vm-test-run-nixbot-gitlab
checks.aarch64-linux.nixbot-gitlab
· build #249
· raw
1tribuchet: building on eliza2Machine state will be reset. To keep it, pass --keep-machine-state3start all VLans4(finished: start all VLans, in 0.00 seconds)5Test will time out and terminate in 3600 seconds6run the VM test script7start all VMs8gitlab: starting vm9gitlab: QEMU running (pid 46)10gitlab # Disk image does not exist, creating the virtualisation disk image...11gitlab # Formatting '/build/vm-state-gitlab/tmp.rJUdAIScUa', fmt=raw size=107374182412gitlab # mke2fs 1.47.4 (6-Mar-2025)13(finished: start all VMs, in 68.69 seconds)14gitlab # Discarding device blocks: 0/262144 done15gitlab: waiting for unit setup-gitlab.service16gitlab # Creating filesystem with 262144 4k blocks and 65536 inodes17gitlab: waiting for the VM to finish booting18gitlab # Filesystem UUID: e2964120-f9b8-4961-b515-7f86ed2e9c4c19gitlab # Superblock backups stored on blocks:20gitlab # 32768, 98304, 163840, 22937621gitlab # 22gitlab # Allocating group tables: 0/8 done23gitlab # Writing inode tables: 0/8 done24gitlab # Creating journal (8192 blocks): done25gitlab # Writing superblocks and filesystem accounting information: 0/8 done26gitlab # 27gitlab # Virtualisation disk image created.28gitlab # Creating Nix store image...29gitlab # Created Nix store image.30gitlab # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40]31gitlab # [ 0.000000] Linux version 6.18.43 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Thu Aug 6 17:27:09 UTC 202632gitlab # [ 0.000000] KASLR enabled33gitlab # [ 0.000000] random: crng init done34gitlab # [ 0.000000] Machine model: linux,dummy-virt35gitlab # [ 0.000000] efi: UEFI not found.36gitlab # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT37gitlab # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x00000001bfffffff]38gitlab # [ 0.000000] NODE_DATA(0) allocated [mem 0x1bfdeb740-0x1bfdeeebf]39gitlab # [ 0.000000] Zone ranges:40gitlab # [ 0.000000] DMA [mem 0x0000000040000000-0x00000000ffffffff]41gitlab # [ 0.000000] DMA32 empty42gitlab # [ 0.000000] Normal [mem 0x0000000100000000-0x00000001bfffffff]43gitlab # [ 0.000000] Device empty44gitlab # [ 0.000000] Movable zone start for each node45gitlab # [ 0.000000] Early memory node ranges46gitlab # [ 0.000000] node 0: [mem 0x0000000040000000-0x00000001bfffffff]47gitlab # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x00000001bfffffff]48gitlab # [ 0.000000] cma: Reserved 32 MiB at 0x00000000fe00000049gitlab # [ 0.000000] psci: probing for conduit method from DT.50gitlab # [ 0.000000] psci: PSCIv1.3 detected in firmware.51gitlab # [ 0.000000] psci: Using standard PSCI v0.2 function IDs52gitlab # [ 0.000000] psci: Trusted OS migration not required53gitlab # [ 0.000000] psci: SMC Calling Convention v1.154gitlab # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003)55gitlab # [ 0.000000] percpu: Embedded 76 pages/cpu s186712 r8192 d116392 u31129656gitlab # [ 0.000000] Detected PIPT I-cache on CPU057gitlab # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm)58gitlab # [ 0.000000] CPU features: detected: GICv3 CPU interface59gitlab # [ 0.000000] CPU features: detected: Spectre-v460gitlab # [ 0.000000] CPU features: detected: Spectre-BHB61gitlab # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_3862gitlab # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_2363gitlab # [ 0.000000] alternatives: applying boot alternatives64gitlab # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/y021a12aas2gdisnxayk5lz32d47afs1-nixos-system-gitlab-test/init regInfo=/nix/store/7535bx1wfl33y6bk9vv8xg39mdqz6hj0-closure-info/registration console=ttyAMA0,115200n8 console=tty065gitlab # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/7535bx1wfl33y6bk9vv8xg39mdqz6hj0-closure-info/registration", will be passed to user space.66gitlab # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes67gitlab # [ 0.000000] Dentry cache hash table entries: 1048576 (order: 11, 8388608 bytes, linear)68gitlab # [ 0.000000] Inode-cache hash table entries: 524288 (order: 10, 4194304 bytes, linear)69gitlab # [ 0.000000] software IO TLB: area num 4.70gitlab # [ 0.000000] software IO TLB: mapped [mem 0x00000000fa000000-0x00000000fe000000] (64MB)71gitlab # [ 0.000000] Fallback order for Node 0: 072gitlab # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 157286473gitlab # [ 0.000000] Policy zone: Normal74gitlab # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off75gitlab # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=176gitlab # [ 0.000000] allocated 12582912 bytes of page_ext77gitlab # [ 0.000000] ftrace: allocating 74867 entries in 294 pages78gitlab # [ 0.000000] ftrace: allocated 294 pages with 4 groups79gitlab # [ 0.000000] rcu: Hierarchical RCU implementation.80gitlab # [ 0.000000] rcu: RCU event tracing is enabled.81gitlab # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=4.82gitlab # [ 0.000000] Trampoline variant of Tasks RCU enabled.83gitlab # [ 0.000000] Rude variant of Tasks RCU enabled.84gitlab # [ 0.000000] Tracing variant of Tasks RCU enabled.85gitlab # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.86gitlab # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=487gitlab # [ 0.000000] RCU Tasks: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.88gitlab # [ 0.000000] RCU Tasks Rude: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.89gitlab # [ 0.000000] RCU Tasks Trace: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.90gitlab # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 091gitlab # [ 0.000000] GICv3: 256 SPIs implemented92gitlab # [ 0.000000] GICv3: 0 Extended SPIs implemented93gitlab # [ 0.000000] Root IRQ handler: gic_handle_irq94gitlab # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI95gitlab # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=096gitlab # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a000097gitlab # [ 0.000000] ITS [mem 0x08080000-0x0809ffff]98gitlab # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @100f20000 (indirect, esz 8, psz 64K, shr 1)99gitlab # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @100f30000 (flat, esz 8, psz 64K, shr 1)100gitlab # [ 0.000000] GICv3: using LPI property table @0x0000000100f40000101gitlab # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000100f50000102gitlab # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.103gitlab # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns104gitlab # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt).105gitlab # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns106gitlab # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns107gitlab # [ 0.000029] arm-pv: using stolen time PV108gitlab # [ 0.000367] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)109gitlab # [ 0.000534] Console: colour dummy device 80x25110gitlab # [ 0.000540] printk: legacy console [tty0] enabled111gitlab # [ 0.000722] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000)112gitlab # [ 0.000728] pid_max: default: 32768 minimum: 301113gitlab # [ 0.000827] LSM: initializing lsm=capability,landlock,yama,bpf,ima114gitlab # [ 0.000954] landlock: Up and running.115gitlab # [ 0.000957] Yama: becoming mindful.116gitlab # [ 0.001367] LSM support for eBPF active117gitlab # [ 0.001533] Mount-cache hash table entries: 16384 (order: 5, 131072 bytes, linear)118gitlab # [ 0.001632] Mountpoint-cache hash table entries: 16384 (order: 5, 131072 bytes, linear)119gitlab # [ 0.002701] cacheinfo: Unable to detect cache hierarchy for CPU 0120gitlab # [ 0.003381] rcu: Hierarchical SRCU implementation.121gitlab # [ 0.003384] rcu: Max phase no-delay instances is 1000.122gitlab # [ 0.003531] Timer migration: 1 hierarchy levels; 8 children per group; 1 crossnode level123gitlab # [ 0.004514] fsl-mc MSI: its@8080000 domain created124gitlab # [ 0.004607] EFI services will not be available.125gitlab # [ 0.004762] smp: Bringing up secondary CPUs ...126gitlab # [ 0.005375] Detected PIPT I-cache on CPU1127gitlab # [ 0.005472] GICv3: CPU1: found redistributor 1 region 0:0x00000000080c0000128gitlab # [ 0.005593] GICv3: CPU1: using allocated LPI pending table @0x0000000100f60000129gitlab # [ 0.005716] CPU1: Booted secondary processor 0x0000000001 [0xc00fac40]130gitlab # [ 0.006813] Detected PIPT I-cache on CPU2131gitlab # [ 0.006925] GICv3: CPU2: found redistributor 2 region 0:0x00000000080e0000132gitlab # [ 0.007085] GICv3: CPU2: using allocated LPI pending table @0x0000000100f70000133gitlab # [ 0.007226] CPU2: Booted secondary processor 0x0000000002 [0xc00fac40]134gitlab # [ 0.008254] Detected PIPT I-cache on CPU3135gitlab # [ 0.008375] GICv3: CPU3: found redistributor 3 region 0:0x0000000008100000136gitlab # [ 0.008515] GICv3: CPU3: using allocated LPI pending table @0x0000000100f80000137gitlab # [ 0.008655] CPU3: Booted secondary processor 0x0000000003 [0xc00fac40]138gitlab # [ 0.009165] smp: Brought up 1 node, 4 CPUs139gitlab # [ 0.009192] SMP: Total of 4 processors activated.140gitlab # [ 0.009195] CPU: All CPU(s) started at EL1141gitlab # [ 0.009204] CPU features: detected: Branch Target Identification142gitlab # [ 0.009208] CPU features: detected: ARMv8.4 Translation Table Level143gitlab # [ 0.009211] CPU features: detected: Instruction cache invalidation not required for I/D coherence144gitlab # [ 0.009214] CPU features: detected: Data cache clean to the PoU not required for I/D coherence145gitlab # [ 0.009218] CPU features: detected: Common not Private translations146gitlab # [ 0.009220] CPU features: detected: CRC32 instructions147gitlab # [ 0.009222] CPU features: detected: Data cache clean to Point of Deep Persistence148gitlab # [ 0.009225] CPU features: detected: Data cache clean to Point of Persistence149gitlab # [ 0.009228] CPU features: detected: Data independent timing control (DIT)150gitlab # [ 0.009231] CPU features: detected: E0PD151gitlab # [ 0.009233] CPU features: detected: Enhanced Counter Virtualization152gitlab # [ 0.009236] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF)153gitlab # [ 0.009239] CPU features: detected: Enhanced Virtualization Traps154gitlab # [ 0.009242] CPU features: detected: Fine Grained Traps155gitlab # [ 0.009245] CPU features: detected: Generic authentication (architected QARMA5 algorithm)156gitlab # [ 0.009249] CPU features: detected: RCpc load-acquire (LDAPR)157gitlab # [ 0.009251] CPU features: detected: LSE atomic instructions158gitlab # [ 0.009254] CPU features: detected: Privileged Access Never159gitlab # [ 0.009256] CPU features: detected: PMUv3160gitlab # [ 0.009258] CPU features: detected: RAS Extension Support161gitlab # [ 0.009261] CPU features: detected: RASv1p1 Extension Support162gitlab # [ 0.009263] CPU features: detected: Random Number Generator163gitlab # [ 0.009265] CPU features: detected: Speculation barrier (SB)164gitlab # [ 0.009268] CPU features: detected: Stage-2 Force Write-Back165gitlab # [ 0.009271] CPU features: detected: TLB range maintenance instructions166gitlab # [ 0.009274] CPU features: detected: Speculative Store Bypassing Safe (SSBS)167gitlab # [ 0.009404] alternatives: applying system-wide alternatives168gitlab # [ 0.012213] CPU features: detected: BBM Level 2 without TLB conflict abort169gitlab # [ 0.012458] Memory: 5963748K/6291456K available (24448K kernel code, 7090K rwdata, 26340K rodata, 4736K init, 1106K bss, 272908K reserved, 32768K cma-reserved)170gitlab # [ 0.013900] devtmpfs: initialized171gitlab # [ 0.017818] posixtimers hash table entries: 2048 (order: 3, 32768 bytes, linear)172gitlab # [ 0.017885] futex hash table entries: 1024 (65536 bytes on 1 NUMA nodes, total 64 KiB, linear).173gitlab # [ 0.018057] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL174gitlab # [ 0.018061] 0 pages in range for non-PLT usage175gitlab # [ 0.018063] 508288 pages in range for PLT usage176gitlab # [ 0.018157] pinctrl core: initialized pinctrl subsystem177gitlab # [ 0.018946] DMI not present or invalid.178gitlab # [ 0.022025] NET: Registered PF_NETLINK/PF_ROUTE protocol family179gitlab # [ 0.024455] DMA: preallocated 1024 KiB GFP_KERNEL pool for atomic allocations180gitlab # [ 0.024730] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations181gitlab # [ 0.026804] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations182gitlab # [ 0.026828] audit: initializing netlink subsys (disabled)183gitlab # [ 0.027137] audit: type=2000 audit(0.024:1): state=initialized audit_enabled=0 res=1184gitlab # [ 0.027561] thermal_sys: Registered thermal governor 'fair_share'185gitlab # [ 0.027564] thermal_sys: Registered thermal governor 'bang_bang'186gitlab # [ 0.027568] thermal_sys: Registered thermal governor 'step_wise'187gitlab # [ 0.027571] thermal_sys: Registered thermal governor 'user_space'188gitlab # [ 0.027573] thermal_sys: Registered thermal governor 'power_allocator'189gitlab # [ 0.027658] cpuidle: using governor ladder190gitlab # [ 0.027681] cpuidle: using governor menu191gitlab # [ 0.027869] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers.192gitlab # [ 0.028076] ASID allocator initialised with 65536 entries193gitlab # [ 0.029233] Serial: AMBA PL011 UART driver194gitlab # [ 0.034283] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1195gitlab # [ 0.034604] printk: console [ttyAMA0] enabled196gitlab # [ 0.047223] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages197gitlab # [ 0.047244] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page198gitlab # [ 0.047254] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages199gitlab # [ 0.047262] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page200gitlab # [ 0.047270] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages201gitlab # [ 0.047278] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page202gitlab # [ 0.047286] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages203gitlab # [ 0.047294] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page204gitlab # [ 0.058746] fbcon: Taking over console205gitlab # [ 0.058756] ACPI: Interpreter disabled.206gitlab # [ 0.059738] iommu: Default domain type: Translated207gitlab # [ 0.059742] iommu: DMA domain TLB invalidation policy: strict mode208gitlab # [ 0.068559] SCSI subsystem initialized209gitlab # [ 0.068933] usbcore: registered new interface driver usbfs210gitlab # [ 0.068957] usbcore: registered new interface driver hub211gitlab # [ 0.068972] usbcore: registered new device driver usb212gitlab # [ 0.069257] pps_core: LinuxPPS API ver. 1 registered213gitlab # [ 0.069261] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>214gitlab # [ 0.069269] PTP clock support registered215gitlab # [ 0.069330] EDAC MC: Ver: 3.0.0216gitlab # [ 0.069681] scmi_core: SCMI protocol bus registered217gitlab # [ 0.070135] FPGA manager framework218gitlab # [ 0.070906] vgaarb: loaded219gitlab # [ 0.072805] clocksource: Switched to clocksource arch_sys_counter220gitlab # [ 0.076596] VFS: Disk quotas dquot_6.6.0221gitlab # [ 0.076618] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)222gitlab # [ 0.077001] netfs: FS-Cache loaded223gitlab # [ 0.077129] pnp: PnP ACPI: disabled224gitlab # [ 0.090995] NET: Registered PF_INET protocol family225gitlab # [ 0.093562] IP idents hash table entries: 131072 (order: 8, 1048576 bytes, linear)226gitlab # [ 0.155412] tcp_listen_portaddr_hash hash table entries: 4096 (order: 4, 65536 bytes, linear)227gitlab # [ 0.155484] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)228gitlab # [ 0.155548] TCP established hash table entries: 65536 (order: 7, 524288 bytes, linear)229gitlab # [ 0.155984] TCP bind hash table entries: 65536 (order: 9, 2097152 bytes, linear)230gitlab # [ 0.156988] TCP: Hash tables configured (established 65536 bind 65536)231gitlab # [ 0.157110] MPTCP token hash table entries: 8192 (order: 6, 196608 bytes, linear)232gitlab # [ 0.157187] UDP hash table entries: 4096 (order: 6, 262144 bytes, linear)233gitlab # [ 0.157368] UDP-Lite hash table entries: 4096 (order: 6, 262144 bytes, linear)234gitlab # [ 0.157616] NET: Registered PF_UNIX/PF_LOCAL protocol family235gitlab # [ 0.157697] NET: Registered PF_XDP protocol family236gitlab # [ 0.157717] PCI: CLS 0 bytes, default 64237gitlab # [ 0.157911] Trying to unpack rootfs image as initramfs...238gitlab # [ 0.165537] kvm [1]: HYP mode not available239gitlab # [ 0.232177] Initialise system trusted keyrings240gitlab # [ 0.232441] workingset: timestamp_bits=42 max_order=21 bucket_order=0241gitlab # [ 0.233249] squashfs: version 4.0 (2009/01/31) Phillip Lougher242gitlab # [ 0.233378] 9p: Installing v9fs 9p2000 file system support243gitlab # [ 0.248779] Key type asymmetric registered244gitlab # [ 0.248785] Asymmetric key parser 'x509' registered245gitlab # [ 0.248840] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242)246gitlab # [ 0.249070] io scheduler mq-deadline registered247gitlab # [ 0.249076] io scheduler kyber registered248gitlab # [ 0.259231] pl061_gpio 9030000.pl061: PL061 GPIO chip registered249gitlab # [ 0.260966] ledtrig-cpu: registered to indicate activity on CPUs250gitlab # [ 0.261539] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges:251gitlab # [ 0.261560] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000252gitlab # [ 0.261573] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000253gitlab # [ 0.261582] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000254gitlab # [ 0.261618] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits255gitlab # [ 0.261648] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff]256gitlab # [ 0.261796] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00257gitlab # [ 0.261819] pci_bus 0000:00: root bus resource [bus 00-ff]258gitlab # [ 0.261837] pci_bus 0000:00: root bus resource [io 0x0000-0xffff]259gitlab # [ 0.261842] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff]260gitlab # [ 0.261847] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff]261gitlab # [ 0.261951] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint262gitlab # [ 0.262809] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint263gitlab # [ 0.263145] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f]264gitlab # [ 0.263165] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff]265gitlab # [ 0.263213] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]266gitlab # [ 0.263232] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref]267gitlab # [ 0.264058] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint268gitlab # [ 0.264391] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f]269gitlab # [ 0.264408] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff]270gitlab # [ 0.264456] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]271gitlab # [ 0.265259] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint272gitlab # [ 0.265606] pci 0000:00:03.0: BAR 0 [io 0x0000-0x001f]273gitlab # [ 0.265624] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff]274gitlab # [ 0.265670] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]275gitlab # [ 0.266460] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint276gitlab # [ 0.266776] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f]277gitlab # [ 0.266794] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff]278gitlab # [ 0.266841] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]279gitlab # [ 0.267677] pci 0000:00:05.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint280gitlab # [ 0.268003] pci 0000:00:05.0: BAR 0 [io 0x0000-0x007f]281gitlab # [ 0.268021] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff]282gitlab # [ 0.268061] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]283gitlab # [ 0.268905] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint284gitlab # [ 0.269246] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f]285gitlab # [ 0.269264] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff]286gitlab # [ 0.269304] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]287gitlab # [ 0.270168] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint288gitlab # [ 0.270487] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f]289gitlab # [ 0.270505] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff]290gitlab # [ 0.270546] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]291gitlab # [ 0.270564] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref]292gitlab # [ 0.271405] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint293gitlab # [ 0.271741] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff]294gitlab # [ 0.271782] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]295gitlab # [ 0.272601] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint296gitlab # [ 0.272961] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff]297gitlab # [ 0.273007] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]298gitlab # [ 0.273664] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint299gitlab # [ 0.273976] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff]300gitlab # [ 0.274387] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint301gitlab # [ 0.274788] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f]302gitlab # [ 0.274806] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff]303gitlab # [ 0.274847] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]304gitlab # [ 0.275696] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint305gitlab # [ 0.276026] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f]306gitlab # [ 0.276043] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff]307gitlab # [ 0.276084] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]308gitlab # [ 0.277082] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned309gitlab # [ 0.277092] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned310gitlab # [ 0.277098] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned311gitlab # [ 0.277177] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned312gitlab # [ 0.277251] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned313gitlab # [ 0.277319] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned314gitlab # [ 0.277392] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned315gitlab # [ 0.277476] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned316gitlab # [ 0.277544] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned317gitlab # [ 0.277616] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned318gitlab # [ 0.277685] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned319gitlab # [ 0.277759] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned320gitlab # [ 0.277848] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned321gitlab # [ 0.277913] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned322gitlab # [ 0.277948] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned323gitlab # [ 0.277976] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned324gitlab # [ 0.278003] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned325gitlab # [ 0.278032] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned326gitlab # [ 0.278066] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned327gitlab # [ 0.278094] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned328gitlab # [ 0.278122] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned329gitlab # [ 0.278151] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned330gitlab # [ 0.278179] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned331gitlab # [ 0.278207] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned332gitlab # [ 0.278235] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned333gitlab # [ 0.278262] pci 0000:00:05.0: BAR 0 [io 0x1000-0x107f]: assigned334gitlab # [ 0.278289] pci 0000:00:06.0: BAR 0 [io 0x1080-0x10ff]: assigned335gitlab # [ 0.278321] pci 0000:00:0b.0: BAR 0 [io 0x1100-0x113f]: assigned336gitlab # [ 0.278354] pci 0000:00:01.0: BAR 0 [io 0x1140-0x115f]: assigned337gitlab # [ 0.278386] pci 0000:00:02.0: BAR 0 [io 0x1160-0x117f]: assigned338gitlab # [ 0.278419] pci 0000:00:03.0: BAR 0 [io 0x1180-0x119f]: assigned339gitlab # [ 0.278452] pci 0000:00:04.0: BAR 0 [io 0x11a0-0x11bf]: assigned340gitlab # [ 0.278485] pci 0000:00:07.0: BAR 0 [io 0x11c0-0x11df]: assigned341gitlab # [ 0.278519] pci 0000:00:0c.0: BAR 0 [io 0x11e0-0x11ff]: assigned342gitlab # [ 0.278553] pci_bus 0000:00: resource 4 [io 0x0000-0xffff]343gitlab # [ 0.278561] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff]344gitlab # [ 0.278566] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff]345gitlab # [ 0.280583] pci 0000:00:0a.0: enabling device (0000 -> 0002)346gitlab # [ 0.297553] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003)347gitlab # [ 0.300450] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003)348gitlab # [ 0.303169] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003)349gitlab # [ 0.305974] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003)350gitlab # [ 0.309784] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003)351gitlab # [ 0.314070] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003)352gitlab # [ 0.316617] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003)353gitlab # [ 0.319252] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002)354gitlab # [ 0.321955] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002)355gitlab # [ 0.325699] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003)356gitlab # [ 0.328722] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003)357gitlab # [ 0.335996] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled358gitlab # [ 0.338297] msm_serial: driver initialized359gitlab # [ 0.338487] SuperH (H)SCI(F) driver initialized360gitlab # [ 0.338561] STM32 USART driver initialized361gitlab # [ 0.366951] loop: module loaded362gitlab # [ 0.367153] virtio_blk virtio4: 4/0/0 default/read/poll queues363gitlab # [ 0.369450] virtio_blk virtio4: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)364gitlab # [ 0.371665] virtio_blk virtio5: 4/0/0 default/read/poll queues365gitlab # [ 0.373723] virtio_blk virtio5: [vdb] 12204224 512-byte logical blocks (6.25 GB/5.82 GiB)366gitlab # [ 0.376180] megasas: 07.734.00.00-rc1367gitlab # [ 0.377059] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff]368gitlab # [ 0.379404] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000369gitlab # [ 0.379421] Intel/Sharp Extended Query Table at 0x0031370gitlab # [ 0.381264] Using buffer write method371gitlab # [ 0.381352] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff]372gitlab # [ 0.383343] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000373gitlab # [ 0.383357] Intel/Sharp Extended Query Table at 0x0031374gitlab # [ 0.385440] Using buffer write method375gitlab # [ 0.385457] Concatenating MTD devices:376gitlab # [ 0.385459] (0): "0.flash"377gitlab # [ 0.385462] (1): "0.flash"378gitlab # [ 0.385465] into device "0.flash"379gitlab # [ 0.576237] Freeing initrd memory: 27184K380gitlab # [ 0.588928] tun: Universal TUN/TAP device driver, 1.6381gitlab # [ 0.592740] thunder_xcv, ver 1.0382gitlab # [ 0.592779] thunder_bgx, ver 1.0383gitlab # [ 0.592817] nicpf, ver 1.0384gitlab # [ 0.593390] e1000: Intel(R) PRO/1000 Network Driver385gitlab # [ 0.593395] e1000: Copyright (c) 1999-2006 Intel Corporation.386gitlab # [ 0.593420] e1000e: Intel(R) PRO/1000 Network Driver387gitlab # [ 0.593425] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.388gitlab # [ 0.593449] igb: Intel(R) Gigabit Ethernet Network Driver389gitlab # [ 0.593452] igb: Copyright (c) 2007-2014 Intel Corporation.390gitlab # [ 0.593472] igbvf: Intel(R) Gigabit Virtual Function Network Driver391gitlab # [ 0.593476] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.392gitlab # [ 0.593610] sky2: driver version 1.30393gitlab # [ 0.595222] usbcore: registered new interface driver usb-storage394gitlab # [ 0.595331] usbcore: registered new interface driver usbserial_generic395gitlab # [ 0.595343] usbserial: USB Serial support registered for generic396gitlab # [ 0.595944] hv_vmbus: registering driver hyperv_keyboard397gitlab # [ 0.596461] ehci-pci 0000:00:0a.0: EHCI Host Controller398gitlab # [ 0.596532] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 1399gitlab # [ 0.596888] rtc-pl031 9010000.pl031: registered as rtc0400gitlab # [ 0.596910] rtc-pl031 9010000.pl031: setting system clock to 2026-08-20T06:09:13 UTC (1787206153)401gitlab # [ 0.597154] ehci-pci 0000:00:0a.0: irq 15, io mem 0x10089000402gitlab # [ 0.597207] i2c_dev: i2c /dev entries driver403gitlab # [ 0.600072] sdhci: Secure Digital Host Controller Interface driver404gitlab # [ 0.600078] sdhci: Copyright(c) Pierre Ossman405gitlab # [ 0.600345] Synopsys Designware Multimedia Card Interface Driver406gitlab # [ 0.600756] sdhci-pltfm: SDHCI platform and OF driver helper407gitlab # [ 0.602452] hid: raw HID events driver (C) Jiri Kosina408gitlab # [ 0.602740] usbcore: registered new interface driver usbhid409gitlab # [ 0.602744] usbhid: USB HID core driver410gitlab # [ 0.608910] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.00411gitlab # [ 0.609894] hub 1-0:1.0: USB hub found412gitlab # [ 0.610050] hub 1-0:1.0: 6 ports detected413gitlab # [ 0.610290] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available414gitlab # [ 0.611892] drop_monitor: Initializing network drop monitor service415gitlab # [ 0.612037] NET: Registered PF_INET6 protocol family416gitlab # [ 0.612903] Segment Routing with IPv6417gitlab # [ 0.612941] In-situ OAM (IOAM) with IPv6418gitlab # [ 0.613017] NET: Registered PF_PACKET protocol family419gitlab # [ 0.613230] 9pnet: Installing 9P2000 support420gitlab # [ 0.614776] Key type dns_resolver registered421gitlab # [ 0.620465] registered taskstats version 1422gitlab # [ 0.620655] Loading compiled-in X.509 certificates423gitlab # [ 0.629010] Demotion targets for Node 0: null424gitlab # [ 0.629143] Key type .fscrypt registered425gitlab # [ 0.629147] Key type fscrypt-provisioning registered426gitlab # [ 0.629242] ima: No TPM chip found, activating TPM-bypass!427gitlab # [ 0.629259] ima: Allocated hash algorithm: sha1428gitlab # [ 0.629281] ima: No architecture policies found429gitlab # [ 0.630029] input: gpio-keys as /devices/platform/gpio-keys/input/input0430gitlab # [ 0.646953] clk: Disabling unused clocks431gitlab # [ 0.646973] PM: genpd: Disabling unused power domains432gitlab # [ 0.651047] Freeing unused kernel memory: 4736K433gitlab # [ 0.651222] Run /init as init process434gitlab # [ 0.689898] systemd[1]: Successfully made /usr/ read-only.435gitlab # [ 0.856922] usb 1-1: new high-speed USB device number 2 using ehci-pci436gitlab # [ 1.009465] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input1437gitlab # [ 1.024109] systemd[1]: systemd 261.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)438gitlab # [ 1.024176] systemd[1]: Detected virtualization qemu.439gitlab # [ 1.024247] systemd[1]: Detected architecture arm64.440gitlab # [ 1.024263] systemd[1]: Running in initrd.441gitlab # [ 1.025137] systemd[1]: Initializing machine ID from random generator.442gitlab # [ 1.025387] systemd[1]: Hostname set to <gitlab>.443gitlab # [ 1.113544] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input0444gitlab # [ 1.232919] usb 1-2: new high-speed USB device number 3 using ehci-pci445gitlab # [ 1.277101] systemd[1]: bpf-restrict-fs: LSM BPF program attached446gitlab # [ 1.376016] systemd[1]: Queued start job for default target Initrd Default Target.447gitlab # [ 1.386637] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input2448gitlab # [ 1.387000] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input0449gitlab # [ 1.392403] systemd[1]: Created slice Slice /system/modprobe.450gitlab # [ 1.392682] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.451gitlab # [ 1.392724] systemd[1]: Expecting device /dev/disk/by-label/nix-store...452gitlab # [ 1.392739] systemd[1]: Expecting device /dev/disk/by-label/nixos...453gitlab # [ 1.392768] systemd[1]: Reached target Path Units.454gitlab # [ 1.392787] systemd[1]: Reached target Slice Units.455gitlab # [ 1.392807] systemd[1]: Reached target Swaps.456gitlab # [ 1.392947] systemd[1]: Reached target Timer Units.457gitlab # [ 1.393201] systemd[1]: Listening on D-Bus System Message Bus Socket.458gitlab # [ 1.393404] systemd[1]: Listening on Journal Socket (/dev/log).459gitlab # [ 1.393601] systemd[1]: Listening on Journal Sockets.460gitlab # [ 1.393783] systemd[1]: Listening on udev Control Socket.461gitlab # [ 1.393893] systemd[1]: Listening on udev Kernel Socket.462gitlab # [ 1.393918] systemd[1]: Reached target Socket Units.463gitlab # [ 1.396398] systemd[1]: Starting Create List of Static Device Nodes...464gitlab # [ 1.398600] systemd[1]: Starting Load Kernel Module 9pnet_virtio...465gitlab # [ 1.398682] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs466gitlab # [ 1.400899] systemd[1]: Mounting Kernel Configuration File System...467gitlab # [ 1.428397] systemd[1]: Starting Journal Service...468gitlab # [ 1.430715] systemd[1]: Starting Load Kernel Modules...469gitlab # [ 1.430829] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os470gitlab # [ 1.433578] systemd[1]: Starting Coldplug All udev Devices...471gitlab # [ 1.435713] systemd[1]: Finished Create List of Static Device Nodes.472gitlab # [ 1.441976] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.473gitlab # [ 1.442372] systemd[1]: Finished Load Kernel Module 9pnet_virtio.474gitlab # [ 1.442686] systemd[1]: Mounted Kernel Configuration File System.475gitlab # [ 1.449122] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...476gitlab # [ 1.464630] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.477gitlab # [ 1.464952] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev478gitlab # [ 1.480483] systemd-journald[95]: Collecting audit messages is disabled.479gitlab # [ 1.481508] [drm] pci: virtio-gpu-pci detected at 0000:00:08.0480gitlab # [ 1.481717] [drm] features: -virgl +edid -resource_blob -host_visible481gitlab # [ 1.481722] [drm] features: -context_init482gitlab # [ 1.482985] [drm] number of scanouts: 1483gitlab # [ 1.483005] [drm] number of cap sets: 0484gitlab # [ 1.487371] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.485gitlab # [ 1.489289] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic486gitlab # [ 1.489302] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 0487gitlab # [ 1.489901] systemd[1]: Starting Create Static Device Nodes in /dev...488gitlab # [ 1.507054] Console: switching to colour frame buffer device 160x50489gitlab # [ 1.508211] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device490gitlab # [ 1.510163] systemd[1]: Finished Create Static Device Nodes in /dev.491gitlab # [ 1.510434] systemd[1]: Reached target Preparation for Local File Systems.492gitlab # [ 1.510481] systemd[1]: Reached target Local File Systems.493gitlab # [ 1.514939] systemd[1]: Starting Rule-based Manager for Device Events and Files...494gitlab # [ 1.549271] systemd[1]: Finished Load Kernel Modules.495gitlab # [ 1.548997] systemd-modules-load[96]: Using 4 probe threads496gitlab # [ 1.551951] systemd-modules-load[96]: Module 'virtio_balloon' is built in[ 1.553411] systemd[1]: Starting Apply Kernel Variables...497gitlab # [ 1.555262] systemd[1]: Started Journal Service.498gitlab # 499gitlab # [ 1.558098] systemd-modules-load[96]: Module 'virtio_console' is built in500gitlab # [ 1.559319] systemd-modules-load[96]: Module 'virtio_rng' is built in501gitlab # [ 1.561288] systemd-modules-load[96]: Inserted module 'dm_mod'502gitlab # [ 1.562289] systemd-modules-load[96]: Inserted module 'virtio_gpu'503gitlab # [ 1.564311] systemd[1]: Starting Create System Files and Directories...504gitlab # [ 1.588457] systemd-udevd[104]: Using default interface naming scheme 'v261'.505gitlab # [ 1.591892] systemd[1]: Finished Apply Kernel Variables.506gitlab # [ 1.595276] systemd[1]: Finished Create System Files and Directories.507gitlab # [ 1.611691] systemd[1]: Started Rule-based Manager for Device Events and Files.508gitlab # [ 1.634484] systemd[1]: Starting Virtual Console Setup...509gitlab # [ 1.692653] systemd-vconsole-setup[129]: Configuration of first virtual console was skipped, ignoring remaining ones.510gitlab # [ 1.696454] systemd[1]: Finished Virtual Console Setup.511gitlab # [ 2.069773] systemd[1]: Finished Coldplug All udev Devices.512gitlab # [ 2.072265] systemd[1]: Reached target System Initialization.513gitlab # [ 2.074785] systemd[1]: Reached target Basic System.514gitlab # [ 2.275210] (udev-worker)[126]: Network interface NamePolicy= disabled on kernel command line.515gitlab # [ 2.289149] systemd[1]: Found device /dev/disk/by-label/nixos.516gitlab # [ 2.290527] systemd[1]: Reached target Initrd Root Device.517gitlab # [ 2.291825] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...518gitlab # [ 2.314981] (udev-worker)[136]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.519gitlab # [ 2.321606] (udev-worker)[136]: Network interface NamePolicy= disabled on kernel command line.520gitlab # [ 2.323623] systemd[1]: Found device /dev/disk/by-label/nix-store.521gitlab # [ 2.338567] systemd-fsck[152]: nixos: clean, 12/65536 files, 13019/262144 blocks522gitlab # [ 2.344093] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.523gitlab # [ 2.431337] systemd[1]: Mounting /sysroot...524gitlab # [ 2.474007] EXT4-fs (vda): mounted filesystem e2964120-f9b8-4961-b515-7f86ed2e9c4c r/w with ordered data mode. Quota mode: none.525gitlab # [ 2.471666] systemd[1]: Mounted /sysroot.526gitlab # [ 2.475436] systemd[1]: Reached target Initrd Root File System.527gitlab # [ 2.476529] systemd[1]: Mounting /sysroot/nix/.ro-store...528gitlab # [ 2.479209] systemd[1]: Mounting /sysroot/nix/.rw-store...529gitlab # [ 2.496243] systemd[1]: Mounting /sysroot/run...530gitlab # [ 2.497743] systemd[1]: Mounting /sysroot/tmp/shared...531gitlab # [ 2.501784] systemd[1]: Mounting /sysroot/tmp/xchg...532gitlab # [ 2.508907] systemd[1]: Starting Mountpoints Configured in the Real Root...533gitlab # [ 2.511292] systemd[1]: Mounted /sysroot/nix/.rw-store.534gitlab # [ 2.515867] systemd[1]: Mounted /sysroot/run.535gitlab # [ 2.524259] systemd[1]: Starting rw-sysroot-nix-store.service...536gitlab # [ 2.526499] systemd-sysroot-fstab-check[166]: /sysroot should be mounted in the initrd, will request daemon-reload.537gitlab # [ 2.530153] systemd[1]: Mounted /sysroot/nix/.ro-store.538gitlab # [ 2.531300] erofs (device vdb): mounted with root inode @ nid 128.539gitlab # [ 2.533307] systemd[1]: Mounted /sysroot/tmp/shared.540gitlab # [ 2.534152] systemd[1]: Mounted /sysroot/tmp/xchg.541gitlab # [ 2.535330] systemd[1]: Reload requested from client PID 166 ('systemd-sysroot') (unit initrd-parse-etc.service)...542gitlab # [ 2.537237] systemd[1]: Reloading...543gitlab # [ 2.649081] systemd[1]: Reloading finished in 113 ms.544gitlab # [ 2.695958] systemd-sysroot-fstab-check[166]: Requesting initrd-fs.target/start/replace...545gitlab # [ 2.697775] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.546gitlab # [ 2.699073] systemd[1]: Finished rw-sysroot-nix-store.service.547gitlab # [ 2.700172] systemd-sysroot-fstab-check[166]: Requesting swap.target/start/replace...548gitlab # [ 2.703175] systemd[1]: Starting rw-sysroot-nix-store.service...549gitlab # [ 2.704571] systemd[1]: initrd-parse-etc.service: Deactivated successfully.550gitlab # [ 2.705569] systemd[1]: Finished Mountpoints Configured in the Real Root.551gitlab # [ 2.706526] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies.552gitlab # [ 2.728612] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.553gitlab # [ 2.730372] systemd[1]: Finished rw-sysroot-nix-store.service.554gitlab # [ 2.853602] (udev-worker)[140]: mtd0ro: Failed to find and pin callout binary "/nix/store/x3ma60wd3w0db1m4dr1xln72q96lnm3b-systemd-261.1/lib/udev/mtd_probe": No such file or directory555gitlab # [ 2.856057] (udev-worker)[140]: mtd0ro: /nix/store/x3ma60wd3w0db1m4dr1xln72q96lnm3b-systemd-261.1/lib/udev/rules.d/75-probe_mtd.rules:5 IMPORT{program}="mtd_probe $devnode": Failed to execute "mtd_probe /dev/mtd0ro", ignoring: No such file or directory556gitlab # [ 2.865334] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.557gitlab # [ 2.866706] systemd[1]: Stopped Virtual Console Setup.558gitlab # [ 2.867721] systemd[1]: Stopping Virtual Console Setup...559gitlab # [ 2.870618] systemd[1]: Starting Virtual Console Setup...560gitlab # [ 2.888780] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.561gitlab # [ 2.889822] systemd[1]: Stopped Virtual Console Setup.562gitlab # [ 2.890563] systemd[1]: Starting Virtual Console Setup...563gitlab # [ 2.909150] systemd-vconsole-setup[197]: Configuration of first virtual console was skipped, ignoring remaining ones.564gitlab # [ 2.911044] systemd[1]: Finished Virtual Console Setup.565gitlab # [ 3.436849] systemd[1]: Mounting /sysroot/nix/store...566gitlab # [ 3.511443] systemd[1]: Mounted /sysroot/nix/store.567gitlab # [ 3.513643] systemd[1]: Reached target Initrd File Systems.568gitlab # [ 3.515928] systemd[1]: Starting Find NixOS closure...569gitlab # [ 3.518173] systemd[1]: Starting Create Volatile Files and Directories in the Real Root...570gitlab # [ 3.555739] systemd[1]: Finished Create Volatile Files and Directories in the Real Root.571gitlab # [ 3.559550] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully.572gitlab # [ 3.580348] systemd[1]: Finished Find NixOS closure.573gitlab # [ 3.582689] systemd[1]: Reached target Initrd Default Target.574gitlab # [ 3.585228] systemd[1]: Starting Cleaning Up and Shutting Down Daemons...575gitlab # [ 3.633765] systemd[1]: Stopped target Initrd Default Target.576gitlab # [ 3.636430] systemd[1]: Stopped target Basic System.577gitlab # [ 3.638628] systemd[1]: Stopped target Initrd Root Device.578gitlab # [ 3.641107] systemd[1]: Stopped target Path Units.579gitlab # [ 3.643306] systemd[1]: systemd-ask-password-console.path: Deactivated successfully.580gitlab # [ 3.646691] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch.581gitlab # [ 3.650064] systemd[1]: Stopped target Slice Units.582gitlab # [ 3.652295] systemd[1]: Stopped target Socket Units.583gitlab # [ 3.657016] systemd[1]: Stopped target System Initialization.584gitlab # [ 3.659510] systemd[1]: Stopped target Swaps.585gitlab # [ 3.663432] systemd[1]: Stopped target Timer Units.586gitlab # [ 3.665905] systemd[1]: dbus.socket: Deactivated successfully.587gitlab # [ 3.672514] systemd[1]: Closed D-Bus System Message Bus Socket.588gitlab # [ 3.675347] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully.589gitlab # [ 3.680941] systemd[1]: Stopped Find NixOS closure.590gitlab # [ 3.683143] systemd[1]: Starting Load Kernel Module 9pnet_virtio...591gitlab # [ 3.685522] systemd[1]: Starting rw-sysroot-nix-store.service...592gitlab # [ 3.687816] systemd[1]: systemd-sysctl.service: Deactivated successfully.593gitlab # [ 3.690692] systemd[1]: Stopped Apply Kernel Variables.594gitlab # [ 3.692818] systemd[1]: systemd-modules-load.service: Deactivated successfully.595gitlab # [ 3.695331] systemd[1]: Stopped Load Kernel Modules.596gitlab # [ 3.697495] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully.597gitlab # [ 3.700381] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root.598gitlab # [ 3.702906] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully.599gitlab # [ 3.705609] systemd[1]: Stopped Create System Files and Directories.600gitlab # [ 3.707717] systemd[1]: Stopped target Local File Systems.601gitlab # [ 3.709641] systemd[1]: Stopped target Preparation for Local File Systems.602gitlab # [ 3.711857] systemd[1]: systemd-udev-trigger.service: Deactivated successfully.603gitlab # [ 3.714355] systemd[1]: Stopped Coldplug All udev Devices.604gitlab # [ 3.716124] systemd[1]: Stopping Rule-based Manager for Device Events and Files...605gitlab # [ 3.718590] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.606gitlab # [ 3.720855] systemd[1]: Stopped Virtual Console Setup.607gitlab # [ 3.722389] systemd[1]: initrd-cleanup.service: Deactivated successfully.608gitlab # [ 3.724238] systemd[1]: Finished Cleaning Up and Shutting Down Daemons.609gitlab # [ 3.726043] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.610gitlab # [ 3.727855] systemd[1]: Finished rw-sysroot-nix-store.service.611gitlab # [ 3.729449] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.612gitlab # [ 3.731229] systemd[1]: Finished Load Kernel Module 9pnet_virtio.613gitlab # [ 3.732771] systemd[1]: systemd-udevd.service: Deactivated successfully.614gitlab # [ 3.734377] systemd[1]: Stopped Rule-based Manager for Device Events and Files.615gitlab # [ 3.736052] systemd[1]: systemd-udevd.service: Consumed 2.205s CPU time over 2.187s wall clock time, 31.6M memory peak.616gitlab # [ 3.738460] systemd[1]: systemd-udevd-control.socket: Deactivated successfully.617gitlab # [ 3.740102] systemd[1]: Closed udev Control Socket.618gitlab # [ 3.741256] systemd[1]: Starting Cleanup udev Database...619gitlab # [ 3.742518] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully.620gitlab # [ 3.744292] systemd[1]: Stopped Create Static Device Nodes in /dev.621gitlab # [ 3.745663] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully.622gitlab # [ 3.747379] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully.623gitlab # [ 3.748954] systemd[1]: kmod-static-nodes.service: Deactivated successfully.624gitlab # [ 3.750423] systemd[1]: Stopped Create List of Static Device Nodes.625gitlab # [ 3.780080] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully.626gitlab # [ 3.783237] systemd[1]: Finished Cleanup udev Database.627gitlab # [ 3.785566] systemd[1]: Reached target Switch Root.628gitlab # [ 3.787646] systemd[1]: Starting NixOS Activation...629gitlab # [ 3.963939] initrd-nixos-activation-start[222]: booting system configuration /nix/store/y021a12aas2gdisnxayk5lz32d47afs1-nixos-system-gitlab-test630gitlab # [ 4.026884] initrd-nixos-activation-start[222]: running activation script...631gitlab # [ 4.331977] initrd-nixos-activation-start[245]: setting up /etc...632gitlab # [ 4.502980] systemd[1]: initrd-nixos-activation.service: Deactivated successfully.633gitlab # [ 4.506484] systemd[1]: Finished NixOS Activation.634gitlab # [ 4.508724] systemd[1]: Starting Switch Root...635gitlab # [ 4.560540] systemd[1]: Switching root.636gitlab # [ 4.685492] systemd-journald[95]: Received SIGTERM from PID 1 (systemd).637gitlab # [ 5.327102] systemd[1]: systemd 261.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)638gitlab # [ 5.327252] systemd[1]: Detected virtualization qemu.639gitlab # [ 5.327347] systemd[1]: Detected architecture arm64.640gitlab # [ 5.327549] systemd[1]: Detected first boot.641gitlab # [ 5.329140] systemd[1]: Initializing machine ID from random generator.642gitlab # [ 5.565719] systemd[1]: bpf-restrict-fs: LSM BPF program attached643gitlab # [ 5.684027] systemd[1]: Applying preset policy.644gitlab # [ 5.889359] systemd[1]: Populated /etc with preset unit settings.645gitlab # [ 6.043629] systemd[1]: initrd-switch-root.service: Deactivated successfully.646gitlab # [ 6.043890] systemd[1]: Stopped initrd-switch-root.service.647gitlab # [ 6.045367] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1.648gitlab # [ 6.050977] systemd[1]: Created slice Slice /system/getty.649gitlab # [ 6.058309] systemd[1]: Created slice GitLab DevOps Platform Slice.650gitlab # [ 6.062242] systemd[1]: Created slice User and Session Slice.651gitlab # [ 6.063625] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.652gitlab # [ 6.064950] systemd[1]: Started Forward Password Requests to Wall Directory Watch.653gitlab # [ 6.066054] systemd[1]: Expecting device /dev/hvc0...654gitlab # [ 6.067092] systemd[1]: Expecting device /dev/ttyAMA0...655gitlab # [ 6.068101] systemd[1]: Reached target Local Encrypted Volumes.656gitlab # [ 6.069171] systemd[1]: Stopped target initrd-fs.target.657gitlab # [ 6.070188] systemd[1]: Stopped target initrd-root-fs.target.658gitlab # [ 6.071201] systemd[1]: Stopped target initrd-switch-root.target.659gitlab # [ 6.072223] systemd[1]: Reached target Virtual Machines and Containers.660gitlab # [ 6.073284] systemd[1]: Reached target Path Units.661gitlab # [ 6.074384] systemd[1]: Reached target Remote File Systems.662gitlab # [ 6.075384] systemd[1]: Reached target Slice Units.663gitlab # [ 6.076358] systemd[1]: Reached target Swaps.664gitlab # [ 6.080130] systemd[1]: Listening on Query the User Interactively for a Password.665gitlab # [ 6.084157] systemd[1]: Listening on Process Core Dump Socket.666gitlab # [ 6.087296] systemd[1]: Listening on Credential Encryption/Decryption.667gitlab # [ 6.090803] systemd[1]: Listening on Factory Reset Management.668gitlab # [ 6.092099] systemd[1]: Listening on Hostname Service Socket.669gitlab # [ 6.101907] systemd[1]: Starting Journal Log Access Socket...670gitlab # [ 6.103940] systemd[1]: Listening on Journal Audit Socket.671gitlab # [ 6.107800] systemd[1]: Listening on Console Output Muting Service Socket.672gitlab # [ 6.109308] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket.673gitlab # [ 6.110327] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os674gitlab # [ 6.111285] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki675gitlab # [ 6.117069] systemd[1]: Listening on Disk Repartitioning Service Socket.676gitlab # [ 6.118400] systemd[1]: Listening on udev Control Socket.677gitlab # [ 6.119747] systemd[1]: Listening on udev Varlink Socket.678gitlab # [ 6.161665] systemd[1]: Mounting Huge Pages File System...679gitlab # [ 6.167217] systemd[1]: Mounting POSIX Message Queue File System...680gitlab # [ 6.173934] systemd[1]: Mounting Kernel Debug File System...681gitlab # [ 6.182556] systemd[1]: Mounting Kernel Trace File System...682gitlab # [ 6.189061] systemd[1]: Starting Create List of Static Device Nodes...683gitlab # [ 6.196900] systemd[1]: Starting Load Kernel Module 9pnet_virtio...684gitlab # [ 6.198503] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs685gitlab # [ 6.217064] systemd[1]: Mounting Kernel Configuration File System...686gitlab # [ 6.218308] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm687gitlab # [ 6.219538] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore688gitlab # [ 6.232422] systemd[1]: Starting Load Kernel Module fuse...689gitlab # [ 6.233489] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67690gitlab # [ 6.248284] systemd[1]: Starting Journal Service...691gitlab # [ 6.252726] systemd[1]: Starting Load Kernel Modules...692gitlab # [ 6.258709] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer...693gitlab # [ 6.269222] systemd[1]: Starting Remount Root and Kernel File Systems...694gitlab # [ 6.270033] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os695gitlab # [ 6.276393] fuse: init (API version 7.45)696gitlab # [ 6.281043] systemd[1]: Starting Coldplug All udev Devices...697gitlab # [ 6.292126] systemd[1]: Listening on Journal Log Access Socket.698gitlab # [ 6.293497] systemd[1]: Mounted Huge Pages File System.699gitlab # [ 6.294317] systemd[1]: Mounted POSIX Message Queue File System.700gitlab # [ 6.295307] systemd[1]: Mounted Kernel Debug File System.701gitlab # [ 6.296101] systemd[1]: Mounted Kernel Trace File System.702gitlab # [ 6.297313] systemd[1]: Finished Create List of Static Device Nodes.703gitlab # [ 6.298475] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.704gitlab # [ 6.300032] systemd[1]: Finished Load Kernel Module 9pnet_virtio.705gitlab # [ 6.301164] systemd[1]: Mounted Kernel Configuration File System.706gitlab # [ 6.302775] systemd-journald[316]: Collecting audit messages is enabled.707gitlab # [ 6.304490] systemd[1]: modprobe@fuse.service: Deactivated successfully.708gitlab # [ 6.307126] systemd[1]: Finished Load Kernel Module fuse.709gitlab # [ 6.323093] systemd[1]: Queued start job for default target Multi-User System.710gitlab # [ 6.324772] systemd[1]: Unnecessary job was removed for /dev/vdb.711gitlab # [ 6.326636] systemd[1]: systemd-journald.service: Deactivated successfully.[ 6.329190] systemd[1]: Mounting FUSE Control File System...712gitlab # 713gitlab # [ 6.331860] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...714gitlab # [ 6.333096] EXT4-fs (vda): re-mounted e2964120-f9b8-4961-b515-7f86ed2e9c4c.715gitlab # [ 6.334667] systemd-modules-load[317]: Using 3 probe threads716gitlab # [ 6.335767] systemd-modules-load[317]: Module 'atkbd' is built in717gitlab # [ 6.337050] systemd-modules-load[317]: Module 'loop' is built in[ 6.341923] systemd[1]: Started Journal Service.718gitlab # 719gitlab # [ 6.340189] systemd-modules-load[317]: Inserted module 'tls'720gitlab # [ 6.352471] systemd[1]: Finished Load Kernel Modules.721gitlab # [ 6.353578] systemd[1]: Finished Remount Root and Kernel File Systems.722gitlab # [ 6.362145] systemd-oomd[319]: No swap; memory pressure usage will be degraded723gitlab # [ 6.364373] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer.724gitlab # [ 6.365427] systemd[1]: Mounted FUSE Control File System.725gitlab # [ 6.367622] systemd[1]: Listening on Disk Image Download Service Socket.726gitlab # [ 6.369609] systemd[1]: Starting Firewall...727gitlab # [ 6.376137] systemd[1]: Starting Flush Journal to Persistent Storage...728gitlab # [ 6.377406] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore729gitlab # [ 6.382620] systemd[1]: Starting Load/Save OS Random Seed...730gitlab # [ 6.397868] systemd-journald[316]: Received client request to flush runtime journal.731gitlab # [ 6.429676] systemd[1]: Starting Apply Kernel Variables...732gitlab # [ 6.431745] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os733gitlab # [ 6.434229] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.734gitlab # [ 6.435477] systemd[1]: Starting Create Static Device Nodes in /dev...735gitlab # [ 6.437762] systemd[1]: Finished Load/Save OS Random Seed.736gitlab # [ 6.438588] systemd[1]: Reached target First Boot Complete.737gitlab # [ 6.439794] systemd[1]: Finished Apply Kernel Variables.738gitlab # [ 6.440690] systemd[1]: Finished Create Static Device Nodes in /dev.739gitlab # [ 6.441600] systemd[1]: Reached target Preparation for Local File Systems.740gitlab # [ 6.442585] systemd[1]: Starting Rule-based Manager for Device Events and Files...741gitlab # [ 6.443666] systemd[1]: Finished Flush Journal to Persistent Storage.742gitlab # [ 6.495903] systemd-udevd[351]: Using default interface naming scheme 'v261'.743gitlab # [ 6.529069] systemd[1]: Started Rule-based Manager for Device Events and Files.744gitlab # [ 6.825473] systemd[1]: Finished Firewall.745gitlab # [ 6.905429] systemd[1]: Finished Coldplug All udev Devices.746gitlab # [ 6.989628] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs747gitlab # [ 7.074124] systemd[1]: Condition check resulted in /dev/hvc0 being skipped.748gitlab # [ 7.081117] systemd[1]: Mounting /run/wrappers...749gitlab # [ 7.086142] systemd[1]: Condition check resulted in /dev/ttyAMA0 being skipped.750gitlab # [ 7.111909] (udev-worker)[466]: Network interface NamePolicy= disabled on kernel command line.751gitlab # [ 7.117760] systemd[1]: Mounted /run/wrappers.752gitlab # [ 7.118640] systemd[1]: Reached target Local File Systems.753gitlab # [ 7.119658] systemd[1]: Listening on Boot Loader Control Service Socket.754gitlab # [ 7.122576] systemd[1]: Starting register-nix-paths.service...755gitlab # [ 7.128898] systemd[1]: Starting Create SUID/SGID Wrappers...756gitlab # [ 7.130684] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met.757gitlab # [ 7.134017] (udev-worker)[469]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.758gitlab # [ 7.138591] (udev-worker)[469]: Network interface NamePolicy= disabled on kernel command line.759gitlab # [ 7.148558] systemd[1]: Starting Save Transient machine-id to Disk...760gitlab # [ 7.151606] systemd[1]: Starting Create System Files and Directories...761gitlab # [ 7.161124] systemd[1]: Condition check resulted in Virtio network device being skipped.762gitlab # [ 7.175528] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore763gitlab # [ 7.178175] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met.764gitlab # [ 7.179720] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67765gitlab # [ 7.183372] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore766gitlab # [ 7.185849] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os767gitlab # [ 7.187149] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os768gitlab # [ 7.200642] systemd[1]: etc-machine\x2did.mount: Deactivated successfully.769gitlab # [ 7.204462] systemd[1]: Finished Save Transient machine-id to Disk.770gitlab # [ 7.226046] systemd[1]: Finished Create System Files and Directories.771gitlab # [ 7.287889] systemd[1]: Starting Rebuild Journal Catalog...772gitlab # [ 7.292403] systemd[1]: Starting Record System Boot/Shutdown in UTMP...773gitlab # [ 7.297312] mousedev: PS/2 mouse device common for all mice774gitlab # [ 7.319530] systemd[1]: Finished Record System Boot/Shutdown in UTMP.775gitlab # [ 7.329566] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully.776gitlab # [ 7.330791] systemd[1]: Finished Create SUID/SGID Wrappers.777gitlab # [ 7.331658] systemd[1]: suid-sgid-wrappers.service: Consumed 139ms CPU time over 200ms wall clock time, 6.1M memory peak, 1.9M read from disk.778gitlab # [ 7.335155] systemd[1]: Finished Rebuild Journal Catalog.779gitlab # [ 7.337586] systemd[1]: Starting Update is Completed...780gitlab # [ 7.370708] systemd[1]: Finished Update is Completed.781gitlab # [ 7.602839] systemd[1]: Finished register-nix-paths.service.782gitlab # [ 7.607007] systemd[1]: Reached target System Initialization.783gitlab # [ 7.607942] systemd[1]: Started Discard unused filesystem blocks once a week.784gitlab # [ 7.609069] systemd[1]: Started logrotate.timer.785gitlab # [ 7.609788] systemd[1]: Started Daily Cleanup of Temporary Directories.786gitlab # [ 7.610744] systemd[1]: Reached target Timer Units.787gitlab # [ 7.611487] systemd[1]: Listening on D-Bus System Message Bus Socket.788gitlab # [ 7.612491] systemd[1]: Listening on Nix Daemon Socket.789gitlab # [ 7.614387] systemd[1]: Starting nixbot CI service socket...790gitlab # [ 7.615326] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket.791gitlab # [ 7.618900] systemd[1]: Starting D-Bus System Message Bus...792gitlab # [ 7.620173] systemd[1]: Listening on nixbot CI service socket.793gitlab # [ 7.621201] systemd[1]: Reached target Socket Units.794gitlab # [ 7.655093] dbus-broker-launch[559]: Looking up NSS user entry for 'systemd-timesync'...795gitlab # [ 7.656508] dbus-broker-launch[559]: NSS returned no entry for 'systemd-timesync'796gitlab # [ 7.657858] dbus-broker-launch[559]: Invalid user-name in /nix/store/9zcyylhndlnizbwn48627991zr1jxg4p-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync"797gitlab # [ 7.661398] systemd[1]: Started D-Bus System Message Bus.798gitlab # [ 7.675427] dbus-broker-launch[559]: Ready799gitlab # [ 7.678159] systemd[1]: Reached target Basic System.800gitlab # [ 7.681800] systemd[1]: Started backdoor.service.801gitlab # [ 7.685891] systemd[1]: Starting gitlab-config.service...802gitlab # [ 7.724973] input: QEMU Virtio Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:09.0/virtio8/input/input3803gitlab # connecting to host...804gitlab: Guest shell says: b'Spawning backdoor root shell...\n'805gitlab # [ 7.760072] systemd[1]: Starting Import lastlog data into lastlog2 database...806gitlab: connected to guest root shell807gitlab: (connecting took 8.20 seconds)808gitlab: (finished: waiting for the VM to finish booting, in 8.20 seconds)809gitlab # [ 7.801369] systemd[1]: Starting Logrotate configuration check...810gitlab # [ 7.822272] systemd[1]: Starting Name Service Cache Daemon (nsncd)...811gitlab # [ 7.824673] systemd[1]: Starting Post-Boot Actions...812gitlab # [ 7.828248] logrotate[575]: warning: logrotate in debug mode does nothing except printing debug messages! Consider using verbose mode (-v) instead if this is not what you want.813gitlab # [ 7.830372] logrotate[575]: reading config file /nix/store/22afkmbkaxyx50bj9lbkkpmz7pd69hsf-logrotate.conf814gitlab # [ 7.831670] logrotate[575]: note: 'monthly' overrides previously specified 'weekly'815gitlab # [ 7.838872] logrotate[575]: Reading state from file: /var/lib/logrotate.status816gitlab # [ 7.839948] logrotate[575]: state file /var/lib/logrotate.status does not exist817gitlab # [ 7.841702] logrotate[575]: Allocating hash table for state file, size 64 entries818gitlab # [ 7.842707] logrotate[575]: Handling 4 logs819gitlab # [ 7.843282] logrotate[575]: rotating pattern: "/var/log/btmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed820gitlab # [ 7.848195] logrotate[575]: considering log /var/log/btmp821gitlab # [ 7.852129] logrotate[575]: Creating new state822gitlab # [ 7.852781] logrotate[575]: Now: 2026-08-20 06:09823gitlab # [ 7.853454] logrotate[575]: Last rotated at 2026-08-20 06:00824gitlab # [ 7.854393] logrotate[575]: log does not need rotating (log has already been rotated)825gitlab # [ 7.855509] logrotate[575]: rotating pattern: "/var/log/wtmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed826gitlab # [ 7.858779] logrotate[575]: considering log /var/log/wtmp827gitlab # [ 7.859502] logrotate[575]: Creating new state828gitlab # [ 7.861264] logrotate[575]: Now: 2026-08-20 06:09829gitlab # [ 7.861904] logrotate[575]: Last rotated at 2026-08-20 06:00830gitlab # [ 7.862655] logrotate[575]: log does not need rotating (log has already been rotated)831gitlab # [ 7.863645] logrotate[575]: rotating pattern: "/var/gitlab/state/log/*.log" after 1 days empty log files are not rotated, (30 rotations), old logs are removed832gitlab # [ 7.865758] logrotate[575]: switching euid from 0 to 165 and egid from 0 to 165 (pid 575)833gitlab # [ 7.866915] logrotate[575]: considering log /var/gitlab/state/log/*.log834gitlab # [ 7.867784] logrotate[575]: log /var/gitlab/state/log/*.log does not exist -- skipping835gitlab # [ 7.869004] logrotate[575]: Creating new state836gitlab # [ 7.869614] logrotate[575]: switching euid from 165 to 0 and egid from 165 to 0 (pid 575)837gitlab # [ 7.870671] logrotate[575]: rotating pattern: "/var/log/nginx/*.log" weekly empty log files are not rotated, (26 rotations), old logs are removed838gitlab # [ 7.874035] logrotate[575]: switching euid from 0 to 60 and egid from 0 to 60 (pid 575)839gitlab # [ 7.875524] logrotate[575]: considering log /var/log/nginx/*.log840gitlab # [ 7.876409] logrotate[575]: log /var/log/nginx/*.log does not exist -- skipping841gitlab # [ 7.877401] logrotate[575]: Creating new state842gitlab # [ 7.878005] logrotate[575]: not running postrotate script, since no logs were rotated843gitlab # [ 7.879017] logrotate[575]: switching euid from 60 to 0 and egid from 60 to 0 (pid 575)844gitlab # [ 7.881877] systemd[1]: Started Reset console on configuration changes.845gitlab # [ 7.883011] systemd[1]: Starting resolvconf update...846gitlab # [ 7.884120] nsncd[576]: Aug 20 06:09:20.773 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"847gitlab # [ 7.886256] systemd[1]: Started Name Service Cache Daemon (nsncd).848gitlab # [ 7.887252] systemd[1]: Finished Logrotate configuration check.849gitlab # [ 7.888316] systemd[1]: Finished Post-Boot Actions.850gitlab # [ 7.889185] systemd[1]: Finished Import lastlog data into lastlog2 database.851gitlab # [ 7.911386] systemd[1]: Reached target Host and Network Name Lookups.852gitlab # [ 7.912379] systemd[1]: Reached target User and Group Name Lookups.853gitlab # [ 7.919064] systemd[1]: Starting User Login Management...854gitlab # [ 7.937465] systemd[1]: Starting Virtual Console Setup...855gitlab # [ 7.945088] systemd[1]: Stopped target Host and Network Name Lookups.856gitlab # [ 7.947774] systemd[1]: Stopping Host and Network Name Lookups...857gitlab # [ 7.948779] systemd[1]: Stopped target User and Group Name Lookups.858gitlab # [ 7.949696] systemd[1]: Stopping User and Group Name Lookups...859gitlab # [ 7.950605] systemd[1]: Stopping Name Service Cache Daemon (nsncd)...860gitlab # [ 7.951457] systemd[1]: nscd.service: Deactivated successfully.861gitlab # [ 7.953897] systemd[1]: Stopped Name Service Cache Daemon (nsncd).862gitlab # [ 7.958550] systemd[1]: nscd.service: Consumed 25ms CPU time over 129ms wall clock time, 7.3M memory peak, 5.8M read from disk.863gitlab # [ 7.960476] systemd[1]: Starting Name Service Cache Daemon (nsncd)...864gitlab # [ 7.979271] nsncd[662]: Aug 20 06:09:20.886 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"865gitlab # [ 7.982580] systemd[1]: Started Name Service Cache Daemon (nsncd).866gitlab # [ 7.983719] systemd[1]: Reached target Host and Network Name Lookups.867gitlab # [ 7.984964] systemd[1]: Reached target User and Group Name Lookups.868gitlab # [ 7.989532] systemd-logind[633]: New seat seat0.869gitlab # [ 7.991802] systemd-logind[633]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard)870gitlab # [ 7.993376] systemd-logind[633]: Watching system buttons on /dev/input/event1 (QEMU QEMU USB Keyboard)871gitlab # [ 7.994694] systemd-logind[633]: Watching system buttons on /dev/input/event0 (gpio-keys)872gitlab # [ 7.995881] systemd[1]: Started User Login Management.873gitlab # [ 7.999962] systemd[1]: Starting linger-users.service...874gitlab # [ 8.002030] systemd-vconsole-setup[639]: Configuration of first virtual console was skipped, ignoring remaining ones.875gitlab # [ 8.003678] systemd[1]: Finished resolvconf update.876gitlab # [ 8.012893] systemd[1]: Finished Virtual Console Setup.877gitlab # [ 8.014409] systemd[1]: Reached target Preparation for Network.878gitlab # [ 8.019213] systemd[1]: Starting DHCP Client...879gitlab # [ 8.023773] systemd[1]: Starting Address configuration of eth1...880gitlab # [ 8.025445] systemd[1]: Starting Extra networking commands....881gitlab # [ 8.027198] systemd[1]: linger-users.service: Deactivated successfully.882gitlab # [ 8.031740] systemd[1]: Finished linger-users.service.883gitlab # [ 8.051815] network-addresses-eth1-start[690]: adding address 192.168.1.1/24... done884gitlab # [ 8.056735] network-addresses-eth1-start[690]: adding address 2001:db8:1::1/64... done885gitlab # [ 8.064356] systemd[1]: Finished Address configuration of eth1.886gitlab # [ 8.108733] systemd[1]: Finished Extra networking commands..887gitlab # [ 8.109671] systemd[1]: Reached target Network.888gitlab # [ 8.115834] systemd[1]: Starting gitlab-workhorse.service...889gitlab # [ 8.117052] systemd[1]: Starting Nginx Web Server...890gitlab # [ 8.119582] systemd[1]: Starting PostgreSQL Server...891gitlab # [ 8.122887] dhcpcd[709]: dhcpcd-10.3.2 starting892gitlab # [ 8.128582] dhcpcd[759]: dev: loaded udev893gitlab # [ 8.129284] systemd[1]: Starting Redis Server - redis-gitlab...894gitlab # [ 8.132207] systemd[1]: Starting Permit User Sessions...895gitlab # [ 8.146319] 8021q: 802.1Q VLAN Support v1.8896gitlab # [ 8.146723] 8021q: adding VLAN 0 to HW filter on device eth1897gitlab # [ 8.155109] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.898gitlab # [ 8.159682] systemd[1]: Finished Permit User Sessions.899gitlab # [ 8.163979] systemd[1]: Started Getty on tty1.900gitlab # [ 8.165797] systemd[1]: Reached target Login Prompts.901gitlab # [ 8.191807] cfg80211: Loading compiled-in X.509 certificates for regulatory database902gitlab # [ 8.202434] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7'903gitlab # [ 8.203031] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600'904gitlab # [ 8.205238] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2905gitlab # [ 8.205588] cfg80211: failed to load regulatory.db906gitlab # [ 8.249801] 8021q: adding VLAN 0 to HW filter on device eth0907gitlab # [ 8.245958] dhcpcd[759]: eth0: waiting for carrier908gitlab # [ 8.249181] dhcpcd[759]: eth0: carrier acquired909gitlab # [ 8.259994] dhcpcd[759]: DUID 00:01:00:01:32:19:56:91:52:54:00:12:34:56910gitlab # [ 8.261270] dhcpcd[759]: eth0: IAID 00:12:34:56911gitlab # [ 8.261990] dhcpcd[759]: eth0: adding address fe80::5054:ff:fe12:3456912gitlab # [ 8.284191] nginx-pre-start[787]: nginx: the configuration file /nix/store/ybdwy2xmslvjmdkxgrrhy1x5rwh45z0q-nginx.conf syntax is ok913gitlab # [ 8.285952] nginx-pre-start[787]: nginx: configuration file /nix/store/ybdwy2xmslvjmdkxgrrhy1x5rwh45z0q-nginx.conf test is successful914gitlab # [ 8.290274] systemd[1]: Started Nginx Web Server.915gitlab # [ 8.329219] redis-server[785]: Supervised by systemd. Please make sure you set appropriate values for TimeoutStartSec and TimeoutStopSec in your service unit.916gitlab # [ 8.331317] redis-server[785]: oO0OoO0OoO0Oo Redis is starting oO0OoO0OoO0Oo917gitlab # [ 8.333212] postgresql-pre-start[789]: The files belonging to this database system will be owned by user "postgres".918gitlab # [ 8.335115] postgresql-pre-start[789]: This user must also own the server process.919gitlab # [ 8.336277] redis-server[785]: Redis version=8.8.1, bits=64, commit=00000000, modified=0, pid=785, just started920gitlab # [ 8.338065] systemd[1]: Started Redis Server - redis-gitlab.921gitlab # [ 8.338939] postgresql-pre-start[789]: The database cluster will be initialized with locale "en_US.UTF-8".922gitlab # [ 8.340498] postgresql-pre-start[789]: The default database encoding has accordingly been set to "UTF8".923gitlab # [ 8.341701] postgresql-pre-start[789]: The default text search configuration will be set to "english".924gitlab # [ 8.342936] postgresql-pre-start[789]: Data page checksums are enabled.925gitlab # [ 8.343814] postgresql-pre-start[789]: fixing permissions on existing directory /var/lib/postgresql/18 ... ok926gitlab # [ 8.345664] postgresql-pre-start[789]: creating subdirectories ... ok927gitlab # [ 8.346569] postgresql-pre-start[789]: selecting dynamic shared memory implementation ... posix928gitlab # [ 8.350486] redis-server[785]: Configuration loaded929gitlab # [ 8.351422] redis[785]: monotonic clock: ARM CNTVCT @ 1000 ticks/us930gitlab # [ 8.352904] redis[785]: Running mode=standalone, port=0.931gitlab # [ 8.354730] redis[785]: Server initialized932gitlab # [ 8.358023] redis[785]: Ready to accept connections unix933gitlab # [ 8.358959] redis[785]: WARNING: Redis does not require authentication. Redis will accept connections from any local client.934gitlab # [ 8.383049] postgresql-pre-start[789]: selecting default "max_connections" ... 100935gitlab # [ 8.443324] postgresql-pre-start[789]: selecting default "shared_buffers" ... 128MB936gitlab # [ 8.658981] dhcpcd[759]: eth0: soliciting a DHCP lease937gitlab # [ 8.672971] dhcpcd[759]: eth0: offered 10.0.2.15 from 10.0.2.2938gitlab # [ 8.688631] dhcpcd[759]: eth0: probing address 10.0.2.15/24939gitlab # [ 8.712115] systemd[1]: Started gitlab-workhorse.service.940gitlab # [ 8.939197] postgresql-pre-start[789]: selecting default time zone ... UTC941gitlab # [ 8.941181] postgresql-pre-start[789]: creating configuration files ... ok942gitlab # [ 8.971503] gitlab-workhorse[817]: time="2026-08-20T06:09:21Z" level=info msg=Starting build_time=19700101.000000 version=19.0.4943gitlab # [ 8.977956] gitlab-workhorse[817]: time="2026-08-20T06:09:21Z" level=info msg="Using redis/go-redis"944gitlab # [ 8.984174] gitlab-workhorse[817]: time="2026-08-20T06:09:21Z" level=info msg="Running upstream server" address=/run/gitlab/gitlab-workhorse.socket network=unix945gitlab # [ 9.174481] postgresql-pre-start[789]: running bootstrap script ... ok946gitlab # [ 9.845433] dhcpcd[759]: eth0: soliciting an IPv6 router947gitlab # [ 9.848136] dhcpcd[759]: eth0: Router Advertisement from fe80::2948gitlab # [ 9.850778] dhcpcd[759]: eth0: adding address fec0::5054:ff:fe12:3456/64949gitlab # [ 9.853908] dhcpcd[759]: eth0: adding route to fec0::/64950gitlab # [ 9.856353] dhcpcd[759]: eth0: adding default route via fe80::2951gitlab # [ 9.900128] postgresql-pre-start[789]: performing post-bootstrap initialization ... ok952gitlab # [ 10.196762] postgresql-pre-start[789]: syncing data to disk ... ok953gitlab # [ 10.199548] postgresql-pre-start[789]: initdb: warning: enabling "trust" authentication for local connections954gitlab # [ 10.203809] postgresql-pre-start[789]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb.955gitlab # [ 10.210602] postgresql-pre-start[789]: Success. You can now start the database server using:956gitlab # [ 10.214258] postgresql-pre-start[789]: pg_ctl -D /var/lib/postgresql/18 -l logfile start957gitlab # [ 10.416920] postgres[852]: [852] LOG: starting PostgreSQL 18.4 on aarch64-unknown-linux-gnu, compiled by clang version 21.1.8, 64-bit958gitlab # [ 10.422550] postgres[852]: [852] LOG: listening on IPv6 address "::1", port 5432959gitlab # [ 10.426921] postgres[852]: [852] LOG: listening on IPv4 address "127.0.0.1", port 5432960gitlab # [ 10.430712] postgres[852]: [852] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432"961gitlab # [ 10.435524] postgres[865]: [865] LOG: database system was shut down at 2026-08-20 06:09:22 GMT962gitlab # [ 10.439483] postgres[852]: [852] LOG: database system is ready to accept connections963gitlab # [ 10.443425] systemd[1]: Started PostgreSQL Server.964gitlab # [ 10.448146] systemd[1]: Starting PostgreSQL Setup Scripts...965gitlab # [ 10.654802] kmklqy2bdnfisygngf3cnp8jwzlh0j09-gitlab-config[859]: mkdir -p /var/gitlab/state/home/.ssh: OK966gitlab # [ 10.658809] kmklqy2bdnfisygngf3cnp8jwzlh0j09-gitlab-config[859]: chmod 700 /var/gitlab/state/home/.ssh: OK967gitlab # [ 10.731207] systemd[1]: Finished gitlab-config.service.968gitlab # [ 10.738405] systemd[1]: Started gitaly.service.969gitlab # [ 10.784164] postgresql-setup-start[877]: CREATE DATABASE970gitlab # [ 10.832185] postgresql-setup-start[896]: CREATE ROLE971gitlab # [ 10.854877] postgresql-setup-start[898]: ALTER DATABASE972gitlab # [ 10.907921] postgresql-setup-start[903]: CREATE ROLE973gitlab # [ 10.912290] systemd[1]: Finished PostgreSQL Setup Scripts.974gitlab # [ 10.914975] systemd[1]: Reached target PostgreSQL.975gitlab # [ 10.923276] systemd[1]: Starting gitlab-db-config.service...976gitlab # [ 10.926391] systemd[1]: Starting gitlab-postgresql.service...977gitlab # [ 11.130413] gitlab-postgresql-start[918]: CREATE DATABASE978gitlab # [ 11.207477] gitlab-postgresql-start[932]: CREATE EXTENSION979gitlab # [ 11.301215] gitlab-postgresql-start[935]: CREATE EXTENSION980gitlab # [ 11.307347] systemd[1]: Finished gitlab-postgresql.service.981gitlab # [ 11.467956] gitaly[891]: time="2026-08-20T06:09:24.374Z" level=warning msg="The current configurations will cause Gitaly to fail to start up in future versions. Please run 'gitaly configuration validate < /nix/store/0r0qd84zrxhqq373hk9spv8j9pg0qlnq-gitaly.toml' and fix the errors that are printed." pid=891982gitlab # [ 11.483369] gitaly[891]: time="2026-08-20T06:09:24.374Z" level=info msg="maxprocs: Leaving GOMAXPROCS=4: CPU quota undefined" pid=891983gitlab # [ 11.488907] gitaly[891]: time="2026-08-20T06:09:24.375Z" level=info msg="grpc prometheus histograms enabled" latencies="[0.001 0.005 0.025 0.1 0.5 1 10 30 60 300 1500]" pid=891984gitlab # [ 11.500393] gitaly[891]: time="2026-08-20T06:09:24.375Z" level=error msg="error initializing distributed tracing" error="tracing is disabled" pid=891985gitlab # [ 11.505322] gitaly[891]: time="2026-08-20T06:09:24.375Z" level=info msg="Starting Gitaly" pid=891 version=986gitlab # [ 11.699841] gitaly[891]: time="2026-08-20T06:09:24.607Z" level=info msg="finished unpacking auxiliary binaries" duration_ms=231 pid=891987gitlab # [ 11.701734] gitaly[891]: time="2026-08-20T06:09:24.607Z" level=info msg="finished initializing bootstrap" duration_ms=0 pid=891988gitlab # [ 11.703446] gitaly[891]: time="2026-08-20T06:09:24.608Z" level=info msg="finished initializing command factory" duration_ms=0 pid=891989gitlab # [ 11.705120] gitaly[891]: time="2026-08-20T06:09:24.608Z" level=info msg="using Git binary" binary_path=/run/gitaly/gitaly-891/git-exec-2734210403.d/git pid=891990gitlab # [ 11.708364] gitaly[891]: time="2026-08-20T06:09:24.616Z" level=info msg="finished detecting git version" duration_ms=8 pid=891991gitlab # [ 11.709860] gitaly[891]: time="2026-08-20T06:09:24.616Z" level=info msg="using Git version" pid=891 version=2.53.g992gitlab # [ 11.711970] gitaly[891]: time="2026-08-20T06:09:24.619Z" level=info msg="clearing disk cache object folder" pid=891 storage=default993gitlab # [ 11.715165] gitaly[891]: time="2026-08-20T06:09:24.619Z" level=info msg="moving disk cache object folder" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache2562298519 pid=891 storage=default994gitlab # [ 11.718202] gitaly[891]: time="2026-08-20T06:09:24.619Z" level=info msg="disk cache object folder doesn't exist, no need to remove" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache2562298519 pid=891 storage=default995gitlab # [ 11.721456] gitaly[891]: time="2026-08-20T06:09:24.619Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/cache path=/var/gitlab/state/repositories/+gitaly/cache pid=891996gitlab # [ 11.724858] gitaly[891]: time="2026-08-20T06:09:24.619Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/state path=/var/gitlab/state/repositories/+gitaly/state pid=891997gitlab # [ 11.728975] gitaly[891]: time="2026-08-20T06:09:24.620Z" level=info msg="cleared all cache object files" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache2562298519 clear_duration_ms=0 pid=891 storage=default998gitlab # [ 11.732364] gitaly[891]: time="2026-08-20T06:09:24.635Z" level=info msg="counting repositories" pid=891999gitlab # [ 11.733917] gitaly[891]: time="2026-08-20T06:09:24.635Z" level=info msg="starting to count repositories" pid=891 storage_path=/var/gitlab/state/repositories1000gitlab # [ 11.736190] gitaly[891]: time="2026-08-20T06:09:24.635Z" level=info msg="completed counting repositories" counting_duration_ms=0 pid=891 storage_path=/var/gitlab/state/repositories1001gitlab # [ 11.738645] gitaly[891]: time="2026-08-20T06:09:24.635Z" level=info msg="completed counting all repositories" counting_duration=0 pid=8911002gitlab # [ 11.740547] gitaly[891]: time="2026-08-20T06:09:24.635Z" level=warning msg="Unable to set SO_REUSEPORT: zero downtime upgrades will not work" error="operation not supported" pid=8911003gitlab # [ 11.742901] gitaly[891]: time="2026-08-20T06:09:24.635Z" level=info msg="listening at address" address=/var/gitlab/state/tmp/sockets/gitaly.socket pid=891 schema=unix1004gitlab # [ 11.746249] gitaly[891]: time="2026-08-20T06:09:24.635Z" level=info msg="listening at address" address=/run/gitaly/gitaly-891/sock.d/intern pid=891 schema=unix1005gitlab # [ 11.748331] gitaly[891]: time="2026-08-20T06:09:24.636Z" level=info msg="finished tempdir cleaner walk" pid=891 storage=default time_ms=01006gitlab # [ 11.750135] gitaly[891]: time="2026-08-20T06:09:24.637Z" level=info msg="starting prometheus listener" address="localhost:9236" pid=8911007gitlab # [ 11.751885] gitaly[891]: time="2026-08-20T06:09:24.637Z" level=info msg="Started Gitaly" duration_ms=262 pid=8911008gitlab # [ 11.753494] gitaly[891]: time="2026-08-20T06:09:24.637Z" level=info msg="Gitaly graceful stop timeout duration" duration_s=1m0s pid=8911009gitlab # [ 11.755254] gitaly[891]: time="2026-08-20T06:09:24.638Z" level=info msg="maintenance: daily scheduled" pid=891 scheduled="2026-08-20 12:00:00 +0000 UTC"1010gitlab # [ 12.300083] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[912]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1011gitlab # [ 12.309992] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[912]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1012gitlab # [ 12.323254] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[912]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1013gitlab # [ 14.035275] dhcpcd[759]: eth0: leased 10.0.2.15 for 86400 seconds1014gitlab # [ 14.039584] dhcpcd[759]: eth0: adding route to 10.0.2.0/241015gitlab # [ 14.042458] dhcpcd[759]: eth0: adding default route via 10.0.2.21016gitlab # [ 14.151061] systemd[1]: Started DHCP Client.1017gitlab # [ 14.152836] systemd[1]: Reached target Network is Online.1018gitlab # [ 15.147355] gitaly[891]: time="2026-08-20T06:09:28.054Z" level=info msg="License database preloaded" duration_ms=3678 pid=8911019gitlab # [ 56.736940] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[912]: W, [2026-08-20T06:10:09.643256 #912] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1020gitlab # [ 59.049843] gitlab-workhorse[817]: time="2026-08-20T06:10:11Z" level=error correlation_id= duration_ms=1 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1021gitlab # [ 59.712822] postgres[1429]: [1429] ERROR: relation "feature_gates" does not exist at character 5231022gitlab # [ 59.713196] postgres[1429]: [1429] STATEMENT: SELECT a.attname, format_type(a.atttypid, a.atttypmod),1023gitlab # [ 59.713321] postgres[1429]: pg_get_expr(d.adbin, d.adrelid), a.attnotnull, a.atttypid, a.atttypmod,1024gitlab # [ 59.713442] postgres[1429]: c.collname, col_description(a.attrelid, a.attnum) AS comment,1025gitlab # [ 59.713569] postgres[1429]: attidentity AS identity,1026gitlab # [ 59.713747] postgres[1429]: attgenerated as attgenerated1027gitlab # [ 59.713870] postgres[1429]: FROM pg_attribute a1028gitlab # [ 59.713990] postgres[1429]: LEFT JOIN pg_attrdef d ON a.attrelid = d.adrelid AND a.attnum = d.adnum1029gitlab # [ 59.714108] postgres[1429]: LEFT JOIN pg_type t ON a.atttypid = t.oid1030gitlab # [ 59.714227] postgres[1429]: LEFT JOIN pg_collation c ON a.attcollation = c.oid AND a.attcollation <> t.typcollation1031gitlab # [ 59.714344] postgres[1429]: WHERE a.attrelid = '"feature_gates"'::regclass1032gitlab # [ 59.714460] postgres[1429]: AND a.attnum > 0 AND NOT a.attisdropped1033gitlab # [ 59.714577] postgres[1429]: ORDER BY a.attnum1034gitlab # [ 59.714695] postgres[1429]:1035gitlab # [ 64.803482] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[1480]: psql:/var/gitlab/state/db/structure.sql:9: NOTICE: extension "btree_gist" already exists, skipping1036gitlab # [ 64.803897] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[1480]: psql:/var/gitlab/state/db/structure.sql:11: NOTICE: extension "pg_trgm" already exists, skipping1037gitlab # [ 69.051524] gitlab-workhorse[817]: time="2026-08-20T06:10:21Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1038gitlab # [ 79.062071] gitlab-workhorse[817]: time="2026-08-20T06:10:31Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1039gitlab # [ 89.063268] gitlab-workhorse[817]: time="2026-08-20T06:10:41Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1040gitlab # [ 90.033454] postgres[1583]: [1583] ERROR: relation "table_without_models" does not exist1041gitlab # [ 90.033797] postgres[1583]: [1583] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1042gitlab # [ 99.070961] gitlab-workhorse[817]: time="2026-08-20T06:10:51Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1043gitlab # [ 109.078432] gitlab-workhorse[817]: time="2026-08-20T06:11:01Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1044gitlab # [ 119.086284] gitlab-workhorse[817]: time="2026-08-20T06:11:11Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1045gitlab # [ 120.759706] systemd[1]: Finished gitlab-db-config.service.1046gitlab # [ 120.768211] systemd[1]: Started gitlab-sidekiq.service.1047gitlab # [ 120.773848] systemd[1]: Starting gitlab.service...1048gitlab # [ 121.352368] bundle[1958]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1049gitlab # [ 121.358628] bundle[1958]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1050gitlab # [ 121.364632] bundle[1958]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1051gitlab # [ 126.053745] bundle[1958]: {"timestamp":"2026-08-20T06:11:18.930Z","pid":1958,"message":"* Enabling systemd notification integration"}1052gitlab # [ 126.058859] bundle[1958]: {"timestamp":"2026-08-20T06:11:18.960Z","pid":1958,"message":"Puma starting in cluster mode..."}1053gitlab # [ 126.059007] bundle[1958]: {"timestamp":"2026-08-20T06:11:18.960Z","pid":1958,"message":"* Puma version: 8.0.1 (\"Into the Arena\")"}1054gitlab # [ 126.059143] bundle[1958]: {"timestamp":"2026-08-20T06:11:18.960Z","pid":1958,"message":"* Ruby version: ruby 3.3.10 (2025-10-23 revision 343ea05002) [aarch64-linux]"}1055gitlab # [ 126.059246] bundle[1958]: {"timestamp":"2026-08-20T06:11:18.960Z","pid":1958,"message":"* Min threads: 0"}1056gitlab # [ 126.059361] bundle[1958]: {"timestamp":"2026-08-20T06:11:18.960Z","pid":1958,"message":"* Max threads: 4"}1057gitlab # [ 126.059479] bundle[1958]: {"timestamp":"2026-08-20T06:11:18.960Z","pid":1958,"message":"* Environment: production"}1058gitlab # [ 126.059619] bundle[1958]: {"timestamp":"2026-08-20T06:11:18.960Z","pid":1958,"message":"* Master PID: 1958"}1059gitlab # [ 126.059736] bundle[1958]: {"timestamp":"2026-08-20T06:11:18.960Z","pid":1958,"message":"* Workers: 2"}1060gitlab # [ 126.059837] bundle[1958]: {"timestamp":"2026-08-20T06:11:18.960Z","pid":1958,"message":"* Restarts: (✔) hot (✖) phased (✖) refork"}1061gitlab # [ 126.059968] bundle[1958]: {"timestamp":"2026-08-20T06:11:18.960Z","pid":1958,"message":"* Preloading application"}1062gitlab # [ 126.070645] sidekiq-cluster[1957]: {"severity":"INFO","time":"2026-08-20T06:11:18.948Z","message":"Starting cluster with 1 processes"}1063gitlab # [ 129.090306] gitlab-workhorse[817]: time="2026-08-20T06:11:21Z" level=error correlation_id= duration_ms=1 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1064gitlab # [ 139.091672] gitlab-workhorse[817]: time="2026-08-20T06:11:31Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1065gitlab # [ 149.101935] gitlab-workhorse[817]: time="2026-08-20T06:11:42Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1066gitlab # [ 159.111983] gitlab-workhorse[817]: time="2026-08-20T06:11:52Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1067gitlab # [ 164.318425] bundle[1958]: W, [2026-08-20T06:11:57.225023 #1958] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1068gitlab # [ 168.205777] sidekiq-cluster[2002]: 2026-08-20T06:12:01.112Z pid=2002 tid=woq INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>2002, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>433111040}1069gitlab # [ 168.636273] sidekiq-cluster[2002]: W, [2026-08-20T06:12:01.543725 #2002] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1070gitlab # [ 168.780391] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:12:01.687Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"}1071gitlab # [ 169.115514] gitlab-workhorse[817]: time="2026-08-20T06:12:02Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1072gitlab # [ 172.936386] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:12:05.842Z","message":"GitLab reliable fetch activated!"}1073gitlab # [ 172.936772] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:12:05.843Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1074gitlab # [ 172.969757] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:12:05.877Z","message":"Cron Jobs - added job with name bbo_users_delete_unconfirmed_secondary in the namespace default"}1075gitlab # [ 172.976846] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:12:05.880Z","message":"Cron Jobs - added job with name background_operation_environments_auto_delete in the namespace default"}1076gitlab # [ 172.983832] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:12:05.883Z","message":"Cron Jobs - added job with name adjourned_group_deletion_worker in the namespace default"}1077gitlab # [ 172.990631] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:12:05.885Z","message":"Cron Jobs - added job with name authn_data_retention_authentication_event_archive_worker in the namespace default"}1078gitlab # [ 172.998245] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:12:05.887Z","message":"Cron Jobs - added job with name delete_expired_trigger_token_worker in the namespace default"}1079gitlab # [ 173.005142] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:12:05.890Z","message":"Cron Jobs - added job with name adjourned_projects_deletion_cron_worker in the namespace default"}1080gitlab # [ 173.011218] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:12:05.892Z","message":"Cron Jobs - added job with name stuck_ci_jobs_worker in the namespace default"}1081gitlab # [ 173.016309] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:12:05.894Z","message":"Cron Jobs - added job with name drop_timed_out_worker in the namespace default"}1082gitlab # [ 173.020800] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:12:05.896Z","message":"Cron Jobs - added job with name pipeline_schedule_worker in the namespace default"}1083gitlab # [ 173.025071] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:12:05.898Z","message":"Cron Jobs - added job with name ci_schedule_bulk_delete_job_artifact_cron_worker in the namespace default"}1084gitlab # [ 173.029532] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:12:05.900Z","message":"Cron Jobs - added job with name update_locked_unknown_artifacts_worker in the namespace default"}1085gitlab # [ 173.033517] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:12:05.903Z","message":"Cron Jobs - added job with name ci_partitioning_worker in the namespace default"}1086gitlab # [ 173.037002] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:12:05.905Z","message":"Cron Jobs - added job with name ci_pipelines_expire_artifacts_worker in the namespace default"}1087gitlab # [ 173.040567] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:12:05.907Z","message":"Cron Jobs - added job with name ci_schedule_delete_objects_worker in the namespace default"}1088gitlab # [ 173.043902] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:12:05.910Z","message":"Cron Jobs - added job with name environments_auto_stop_cron_worker in the namespace default"}1089gitlab # [ 173.047411] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:12:05.912Z","message":"Cron Jobs - added job with name repository_check_worker in the namespace default"}1090gitlab # [ 173.050564] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:12:05.916Z","message":"Cron Jobs - added job with name admin_email_worker in the namespace default"}1091gitlab # [ 173.053450] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:12:05.918Z","message":"Cron Jobs - added job with name personal_access_tokens_expiring_worker in the namespace default"}1092gitlab # [ 173.056475] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:12:05.921Z","message":"Cron Jobs - added job with name deploy_tokens_expiring_worker in the namespace default"}1093gitlab # [ 173.059216] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:12:05.924Z","message":"Cron Jobs - added job with name personal_access_tokens_expired_notification_worker in the namespace default"}1094gitlab # [ 173.062541] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:12:05.927Z","message":"Cron Jobs - added job with name resource_access_tokens_inactive_tokens_deletion_cron_worker in the namespace default"}1095gitlab # [ 173.065801] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:12:05.929Z","message":"Cron Jobs - added job with name repository_archive_cache_worker in the namespace default"}1096gitlab # [ 173.069481] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:12:05.931Z","message":"Cron Jobs - added job with name import_export_project_cleanup_worker in the namespace default"}1097gitlab # [ 173.072576] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:12:05.934Z","message":"Cron Jobs - added job with name gitlab_import_import_file_cleanup_worker in the namespace default"}1098gitlab # [ 173.075734] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:12:05.936Z","message":"Cron Jobs - added job with name ci_archive_traces_cron_worker in the namespace default"}1099gitlab # [ 173.078965] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:12:05.939Z","message":"Cron Jobs - added job with name members_expiring_worker in the namespace default"}1100gitlab # [ 173.082004] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:12:05.942Z","message":"Cron Jobs - added job with name remove_expired_members_worker in the namespace default"}1101gitlab # [ 173.085041] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:12:05.945Z","message":"Cron Jobs - added job with name remove_expired_group_links_worker in the namespace default"}1102gitlab # [ 173.088031] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:12:05.947Z","message":"Cron Jobs - added job with name remove_unaccepted_member_invites_worker in the namespace default"}1103gitlab # [ 173.091185] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:12:05.950Z","message":"Cron Jobs - added job with name prune_old_events_worker in the namespace default"}1104gitlab # [ 173.094293] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:12:05.952Z","message":"Cron Jobs - added job with name gitlab_export_prune_project_export_jobs_worker in the namespace default"}1105gitlab # [ 173.097705] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:12:05.955Z","message":"Cron Jobs - added job with name trending_projects_worker in the namespace default"}1106gitlab # [ 173.100679] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:12:05.958Z","message":"Cron Jobs - added job with name remove_unreferenced_lfs_objects_worker in the namespace default"}1107gitlab # [ 173.103796] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:12:05.961Z","message":"Cron Jobs - added job with name bulk_imports_stale_import_worker in the namespace default"}1108gitlab # [ 173.107130] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:12:05.963Z","message":"Cron Jobs - added job with name import_stuck_project_import_jobs in the namespace default"}1109gitlab # [ 173.110325] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:12:05.966Z","message":"Cron Jobs - added job with name jira_import_stuck_jira_import_jobs in the namespace default"}1110gitlab # [ 173.113357] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:12:05.968Z","message":"Cron Jobs - added job with name stuck_export_jobs_worker in the namespace default"}1111gitlab # [ 173.116055] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:12:05.970Z","message":"Cron Jobs - added job with name gitlab_service_ping_worker in the namespace default"}1112gitlab # [ 173.118686] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:12:05.972Z","message":"Cron Jobs - added job with name stuck_merge_jobs_worker in the namespace default"}1113gitlab # [ 173.121337] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:12:05.974Z","message":"Cron Jobs - added job with name pages_domain_verification_cron_worker in the namespace default"}1114gitlab # [ 173.123941] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:12:05.977Z","message":"Cron Jobs - added job with name pages_domain_removal_cron_worker in the namespace default"}1115gitlab # [ 173.126665] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:12:05.979Z","message":"Cron Jobs - added job with name pages_domain_ssl_renewal_cron_worker in the namespace default"}1116gitlab # [ 173.129286] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:12:05.981Z","message":"Cron Jobs - added job with name issue_due_scheduler_worker in the namespace default"}1117gitlab # [ 173.131608] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:12:05.983Z","message":"Cron Jobs - added job with name schedule_migrate_external_diffs_worker in the namespace default"}1118gitlab # [ 173.134319] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:12:05.985Z","message":"Cron Jobs - added job with name namespaces_prune_aggregation_schedules_worker in the namespace default"}1119gitlab # [ 173.136974] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:12:05.988Z","message":"Cron Jobs - added job with name container_expiration_policy_worker in the namespace default"}1120gitlab # [ 173.139309] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:12:05.990Z","message":"Cron Jobs - added job with name cleanup_container_registry_worker in the namespace default"}1121gitlab # [ 173.141825] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:12:05.992Z","message":"Cron Jobs - added job with name image_ttl_group_policy_worker in the namespace default"}1122gitlab # [ 173.144038] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:12:05.994Z","message":"Cron Jobs - added job with name cleanup_dependency_proxy_worker in the namespace default"}1123gitlab # [ 173.146233] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:12:05.996Z","message":"Cron Jobs - added job with name cleanup_package_registry_worker in the namespace default"}1124gitlab # [ 173.148437] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:12:05.999Z","message":"Cron Jobs - added job with name x509_issuer_crl_check_worker in the namespace default"}1125gitlab # [ 173.150512] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:12:06.001Z","message":"Cron Jobs - added job with name users_create_statistics_worker in the namespace default"}1126gitlab # [ 173.152641] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:12:06.013Z","message":"Cron Jobs - added job with name authorized_project_update_periodic_recalculate_worker in the namespace default"}1127gitlab # [ 173.154963] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:12:06.016Z","message":"Cron Jobs - added job with name update_container_registry_info_worker in the namespace default"}1128gitlab # [ 173.157230] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:12:06.018Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_manager in the namespace default"}1129gitlab # [ 173.159350] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:12:06.021Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_dropper in the namespace default"}1130gitlab # [ 173.161566] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:12:06.023Z","message":"Cron Jobs - added job with name analytics_usage_trends_count_job_trigger_worker in the namespace default"}1131gitlab # [ 173.163749] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:12:06.026Z","message":"Cron Jobs - added job with name member_invitation_reminder_emails_worker in the namespace default"}1132gitlab # [ 173.166082] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:12:06.028Z","message":"Cron Jobs - added job with name schedule_merge_request_cleanup_refs_worker in the namespace default"}1133gitlab # [ 173.168258] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:12:06.030Z","message":"Cron Jobs - added job with name manage_evidence_worker in the namespace default"}1134gitlab # [ 173.170243] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:12:06.032Z","message":"Cron Jobs - added job with name publish_release_worker in the namespace default"}1135gitlab # [ 173.172286] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:12:06.034Z","message":"Cron Jobs - added job with name user_status_cleanup_batch_worker in the namespace default"}1136gitlab # [ 173.174387] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:12:06.036Z","message":"Cron Jobs - added job with name ssh_keys_expired_notification_worker in the namespace default"}1137gitlab # [ 173.176589] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:12:06.039Z","message":"Cron Jobs - added job with name ssh_keys_expiring_soon_notification_worker in the namespace default"}1138gitlab # [ 173.178826] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:12:06.041Z","message":"Cron Jobs - added job with name users_deactivate_dormant_users_worker in the namespace default"}1139gitlab # [ 173.181091] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:12:06.044Z","message":"Cron Jobs - added job with name ci_delete_unit_tests_worker in the namespace default"}1140gitlab # [ 173.183136] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:12:06.046Z","message":"Cron Jobs - added job with name batched_background_migrations_worker in the namespace default"}1141gitlab # [ 173.185416] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:12:06.048Z","message":"Cron Jobs - added job with name batched_background_migration_worker_ci_database in the namespace default"}1142gitlab # [ 173.187655] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:12:06.050Z","message":"Cron Jobs - added job with name batched_background_migration_worker_sec_database in the namespace default"}1143gitlab # [ 173.190119] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:12:06.052Z","message":"Cron Jobs - added job with name background_operations_worker_main_database in the namespace default"}1144gitlab # [ 173.192363] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:12:06.053Z","message":"Cron Jobs - added job with name background_operations_worker_ci_database in the namespace default"}1145gitlab # [ 173.194605] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:12:06.055Z","message":"Cron Jobs - added job with name background_operations_worker_sec_database in the namespace default"}1146gitlab # [ 173.196929] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:12:06.057Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_main_database in the namespace default"}1147gitlab # [ 173.199254] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:12:06.059Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_ci_database in the namespace default"}1148gitlab # [ 173.201734] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:12:06.061Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_sec_database in the namespace default"}1149gitlab # [ 173.204034] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:12:06.063Z","message":"Cron Jobs - added job with name issues_reschedule_stuck_issue_rebalances in the namespace default"}1150gitlab # [ 173.206209] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:12:06.065Z","message":"Cron Jobs - added job with name projects_schedule_refresh_build_artifacts_size_statistics_worker in the namespace default"}1151gitlab # [ 173.208700] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:12:06.066Z","message":"Cron Jobs - added job with name inactive_projects_deletion_cron_worker in the namespace default"}1152gitlab # [ 173.210827] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:12:06.069Z","message":"Cron Jobs - added job with name loose_foreign_keys_cleanup_worker in the namespace default"}1153gitlab # [ 173.212967] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:12:06.071Z","message":"Cron Jobs - added job with name loose_foreign_keys_ci_pipelines_builds_cleanup_worker in the namespace default"}1154gitlab # [ 173.215217] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:12:06.072Z","message":"Cron Jobs - added job with name loose_foreign_keys_merge_request_diff_commit_cleanup_worker in the namespace default"}1155gitlab # [ 173.217689] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:12:06.074Z","message":"Cron Jobs - added job with name batched_git_ref_updates_cleanup_scheduler_worker in the namespace default"}1156gitlab # [ 173.219914] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:12:06.077Z","message":"Cron Jobs - added job with name ci_runner_versions_reconciliation_worker in the namespace default"}1157gitlab # [ 173.222346] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:12:06.079Z","message":"Cron Jobs - added job with name users_migrate_records_to_ghost_user_in_batches_worker in the namespace default"}1158gitlab # [ 173.224901] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:12:06.081Z","message":"Cron Jobs - added job with name ci_runners_stale_machines_cleanup_worker in the namespace default"}1159gitlab # [ 173.227142] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:12:06.082Z","message":"Cron Jobs - added job with name packages_cleanup_delete_orphaned_dependencies_worker in the namespace default"}1160gitlab # [ 173.229663] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:12:06.085Z","message":"Cron Jobs - added job with name cleanup_dangling_debian_package_files_worker in the namespace default"}1161gitlab # [ 173.231957] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:12:06.087Z","message":"Cron Jobs - added job with name object_storage_delete_stale_direct_uploads_worker in the namespace default"}1162gitlab # [ 173.234533] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:12:06.088Z","message":"Cron Jobs - added job with name service_desk_custom_email_verification_cleanup in the namespace default"}1163gitlab # [ 173.236940] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:12:06.090Z","message":"Cron Jobs - added job with name deactivated_pages_deployments_delete_cron_worker in the namespace default"}1164gitlab # [ 173.239251] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:12:06.092Z","message":"Cron Jobs - added job with name ci_schedule_unlock_pipelines_in_queue_worker in the namespace default"}1165gitlab # [ 173.241742] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:12:06.094Z","message":"Cron Jobs - added job with name ci_catalog_resources_process_sync_events_worker in the namespace default"}1166gitlab # [ 173.244076] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:12:06.095Z","message":"Cron Jobs - added job with name namespaces_process_outdated_namespace_descendants_cron_worker in the namespace default"}1167gitlab # [ 173.246542] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:12:06.097Z","message":"Cron Jobs - added job with name performance_bar_stats in the namespace default"}1168gitlab # [ 173.248700] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:12:06.100Z","message":"Cron Jobs - added job with name ci_catalog_resources_aggregate_last30_day_usage_worker in the namespace default"}1169gitlab # [ 173.251084] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:12:06.102Z","message":"Cron Jobs - added job with name ci_catalog_resources_cleanup_last_usages_worker in the namespace default"}1170gitlab # [ 173.253546] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:12:06.105Z","message":"Cron Jobs - added job with name ci_click_house_finished_pipelines_sync_worker in the namespace default"}1171gitlab # [ 173.255790] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:12:06.106Z","message":"Cron Jobs - added job with name deactivate_expired_deployments_cron_worker in the namespace default"}1172gitlab # [ 173.258239] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:12:06.120Z","message":"Cron Jobs - added job with name database_monitor_locked_tables_cron_worker in the namespace default"}1173gitlab # [ 173.260504] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:12:06.122Z","message":"Cron Jobs - added job with name merge_requests_process_scheduled_merge in the namespace default"}1174gitlab # [ 173.262631] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:12:06.124Z","message":"Cron Jobs - added job with name ci_schedule_old_pipelines_removal_cron_worker in the namespace default"}1175gitlab # [ 173.264919] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:12:06.127Z","message":"Cron Jobs - added job with name version_version_check_cron in the namespace default"}1176gitlab # [ 173.266904] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:12:06.130Z","message":"Cron Jobs - added job with name import_placeholder_user_cleanup_worker in the namespace default"}1177gitlab # [ 173.269124] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:12:06.133Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_grant_archive_worker in the namespace default"}1178gitlab # [ 173.271429] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:12:06.136Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_token_archive_worker in the namespace default"}1179gitlab # [ 173.275035] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:12:06.138Z","message":"Cron Jobs - added job with name lost_transaction_recovery_worker in the namespace default"}1180gitlab # [ 173.277362] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:12:06.140Z","message":"Cron Jobs - added job with name topology_service_stale_requests_cleanup_worker in the namespace default"}1181gitlab # [ 173.279678] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:12:06.143Z","message":"Cron Jobs - added job with name cells_schedule_claims_verification_worker in the namespace default"}1182gitlab # [ 173.282155] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:12:06.145Z","message":"Cron Jobs - added job with name concurrency_limit_resume_worker in the namespace default"}1183gitlab # [ 179.115422] gitlab-workhorse[817]: time="2026-08-20T06:12:12Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1184gitlab # [ 189.122718] gitlab-workhorse[817]: time="2026-08-20T06:12:22Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1185gitlab # [ 199.123465] gitlab-workhorse[817]: time="2026-08-20T06:12:32Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1186gitlab # [ 209.130311] gitlab-workhorse[817]: time="2026-08-20T06:12:42Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1187gitlab # [ 212.980823] postgres[2735]: [2735] ERROR: relation "table_without_models" does not exist1188gitlab # [ 212.981212] postgres[2735]: [2735] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1189gitlab # [ 215.897452] postgres[2756]: [2756] ERROR: relation "table_without_models" does not exist1190gitlab # [ 215.901024] postgres[2756]: [2756] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1191gitlab # [ 217.947260] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:12:50.853Z","message":"Booted Rails 7.2.3.1 application in production environment"}1192gitlab # [ 217.953843] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:12:50.861Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [aarch64-linux]"}1193gitlab # [ 217.954043] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:12:50.861Z","message":"See LICENSE and the LGPL-3.0 for licensing details."}1194gitlab # [ 217.954099] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:12:50.861Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"}1195gitlab # [ 217.957907] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:12:50.865Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1196gitlab # [ 219.138351] gitlab-workhorse[817]: time="2026-08-20T06:12:52Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1197gitlab # [ 220.640849] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:12:53.548Z","message":"Cleaning working queues"}1198gitlab # [ 220.645736] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:12:53.553Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"fdb3e9efe51f4bb2d2e49622","created_at":"2026-08-20T06:11:13.018Z","trace_propagation_headers":{"sentry-trace":"6476e625cede41b49ad3f226579f5842-aed149d6b9004237","baggage":"sentry-trace_id=6476e625cede41b49ad3f226579f5842,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"d3de6940290140c056a5fe2471d50451","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-08-20T06:11:13.030Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-fdb3e9efe51f4bb2d2e49622: start","job_status":"start","queue_duration_s":100.52261,"scheduling_latency_s":100.52267}1199gitlab # [ 220.894120] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:12:53.801Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"fdb3e9efe51f4bb2d2e49622","created_at":"2026-08-20T06:11:13.018Z","trace_propagation_headers":{"sentry-trace":"6476e625cede41b49ad3f226579f5842-aed149d6b9004237","baggage":"sentry-trace_id=6476e625cede41b49ad3f226579f5842,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"d3de6940290140c056a5fe2471d50451","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-08-20T06:11:13.030Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-fdb3e9efe51f4bb2d2e49622: done: 0.248175 sec","job_status":"done","queue_duration_s":100.52261,"scheduling_latency_s":100.52267,"redis_calls":29,"redis_duration_s":0.008998,"redis_read_bytes":282,"redis_write_bytes":3632,"redis_feature_flag_calls":18,"redis_feature_flag_duration_s":0.005119,"redis_feature_flag_read_bytes":272,"redis_feature_flag_write_bytes":2385,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002249,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":688,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00163,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":559,"db_count":15,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.022,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.018,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.105773,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.14755458,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.248175,"completed_at":"2026-08-20T06:12:53.800Z","load_balancing_strategy":"primary","db_duration_s":0.100739,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1200gitlab # [ 222.739466] bundle[1958]: {"timestamp":"2026-08-20T06:12:55.646Z","pid":1958,"message":"* Listening on unix:///var/gitlab/state//tmp/sockets/gitlab.socket"}1201gitlab # [ 222.739801] bundle[1958]: {"timestamp":"2026-08-20T06:12:55.646Z","pid":1958,"message":"! WARNING: Detected 2 Thread(s) started in app boot:"}1202gitlab # [ 222.739969] bundle[1958]: {"timestamp":"2026-08-20T06:12:55.646Z","pid":1958,"message":"! #\u003cThread:0x0000e478cbe4cd10 /nix/store/zj7sa5zsg6vhnyq28b8v0x1jajz1gpvc-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:72 sleep\u003e - /nix/store/zj7sa5zsg6vhnyq28b8v0x1jajz1gpvc-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:90:in `sleep'"}1203gitlab # [ 222.740180] bundle[1958]: {"timestamp":"2026-08-20T06:12:55.646Z","pid":1958,"message":"! #\u003cThread:0x0000e478cb6b77d0 /nix/store/lnly88svq5ykjs8ynaw5cm3g88z1lvsm-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:18 sleep\u003e - /nix/store/lnly88svq5ykjs8ynaw5cm3g88z1lvsm-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:20:in `sleep'"}1204gitlab # [ 222.740340] bundle[1958]: {"timestamp":"2026-08-20T06:12:55.646Z","pid":1958,"message":"Use Ctrl-C to stop"}1205gitlab # [ 222.740459] bundle[1958]: {"timestamp":"2026-08-20T06:12:55.646Z","pid":1958,"message":"Sending status to systemd every 1.0 sec"}1206gitlab # [ 223.462710] bundle[1958]: {"timestamp":"2026-08-20T06:12:56.370Z","pid":1958,"message":"- Worker 0 (PID: 2873) booted in 0.69s, phase: 0"}1207gitlab # [ 223.470411] bundle[1958]: {"timestamp":"2026-08-20T06:12:56.377Z","pid":1958,"message":"- Worker 1 (PID: 2877) booted in 0.67s, phase: 0"}1208gitlab # [ 223.477121] systemd[1]: Started gitlab.service.1209gitlab # [ 223.477967] systemd[1]: Reached target Common target for all GitLab services..1210gitlab # [ 223.483463] systemd[1]: Starting setup-gitlab.service...1211gitlab # [ 223.516775] setup-gitlab-start[2910]: + timeout 900 bash -c 'until curl -fs http://gitlab/users/sign_in > /dev/null; do sleep 5; done'1212gitlab # [ 227.133218] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/20:06:13:00 +0000] "GET /users/sign_in HTTP/1.1" 200 10655 "" "curl/8.21.0" 35781213gitlab # [ 227.138928] setup-gitlab-start[2910]: + TOKEN=nixbot-test-token-of-20-chars1214gitlab # [ 227.142334] setup-gitlab-start[2910]: + runuser -u gitlab -- /run/current-system/sw/bin/gitlab-rails runner $'\n ApplicationSetting.current.update!(allow_local_requests_from_web_hooks_and_services: true)\n Rails.cache.clear\n token = User.find_by_username(\'root\').personal_access_tokens.create!(\n name: \'nixbot\', scopes: [:api], expires_at: 7.days.from_now)\n token.set_token(\'nixbot-test-token-of-20-chars\')\n token.save!\n'1215gitlab # [ 227.159646] runuser[2932]: pam_unix(runuser:session): session opened for user gitlab(uid=165) by (uid=0)1216gitlab # [ 227.718106] setup-gitlab-start[2937]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1217gitlab # [ 227.724611] setup-gitlab-start[2937]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1218gitlab # [ 227.730892] setup-gitlab-start[2937]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1219gitlab # [ 228.547631] setup-gitlab-start[2937]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1220gitlab # [ 228.547975] setup-gitlab-start[2937]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1221gitlab # [ 228.550298] setup-gitlab-start[2937]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1222gitlab # [ 234.930397] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:13:07.836Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"7e7718b3c230fab71f689552","created_at":"2026-08-20T06:13:07.625Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-d05502bc9eab4b30","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d03787b45912bfbf8a49c3db44c0460d","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-20T06:13:07.829Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-7e7718b3c230fab71f689552: start","job_status":"start","queue_duration_s":0.007171,"scheduling_latency_s":0.007234}1223gitlab # [ 235.746066] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:13:08.652Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"7e7718b3c230fab71f689552","created_at":"2026-08-20T06:13:07.625Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-d05502bc9eab4b30","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d03787b45912bfbf8a49c3db44c0460d","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-20T06:13:07.829Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-7e7718b3c230fab71f689552: done: 0.816211 sec","job_status":"done","queue_duration_s":0.007171,"scheduling_latency_s":0.007234,"redis_calls":16,"redis_duration_s":0.060533,"redis_read_bytes":15,"redis_write_bytes":1942,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.028931,"redis_feature_flag_read_bytes":8,"redis_feature_flag_write_bytes":1148,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.026644,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":574,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.004958,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":220,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.229,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.229,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.078228,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00365246,"duration_s":0.816211,"completed_at":"2026-08-20T06:13:08.652Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.376907,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1224gitlab # [ 235.760288] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:13:08.663Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"2f83a5cf166e0a8970000a87","created_at":"2026-08-20T06:13:07.901Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-d05502bc9eab4b30","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"21b04237111f76f3cd4a4e3e324494bb","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-20T06:13:07.939Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-2f83a5cf166e0a8970000a87: start","job_status":"start","queue_duration_s":0.724704,"scheduling_latency_s":0.724752}1225gitlab # [ 236.287994] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:13:09.193Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"2f83a5cf166e0a8970000a87","created_at":"2026-08-20T06:13:07.901Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-d05502bc9eab4b30","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"21b04237111f76f3cd4a4e3e324494bb","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-20T06:13:07.939Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-2f83a5cf166e0a8970000a87: done: 0.529424 sec","job_status":"done","queue_duration_s":0.724704,"scheduling_latency_s":0.724752,"redis_calls":10,"redis_duration_s":0.049219,"redis_read_bytes":9,"redis_write_bytes":1157,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.008644,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.031563,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.009012,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.029,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.029,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.059868,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0024757,"duration_s":0.529424,"completed_at":"2026-08-20T06:13:09.193Z","load_balancing_strategy":"primary","db_duration_s":0.074634,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1226gitlab # [ 236.383505] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:13:09.205Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"19d698ce659b680ae918f191","created_at":"2026-08-20T06:13:07.995Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-d05502bc9eab4b30","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ff8b8347cb3bcb78f4f982e8e1f89314","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-20T06:13:08.051Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-19d698ce659b680ae918f191: start","job_status":"start","queue_duration_s":1.154424,"scheduling_latency_s":1.154473}1227gitlab # [ 236.553869] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:13:09.461Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0}1228gitlab # [ 236.672259] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:13:09.578Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"19d698ce659b680ae918f191","created_at":"2026-08-20T06:13:07.995Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-d05502bc9eab4b30","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ff8b8347cb3bcb78f4f982e8e1f89314","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-20T06:13:08.051Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-19d698ce659b680ae918f191: done: 0.372742 sec","job_status":"done","queue_duration_s":1.154424,"scheduling_latency_s":1.154473,"redis_calls":10,"redis_duration_s":0.07968800000000001,"redis_read_bytes":9,"redis_write_bytes":1283,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.006815,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.064281,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":662,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.008592,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":264,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.026,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.026,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.036634,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00387848,"duration_s":0.372742,"completed_at":"2026-08-20T06:13:09.578Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.02599,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1229gitlab # [ 236.753435] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:13:09.589Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"da6284e960ec264fc46de705","created_at":"2026-08-20T06:13:08.089Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-d05502bc9eab4b30","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"860cb5b92ca1b9bfee7f09655412761b","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-20T06:13:08.128Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-da6284e960ec264fc46de705: start","job_status":"start","queue_duration_s":1.461251,"scheduling_latency_s":1.461309}1230gitlab # [ 236.894678] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:13:09.801Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0}1231gitlab # [ 236.973254] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:13:09.879Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"da6284e960ec264fc46de705","created_at":"2026-08-20T06:13:08.089Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-d05502bc9eab4b30","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"860cb5b92ca1b9bfee7f09655412761b","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-20T06:13:08.128Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-da6284e960ec264fc46de705: done: 0.289851 sec","job_status":"done","queue_duration_s":1.461251,"scheduling_latency_s":1.461309,"redis_calls":10,"redis_duration_s":0.050126000000000004,"redis_read_bytes":9,"redis_write_bytes":1199,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.006884,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.036518,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":618,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.006724,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":242,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.017,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.017,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.035149,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00553622,"duration_s":0.289851,"completed_at":"2026-08-20T06:13:09.879Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.017191,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1232gitlab # [ 237.055441] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:13:09.900Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"PipelineScheduleWorker","jid":"d594b039487869ea24275b05","created_at":"2026-08-20T06:13:08.179Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-d05502bc9eab4b30","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0c03ef0a0b5dffba610df4c8828de6d4","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f6baa6e6d21754c4b13358fe49f8c31a08729a9dd276fb680a810caf1bc7fab5","size_limiter":"validated","enqueued_at":"2026-08-20T06:13:08.207Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineScheduleWorker JID-d594b039487869ea24275b05: start","job_status":"start","queue_duration_s":1.692786,"scheduling_latency_s":1.692841}1233gitlab # [ 237.281904] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:13:10.188Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"PipelineScheduleWorker","jid":"d594b039487869ea24275b05","created_at":"2026-08-20T06:13:08.179Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-d05502bc9eab4b30","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0c03ef0a0b5dffba610df4c8828de6d4","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f6baa6e6d21754c4b13358fe49f8c31a08729a9dd276fb680a810caf1bc7fab5","size_limiter":"validated","enqueued_at":"2026-08-20T06:13:08.207Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineScheduleWorker JID-d594b039487869ea24275b05: done: 0.288007 sec","job_status":"done","queue_duration_s":1.692786,"scheduling_latency_s":1.692841,"redis_calls":12,"redis_duration_s":0.033772,"redis_read_bytes":11,"redis_write_bytes":1281,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.005819,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":287,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.016655,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":518,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.011298,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":476,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.013,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0618,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.0039934,"exclusive_lock_hold_duration_s":0.09804294,"duration_s":0.288007,"completed_at":"2026-08-20T06:13:10.188Z","load_balancing_strategy":"primary","db_duration_s":0.057529,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1234gitlab # [ 237.373257] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:13:10.279Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"3d0cc44a7642b09b49d49175","created_at":"2026-08-20T06:13:08.231Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-d05502bc9eab4b30","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0c99ef2e8c7f59b2c8b9ff8ef8d6f012","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-20T06:13:08.272Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-3d0cc44a7642b09b49d49175: start","job_status":"start","queue_duration_s":2.006495,"scheduling_latency_s":2.00654}1235gitlab # [ 237.489642] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:13:10.396Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"3d0cc44a7642b09b49d49175","created_at":"2026-08-20T06:13:08.231Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-d05502bc9eab4b30","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0c99ef2e8c7f59b2c8b9ff8ef8d6f012","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-20T06:13:08.272Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-3d0cc44a7642b09b49d49175: done: 0.116937 sec","job_status":"done","queue_duration_s":2.006495,"scheduling_latency_s":2.00654,"redis_calls":10,"redis_duration_s":0.00502,"redis_read_bytes":9,"redis_write_bytes":1289,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000699,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003245,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001076,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.025,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.025,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.042057,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00094728,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.116937,"completed_at":"2026-08-20T06:13:10.396Z","load_balancing_strategy":"primary","db_duration_s":0.033743,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1236gitlab # [ 237.574388] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:13:10.402Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"5c50c51b920e764466535b1b","created_at":"2026-08-20T06:13:08.322Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-d05502bc9eab4b30","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"66b865e32a47ffb187dc385dc9f302ef","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-20T06:13:08.364Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-5c50c51b920e764466535b1b: start","job_status":"start","queue_duration_s":2.037494,"scheduling_latency_s":2.037541}1237gitlab # [ 237.590508] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:13:10.475Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"5c50c51b920e764466535b1b","created_at":"2026-08-20T06:13:08.322Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-d05502bc9eab4b30","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"66b865e32a47ffb187dc385dc9f302ef","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-20T06:13:08.364Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-5c50c51b920e764466535b1b: done: 0.073592 sec","job_status":"done","queue_duration_s":2.037494,"scheduling_latency_s":2.037541,"redis_calls":12,"redis_duration_s":0.006144,"redis_read_bytes":11,"redis_write_bytes":1489,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001032,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003086,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002026,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":560,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.044137,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.001456,"exclusive_lock_hold_duration_s":0.01806758,"duration_s":0.073592,"completed_at":"2026-08-20T06:13:10.475Z","load_balancing_strategy":"primary","db_duration_s":0.009618,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1238gitlab # [ 237.633811] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:13:10.478Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"044d32f37ca0bfd3ce274158","created_at":"2026-08-20T06:13:08.412Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-d05502bc9eab4b30","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"95f34ceb6fae67333e1a906a644c1675","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-20T06:13:08.500Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-044d32f37ca0bfd3ce274158: start","job_status":"start","queue_duration_s":1.978761,"scheduling_latency_s":1.978804}1239gitlab # [ 237.718430] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:13:10.625Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"044d32f37ca0bfd3ce274158","created_at":"2026-08-20T06:13:08.412Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-d05502bc9eab4b30","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"95f34ceb6fae67333e1a906a644c1675","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-20T06:13:08.500Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-044d32f37ca0bfd3ce274158: done: 0.146371 sec","job_status":"done","queue_duration_s":1.978761,"scheduling_latency_s":1.978804,"redis_calls":12,"redis_duration_s":0.005949,"redis_read_bytes":11,"redis_write_bytes":1622,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000654,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":349,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00251,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":658,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002785,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":615,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.026,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.026,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.101154,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00201084,"exclusive_lock_hold_duration_s":0.07817518,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.146371,"completed_at":"2026-08-20T06:13:10.625Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.026878,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1240gitlab # [ 237.782889] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:13:10.628Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"3cb10fa4b471622705af6a61","created_at":"2026-08-20T06:13:08.546Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-d05502bc9eab4b30","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9f948eb97280e190c3790302fad60aff","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-20T06:13:08.605Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-3cb10fa4b471622705af6a61: start","job_status":"start","queue_duration_s":2.022179,"scheduling_latency_s":2.022237}1241gitlab # [ 238.322681] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:13:11.229Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"3cb10fa4b471622705af6a61","created_at":"2026-08-20T06:13:08.546Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-d05502bc9eab4b30","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9f948eb97280e190c3790302fad60aff","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-20T06:13:08.605Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-3cb10fa4b471622705af6a61: done: 0.601775 sec","job_status":"done","queue_duration_s":2.022179,"scheduling_latency_s":2.022237,"redis_calls":14,"redis_duration_s":0.00649,"redis_read_bytes":13,"redis_write_bytes":1641,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001722,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":576,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002647,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002121,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":511,"db_count":131,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":131,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.102,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":129,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":84,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.097,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.472456,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00117004,"exclusive_lock_hold_duration_s":0.54339002,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"ci","turbo_mode":false},"duration_s":0.601775,"completed_at":"2026-08-20T06:13:11.229Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.14419,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1242gitlab # [ 238.324217] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:13:11.231Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"e3a283368bb6bca171663c1e","created_at":"2026-08-20T06:13:08.654Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-d05502bc9eab4b30","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d5361cef34bd701722360bcb6ddd6c58","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-20T06:13:08.853Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-e3a283368bb6bca171663c1e: start","job_status":"start","queue_duration_s":2.378601,"scheduling_latency_s":2.378624}1243gitlab # [ 238.596562] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:13:11.498Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"e3a283368bb6bca171663c1e","created_at":"2026-08-20T06:13:08.654Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-d05502bc9eab4b30","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d5361cef34bd701722360bcb6ddd6c58","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-20T06:13:08.853Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-e3a283368bb6bca171663c1e: done: 0.267281 sec","job_status":"done","queue_duration_s":2.378601,"scheduling_latency_s":2.378624,"redis_calls":71,"redis_duration_s":0.027943,"redis_read_bytes":120,"redis_write_bytes":42674,"redis_feature_flag_calls":10,"redis_feature_flag_duration_s":0.002582,"redis_feature_flag_read_bytes":10,"redis_feature_flag_write_bytes":1471,"redis_queues_calls":2,"redis_queues_duration_s":0.001872,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37485,"redis_queues_metadata_calls":56,"redis_queues_metadata_duration_s":0.022598,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3418,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000891,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":300,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.228461,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00094508,"duration_s":0.267281,"completed_at":"2026-08-20T06:13:11.498Z","load_balancing_strategy":"primary","db_duration_s":0.008544,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1244gitlab # [ 238.707812] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:13:11.503Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"d9ba781267b2c3b53838ff6b","created_at":"2026-08-20T06:13:08.875Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-d05502bc9eab4b30","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fe547463759fbd9fbb0010e0d2952788","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-20T06:13:08.916Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-d9ba781267b2c3b53838ff6b: start","job_status":"start","queue_duration_s":2.586749,"scheduling_latency_s":2.586814}1245gitlab # [ 238.728877] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:13:11.538Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0}1246gitlab # [ 238.732974] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:13:11.563Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"d9ba781267b2c3b53838ff6b","created_at":"2026-08-20T06:13:08.875Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-d05502bc9eab4b30","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fe547463759fbd9fbb0010e0d2952788","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-20T06:13:08.916Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-d9ba781267b2c3b53838ff6b: done: 0.060318 sec","job_status":"done","queue_duration_s":2.586749,"scheduling_latency_s":2.586814,"redis_calls":10,"redis_duration_s":0.005163,"redis_read_bytes":9,"redis_write_bytes":1207,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001138,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003022,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001003,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.035991,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00080842,"duration_s":0.060318,"completed_at":"2026-08-20T06:13:11.563Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00085,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1247gitlab # [ 238.778892] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:13:11.567Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"0929a931a2806e908604e25e","created_at":"2026-08-20T06:13:08.962Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-d05502bc9eab4b30","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"66ffbb975fd370cb8c51b8ff2107cab9","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-20T06:13:09.020Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-0929a931a2806e908604e25e: start","job_status":"start","queue_duration_s":2.546509,"scheduling_latency_s":2.546584}1248gitlab # [ 238.794200] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:13:11.603Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0}1249gitlab # [ 238.797765] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:13:11.628Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"0929a931a2806e908604e25e","created_at":"2026-08-20T06:13:08.962Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-d05502bc9eab4b30","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"66ffbb975fd370cb8c51b8ff2107cab9","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-20T06:13:09.020Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-0929a931a2806e908604e25e: done: 0.060923 sec","job_status":"done","queue_duration_s":2.546509,"scheduling_latency_s":2.546584,"redis_calls":10,"redis_duration_s":0.004083,"redis_read_bytes":9,"redis_write_bytes":1291,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000988,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":359,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002216,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000879,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.03676,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0003923,"duration_s":0.060923,"completed_at":"2026-08-20T06:13:11.628Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000853,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1250gitlab # [ 238.841546] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:13:11.631Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"615c134ab5620043801b64cf","created_at":"2026-08-20T06:13:09.045Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-d05502bc9eab4b30","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c317c50465eda773b1c687a9c1a3b98e","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-20T06:13:09.096Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-615c134ab5620043801b64cf: start","job_status":"start","queue_duration_s":2.534873,"scheduling_latency_s":2.534893}1251gitlab # [ 238.856057] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:13:11.704Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"615c134ab5620043801b64cf","created_at":"2026-08-20T06:13:09.045Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-d05502bc9eab4b30","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c317c50465eda773b1c687a9c1a3b98e","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-20T06:13:09.096Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-615c134ab5620043801b64cf: done: 0.07298 sec","job_status":"done","queue_duration_s":2.534873,"scheduling_latency_s":2.534893,"redis_calls":10,"redis_duration_s":0.003294,"redis_read_bytes":9,"redis_write_bytes":1061,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00086,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001707,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":550,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000727,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":208,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.044762,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000576,"duration_s":0.07298,"completed_at":"2026-08-20T06:13:11.704Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004889,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1252gitlab # [ 238.900090] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:13:11.709Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"ef07cf3df17334c6e3b19749","created_at":"2026-08-20T06:13:09.179Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-d05502bc9eab4b30","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8f8c6014f7c6974d79898e75cd7b31b7","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-20T06:13:09.212Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-ef07cf3df17334c6e3b19749: start","job_status":"start","queue_duration_s":2.496387,"scheduling_latency_s":2.496475}1253gitlab # [ 238.913668] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:13:11.743Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0}1254gitlab # [ 238.917082] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:13:11.766Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"ef07cf3df17334c6e3b19749","created_at":"2026-08-20T06:13:09.179Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-d05502bc9eab4b30","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8f8c6014f7c6974d79898e75cd7b31b7","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-20T06:13:09.212Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-ef07cf3df17334c6e3b19749: done: 0.057582 sec","job_status":"done","queue_duration_s":2.496387,"scheduling_latency_s":2.496475,"redis_calls":10,"redis_duration_s":0.003254,"redis_read_bytes":9,"redis_write_bytes":1261,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000616,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":353,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001927,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":650,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000711,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":258,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.035417,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00090086,"duration_s":0.057582,"completed_at":"2026-08-20T06:13:11.766Z","load_balancing_strategy":"primary","db_duration_s":0.00078,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1255gitlab # [ 238.960875] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:13:11.769Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"8c49b61a8e7806c3ace5847a","created_at":"2026-08-20T06:13:09.292Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-d05502bc9eab4b30","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"891a1594dd894efdca23c9515ed9a3f2","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-20T06:13:09.336Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-8c49b61a8e7806c3ace5847a: start","job_status":"start","queue_duration_s":2.433207,"scheduling_latency_s":2.433261}1256gitlab # [ 238.978618] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:13:11.862Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"8c49b61a8e7806c3ace5847a","created_at":"2026-08-20T06:13:09.292Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-d05502bc9eab4b30","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"891a1594dd894efdca23c9515ed9a3f2","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-20T06:13:09.336Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-8c49b61a8e7806c3ace5847a: done: 0.093087 sec","job_status":"done","queue_duration_s":2.433207,"scheduling_latency_s":2.433261,"redis_calls":13,"redis_duration_s":0.004605,"redis_read_bytes":12,"redis_write_bytes":1668,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000712,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002415,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":728,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001478,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":603,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.06562,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.02950294,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.093087,"completed_at":"2026-08-20T06:13:11.862Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005351,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1257gitlab # [ 239.024169] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:13:11.866Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"1387f66c13381b0c3f617d29","created_at":"2026-08-20T06:13:09.356Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-d05502bc9eab4b30","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e61cb074a25192909df298d922497882","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-20T06:13:09.406Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-1387f66c13381b0c3f617d29: start","job_status":"start","queue_duration_s":2.460656,"scheduling_latency_s":2.460684}1258gitlab # [ 239.151111] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:13:12.056Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"1387f66c13381b0c3f617d29","created_at":"2026-08-20T06:13:09.356Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-d05502bc9eab4b30","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e61cb074a25192909df298d922497882","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-20T06:13:09.406Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-1387f66c13381b0c3f617d29: done: 0.190103 sec","job_status":"done","queue_duration_s":2.460656,"scheduling_latency_s":2.460684,"redis_calls":12,"redis_duration_s":0.006083,"redis_read_bytes":11,"redis_write_bytes":1612,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000609,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":347,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003328,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":654,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002146,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":611,"db_count":7,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.066,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.065,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.092573,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00125668,"exclusive_lock_hold_duration_s":0.11647818,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.190103,"completed_at":"2026-08-20T06:13:12.056Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.069825,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1259gitlab # [ 239.242614] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:13:12.062Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"0e649eed402a2d1a56e4372b","created_at":"2026-08-20T06:13:09.439Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-d05502bc9eab4b30","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c23cd23682a094c6a94e4c10c3a4c622","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-20T06:13:09.484Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-0e649eed402a2d1a56e4372b: start","job_status":"start","queue_duration_s":2.57727,"scheduling_latency_s":2.577375}1260gitlab # [ 239.258698] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:13:12.102Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0}1261gitlab # [ 239.262906] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:13:12.126Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"0e649eed402a2d1a56e4372b","created_at":"2026-08-20T06:13:09.439Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-d05502bc9eab4b30","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c23cd23682a094c6a94e4c10c3a4c622","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-20T06:13:09.484Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-0e649eed402a2d1a56e4372b: done: 0.064204 sec","job_status":"done","queue_duration_s":2.57727,"scheduling_latency_s":2.577375,"redis_calls":10,"redis_duration_s":0.005659,"redis_read_bytes":9,"redis_write_bytes":1253,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001207,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":351,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00341,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":646,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001042,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":256,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.037427,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00089182,"duration_s":0.064204,"completed_at":"2026-08-20T06:13:12.126Z","load_balancing_strategy":"primary","db_duration_s":0.000898,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1262gitlab # [ 239.306397] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:13:12.130Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"9576223bda7f08575b5b4247","created_at":"2026-08-20T06:13:09.513Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-d05502bc9eab4b30","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"52793c608de7648e17a08dc53e35fcd4","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-20T06:13:09.565Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-9576223bda7f08575b5b4247: start","job_status":"start","queue_duration_s":2.565148,"scheduling_latency_s":2.565168}1263gitlab # [ 239.321160] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:13:12.197Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"9576223bda7f08575b5b4247","created_at":"2026-08-20T06:13:09.513Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-d05502bc9eab4b30","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"52793c608de7648e17a08dc53e35fcd4","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-20T06:13:09.565Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-9576223bda7f08575b5b4247: done: 0.067648 sec","job_status":"done","queue_duration_s":2.565148,"scheduling_latency_s":2.565168,"redis_calls":12,"redis_duration_s":0.006281999999999999,"redis_read_bytes":11,"redis_write_bytes":1482,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.002072,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":610,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003201,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":626,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001009,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":246,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.041109,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00095232,"duration_s":0.067648,"completed_at":"2026-08-20T06:13:12.197Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003191,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1264gitlab # [ 239.363944] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:13:12.224Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"c7c016a13937adcd362fd508","created_at":"2026-08-20T06:13:09.600Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-d05502bc9eab4b30","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3e70fc7cf061dbed88602e28586e408e","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-20T06:13:09.641Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-c7c016a13937adcd362fd508: start","job_status":"start","queue_duration_s":2.583071,"scheduling_latency_s":2.583115}1265gitlab # [ 239.478458] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:13:12.384Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"c7c016a13937adcd362fd508","created_at":"2026-08-20T06:13:09.600Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-d05502bc9eab4b30","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3e70fc7cf061dbed88602e28586e408e","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-20T06:13:09.641Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-c7c016a13937adcd362fd508: done: 0.159683 sec","job_status":"done","queue_duration_s":2.583071,"scheduling_latency_s":2.583115,"redis_calls":12,"redis_duration_s":0.012506,"redis_read_bytes":11,"redis_write_bytes":1511,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001774,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.005998,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.004734,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":566,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.01,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.111777,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.0027377,"exclusive_lock_hold_duration_s":0.021446279999999998,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.159683,"completed_at":"2026-08-20T06:13:12.383Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.009915,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1266gitlab # [ 239.567127] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:13:12.392Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"5c92e382f6daeccac21deb6d","created_at":"2026-08-20T06:13:09.662Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-d05502bc9eab4b30","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a2c9e5731d98b6a3f1610ca88cbd62d2","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-20T06:13:09.695Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-5c92e382f6daeccac21deb6d: start","job_status":"start","queue_duration_s":2.697486,"scheduling_latency_s":2.697745}1267gitlab # [ 239.628330] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:13:12.532Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"5c92e382f6daeccac21deb6d","created_at":"2026-08-20T06:13:09.662Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-d05502bc9eab4b30","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a2c9e5731d98b6a3f1610ca88cbd62d2","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-20T06:13:09.695Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-5c92e382f6daeccac21deb6d: done: 0.140086 sec","job_status":"done","queue_duration_s":2.697486,"scheduling_latency_s":2.697745,"redis_calls":10,"redis_duration_s":0.008753,"redis_read_bytes":9,"redis_write_bytes":1299,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001351,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":361,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.005825,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":670,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001577,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":268,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.079602,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0016639,"duration_s":0.140086,"completed_at":"2026-08-20T06:13:12.531Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002965,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1268gitlab # [ 239.713068] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:13:12.537Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"fee19c7264f364fab0e1bac5","created_at":"2026-08-20T06:13:09.726Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-d05502bc9eab4b30","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2ec1cc2db59b6ed8e11d3ef2354acbe1","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-20T06:13:09.796Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-fee19c7264f364fab0e1bac5: start","job_status":"start","queue_duration_s":2.740123,"scheduling_latency_s":2.740151}1269gitlab # [ 240.116839] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:13:13.024Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"fee19c7264f364fab0e1bac5","created_at":"2026-08-20T06:13:09.726Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-d05502bc9eab4b30","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2ec1cc2db59b6ed8e11d3ef2354acbe1","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-20T06:13:09.796Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-fee19c7264f364fab0e1bac5: done: 0.487261 sec","job_status":"done","queue_duration_s":2.740123,"scheduling_latency_s":2.740151,"redis_calls":565,"redis_duration_s":0.102546,"redis_read_bytes":564,"redis_write_bytes":49139,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001005,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002404,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":546,"redis_shared_state_calls":557,"redis_shared_state_duration_s":0.099137,"redis_shared_state_read_bytes":558,"redis_shared_state_write_bytes":48290,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.418793,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00028384,"duration_s":0.487261,"completed_at":"2026-08-20T06:13:13.024Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001739,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1270gitlab # [ 240.217136] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:13:13.025Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"7ddc63a7293aadcf113e00a3","created_at":"2026-08-20T06:13:09.843Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-d05502bc9eab4b30","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c3280d5f93fa5d734d74a159ca9bb46b","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-08-20T06:13:09.894Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-7ddc63a7293aadcf113e00a3: start","job_status":"start","queue_duration_s":3.13066,"scheduling_latency_s":3.13068}1271gitlab # [ 240.236100] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:13:13.065Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"7ddc63a7293aadcf113e00a3","created_at":"2026-08-20T06:13:09.843Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-d05502bc9eab4b30","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c3280d5f93fa5d734d74a159ca9bb46b","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-08-20T06:13:09.894Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-7ddc63a7293aadcf113e00a3: done: 0.040237 sec","job_status":"done","queue_duration_s":3.13066,"scheduling_latency_s":3.13068,"redis_calls":19,"redis_duration_s":0.003978,"redis_read_bytes":22,"redis_write_bytes":4785,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000828,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":672,"redis_queues_calls":2,"redis_queues_duration_s":0.000355,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3015,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.002131,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":814,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000664,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":284,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.027844,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0003166,"duration_s":0.040237,"completed_at":"2026-08-20T06:13:13.065Z","load_balancing_strategy":"primary","db_duration_s":0.003194,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1272gitlab # [ 240.286730] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:13:13.067Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"00aa35fa84a4970c5c597154","created_at":"2026-08-20T06:13:11.267Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-34be75c673124c80","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d5361cef34bd701722360bcb6ddd6c58","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:13:11.472Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-00aa35fa84a4970c5c597154: start","job_status":"start","queue_duration_s":1.595114,"scheduling_latency_s":1.59513}1273gitlab # [ 240.316210] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:13:13.223Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"00aa35fa84a4970c5c597154","created_at":"2026-08-20T06:13:11.267Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-34be75c673124c80","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d5361cef34bd701722360bcb6ddd6c58","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:13:11.472Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-00aa35fa84a4970c5c597154: done: 0.15616 sec","job_status":"done","queue_duration_s":1.595114,"scheduling_latency_s":1.59513,"redis_calls":16,"redis_duration_s":0.00397,"redis_read_bytes":14,"redis_write_bytes":1544,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000503,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001096,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":439,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002371,"redis_shared_state_read_bytes":9,"redis_shared_state_write_bytes":798,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013799,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00032234,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.15616,"completed_at":"2026-08-20T06:13:13.223Z","load_balancing_strategy":"primary","db_duration_s":0.000734,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1274gitlab # [ 240.381200] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:13:13.225Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6e598cd2995c9d48da7304c2","created_at":"2026-08-20T06:13:11.267Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-34be75c673124c80","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d5361cef34bd701722360bcb6ddd6c58","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:13:11.472Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6e598cd2995c9d48da7304c2: start","job_status":"start","queue_duration_s":1.752975,"scheduling_latency_s":1.752992}1275gitlab # [ 240.396400] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:13:13.241Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6e598cd2995c9d48da7304c2","created_at":"2026-08-20T06:13:11.267Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-34be75c673124c80","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d5361cef34bd701722360bcb6ddd6c58","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:13:11.472Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6e598cd2995c9d48da7304c2: done: 0.016056 sec","job_status":"done","queue_duration_s":1.752975,"scheduling_latency_s":1.752992,"redis_calls":13,"redis_duration_s":0.0028539999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000949,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001905,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00987,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016056,"completed_at":"2026-08-20T06:13:13.241Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1276gitlab # [ 240.443055] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:13:13.242Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8d12efbaa365d0576fe28b7e","created_at":"2026-08-20T06:13:11.267Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-34be75c673124c80","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d5361cef34bd701722360bcb6ddd6c58","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:13:11.472Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8d12efbaa365d0576fe28b7e: start","job_status":"start","queue_duration_s":1.770517,"scheduling_latency_s":1.770533}1277gitlab # [ 240.458219] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:13:13.258Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8d12efbaa365d0576fe28b7e","created_at":"2026-08-20T06:13:11.267Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-34be75c673124c80","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d5361cef34bd701722360bcb6ddd6c58","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:13:11.472Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8d12efbaa365d0576fe28b7e: done: 0.015732 sec","job_status":"done","queue_duration_s":1.770517,"scheduling_latency_s":1.770533,"redis_calls":13,"redis_duration_s":0.002922,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000962,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00196,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00972,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015732,"completed_at":"2026-08-20T06:13:13.258Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1278gitlab # [ 240.504555] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:13:13.260Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"935596c762d6f2144b6554d8","created_at":"2026-08-20T06:13:11.267Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-34be75c673124c80","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d5361cef34bd701722360bcb6ddd6c58","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:13:11.472Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-935596c762d6f2144b6554d8: start","job_status":"start","queue_duration_s":1.788413,"scheduling_latency_s":1.788429}1279gitlab # [ 240.519933] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:13:13.277Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"935596c762d6f2144b6554d8","created_at":"2026-08-20T06:13:11.267Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-34be75c673124c80","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d5361cef34bd701722360bcb6ddd6c58","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:13:11.472Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-935596c762d6f2144b6554d8: done: 0.01633 sec","job_status":"done","queue_duration_s":1.788413,"scheduling_latency_s":1.788429,"redis_calls":13,"redis_duration_s":0.002715,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000923,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001792,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01055,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01633,"completed_at":"2026-08-20T06:13:13.277Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1280gitlab # [ 240.560605] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:13:13.278Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"687f1ceb5c4c4ba42050aed4","created_at":"2026-08-20T06:13:11.267Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-34be75c673124c80","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d5361cef34bd701722360bcb6ddd6c58","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:13:11.472Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-687f1ceb5c4c4ba42050aed4: start","job_status":"start","queue_duration_s":1.806082,"scheduling_latency_s":1.806097}1281gitlab # [ 240.572894] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:13:13.294Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"687f1ceb5c4c4ba42050aed4","created_at":"2026-08-20T06:13:11.267Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-34be75c673124c80","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d5361cef34bd701722360bcb6ddd6c58","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:13:11.472Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-687f1ceb5c4c4ba42050aed4: done: 0.016577 sec","job_status":"done","queue_duration_s":1.806082,"scheduling_latency_s":1.806097,"redis_calls":13,"redis_duration_s":0.002879,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000975,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001904,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010824,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016577,"completed_at":"2026-08-20T06:13:13.294Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1282gitlab # [ 240.614007] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:13:13.296Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"299f30e5aac4209058853bf7","created_at":"2026-08-20T06:13:11.267Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-34be75c673124c80","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d5361cef34bd701722360bcb6ddd6c58","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:13:11.472Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-299f30e5aac4209058853bf7: start","job_status":"start","queue_duration_s":1.824095,"scheduling_latency_s":1.824112}1283gitlab # [ 240.629656] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:13:13.312Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"299f30e5aac4209058853bf7","created_at":"2026-08-20T06:13:11.267Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-34be75c673124c80","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d5361cef34bd701722360bcb6ddd6c58","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:13:11.472Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-299f30e5aac4209058853bf7: done: 0.01642 sec","job_status":"done","queue_duration_s":1.824095,"scheduling_latency_s":1.824112,"redis_calls":13,"redis_duration_s":0.002817,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000939,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001878,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009424,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01642,"completed_at":"2026-08-20T06:13:13.312Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1284gitlab # [ 240.676267] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:13:13.315Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c9810f391a40d6ac35726932","created_at":"2026-08-20T06:13:11.267Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-34be75c673124c80","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d5361cef34bd701722360bcb6ddd6c58","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:13:11.472Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c9810f391a40d6ac35726932: start","job_status":"start","queue_duration_s":1.843013,"scheduling_latency_s":1.843029}1285gitlab # [ 240.690172] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:13:13.331Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c9810f391a40d6ac35726932","created_at":"2026-08-20T06:13:11.267Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-34be75c673124c80","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d5361cef34bd701722360bcb6ddd6c58","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:13:11.472Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c9810f391a40d6ac35726932: done: 0.016446 sec","job_status":"done","queue_duration_s":1.843013,"scheduling_latency_s":1.843029,"redis_calls":13,"redis_duration_s":0.002885,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00095,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001935,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010457,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016446,"completed_at":"2026-08-20T06:13:13.331Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1286gitlab # [ 240.735606] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:13:13.333Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"90e41e82536c4f0e8110ff4a","created_at":"2026-08-20T06:13:11.267Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-34be75c673124c80","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d5361cef34bd701722360bcb6ddd6c58","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:13:11.472Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-90e41e82536c4f0e8110ff4a: start","job_status":"start","queue_duration_s":1.860812,"scheduling_latency_s":1.860828}1287gitlab # [ 240.748332] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:13:13.349Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"90e41e82536c4f0e8110ff4a","created_at":"2026-08-20T06:13:11.267Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-34be75c673124c80","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d5361cef34bd701722360bcb6ddd6c58","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:13:11.472Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-90e41e82536c4f0e8110ff4a: done: 0.016596 sec","job_status":"done","queue_duration_s":1.860812,"scheduling_latency_s":1.860828,"redis_calls":13,"redis_duration_s":0.00287,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00094,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00193,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010784,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016596,"completed_at":"2026-08-20T06:13:13.349Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1288gitlab # [ 240.787584] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:13:13.351Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8fdb0bca9be7dd7472e7009c","created_at":"2026-08-20T06:13:11.267Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-34be75c673124c80","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d5361cef34bd701722360bcb6ddd6c58","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:13:11.472Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8fdb0bca9be7dd7472e7009c: start","job_status":"start","queue_duration_s":1.878805,"scheduling_latency_s":1.87882}1289gitlab # [ 240.800158] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:13:13.367Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8fdb0bca9be7dd7472e7009c","created_at":"2026-08-20T06:13:11.267Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-34be75c673124c80","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d5361cef34bd701722360bcb6ddd6c58","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:13:11.472Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8fdb0bca9be7dd7472e7009c: done: 0.016378 sec","job_status":"done","queue_duration_s":1.878805,"scheduling_latency_s":1.87882,"redis_calls":13,"redis_duration_s":0.00272,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000975,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001745,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010757,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016378,"completed_at":"2026-08-20T06:13:13.367Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1290gitlab # [ 240.839101] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:13:13.368Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"99a66c1884bb832bb2cc29d1","created_at":"2026-08-20T06:13:11.267Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-34be75c673124c80","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d5361cef34bd701722360bcb6ddd6c58","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:13:11.472Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-99a66c1884bb832bb2cc29d1: start","job_status":"start","queue_duration_s":1.896597,"scheduling_latency_s":1.896613}1291gitlab # [ 240.851782] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:13:13.385Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"99a66c1884bb832bb2cc29d1","created_at":"2026-08-20T06:13:11.267Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-34be75c673124c80","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d5361cef34bd701722360bcb6ddd6c58","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:13:11.472Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-99a66c1884bb832bb2cc29d1: done: 0.016441 sec","job_status":"done","queue_duration_s":1.896597,"scheduling_latency_s":1.896613,"redis_calls":13,"redis_duration_s":0.002803,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000975,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001828,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009658,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016441,"completed_at":"2026-08-20T06:13:13.385Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1292gitlab # [ 240.891212] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:13:13.387Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e8387f23c45e0df303fe7190","created_at":"2026-08-20T06:13:11.267Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-34be75c673124c80","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d5361cef34bd701722360bcb6ddd6c58","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:13:11.472Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e8387f23c45e0df303fe7190: start","job_status":"start","queue_duration_s":1.915563,"scheduling_latency_s":1.915606}1293gitlab # [ 240.903776] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:13:13.404Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e8387f23c45e0df303fe7190","created_at":"2026-08-20T06:13:11.267Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-34be75c673124c80","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d5361cef34bd701722360bcb6ddd6c58","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:13:11.472Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e8387f23c45e0df303fe7190: done: 0.016356 sec","job_status":"done","queue_duration_s":1.915563,"scheduling_latency_s":1.915606,"redis_calls":13,"redis_duration_s":0.00277,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000923,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001847,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010408,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016356,"completed_at":"2026-08-20T06:13:13.404Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1294gitlab # [ 240.943891] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:13:13.405Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ef5147841db769d29f62ddbf","created_at":"2026-08-20T06:13:11.267Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-34be75c673124c80","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d5361cef34bd701722360bcb6ddd6c58","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:13:11.472Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ef5147841db769d29f62ddbf: start","job_status":"start","queue_duration_s":1.933279,"scheduling_latency_s":1.933295}1295gitlab # [ 240.956415] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:13:13.422Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ef5147841db769d29f62ddbf","created_at":"2026-08-20T06:13:11.267Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-34be75c673124c80","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d5361cef34bd701722360bcb6ddd6c58","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:13:11.472Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ef5147841db769d29f62ddbf: done: 0.016428 sec","job_status":"done","queue_duration_s":1.933279,"scheduling_latency_s":1.933295,"redis_calls":13,"redis_duration_s":0.0038929999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000934,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002959,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010717,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016428,"completed_at":"2026-08-20T06:13:13.421Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1296gitlab # [ 240.995211] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:13:13.423Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"369017e9b9e4e008f63386f9","created_at":"2026-08-20T06:13:11.267Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-34be75c673124c80","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d5361cef34bd701722360bcb6ddd6c58","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:13:11.472Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-369017e9b9e4e008f63386f9: start","job_status":"start","queue_duration_s":1.95115,"scheduling_latency_s":1.951167}1297gitlab # [ 241.007890] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:13:13.440Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"369017e9b9e4e008f63386f9","created_at":"2026-08-20T06:13:11.267Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-34be75c673124c80","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d5361cef34bd701722360bcb6ddd6c58","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:13:11.472Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-369017e9b9e4e008f63386f9: done: 0.016888 sec","job_status":"done","queue_duration_s":1.95115,"scheduling_latency_s":1.951167,"redis_calls":13,"redis_duration_s":0.002895,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000988,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001907,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010929,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016888,"completed_at":"2026-08-20T06:13:13.440Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1298gitlab # [ 241.047340] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:13:13.441Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8a2f69102a7b36562c81945f","created_at":"2026-08-20T06:13:11.267Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-34be75c673124c80","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d5361cef34bd701722360bcb6ddd6c58","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:13:11.472Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8a2f69102a7b36562c81945f: start","job_status":"start","queue_duration_s":1.96941,"scheduling_latency_s":1.969425}1299gitlab # [ 241.059895] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:13:13.458Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8a2f69102a7b36562c81945f","created_at":"2026-08-20T06:13:11.267Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-34be75c673124c80","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d5361cef34bd701722360bcb6ddd6c58","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:13:11.472Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8a2f69102a7b36562c81945f: done: 0.016422 sec","job_status":"done","queue_duration_s":1.96941,"scheduling_latency_s":1.969425,"redis_calls":13,"redis_duration_s":0.0030680000000000004,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000946,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002122,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009394,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016422,"completed_at":"2026-08-20T06:13:13.458Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1300gitlab # [ 241.098928] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:13:13.460Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"034e6ce8aced4ffbaa5a2d3c","created_at":"2026-08-20T06:13:11.267Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-34be75c673124c80","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d5361cef34bd701722360bcb6ddd6c58","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:13:11.472Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-034e6ce8aced4ffbaa5a2d3c: start","job_status":"start","queue_duration_s":1.988442,"scheduling_latency_s":1.988459}1301gitlab # [ 241.111493] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:13:13.476Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"034e6ce8aced4ffbaa5a2d3c","created_at":"2026-08-20T06:13:11.267Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-34be75c673124c80","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d5361cef34bd701722360bcb6ddd6c58","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:13:11.472Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-034e6ce8aced4ffbaa5a2d3c: done: 0.016177 sec","job_status":"done","queue_duration_s":1.988442,"scheduling_latency_s":1.988459,"redis_calls":13,"redis_duration_s":0.0027400000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000915,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001825,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010394,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016177,"completed_at":"2026-08-20T06:13:13.476Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1302gitlab # [ 241.152163] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:13:13.478Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ebe1fe218dde212977107f58","created_at":"2026-08-20T06:13:11.267Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-34be75c673124c80","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d5361cef34bd701722360bcb6ddd6c58","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:13:11.472Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ebe1fe218dde212977107f58: start","job_status":"start","queue_duration_s":2.005958,"scheduling_latency_s":2.005974}1303gitlab # [ 241.164404] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:13:13.494Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ebe1fe218dde212977107f58","created_at":"2026-08-20T06:13:11.267Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-34be75c673124c80","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d5361cef34bd701722360bcb6ddd6c58","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:13:11.472Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ebe1fe218dde212977107f58: done: 0.016448 sec","job_status":"done","queue_duration_s":2.005958,"scheduling_latency_s":2.005974,"redis_calls":13,"redis_duration_s":0.002816,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000929,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001887,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010746,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016448,"completed_at":"2026-08-20T06:13:13.494Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1304gitlab # [ 241.203666] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:13:13.496Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"68d268ec9a200530bdd55d70","created_at":"2026-08-20T06:13:11.267Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-34be75c673124c80","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d5361cef34bd701722360bcb6ddd6c58","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:13:11.472Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-68d268ec9a200530bdd55d70: start","job_status":"start","queue_duration_s":2.023782,"scheduling_latency_s":2.023798}1305gitlab # [ 241.216185] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:13:13.512Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"68d268ec9a200530bdd55d70","created_at":"2026-08-20T06:13:11.267Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-34be75c673124c80","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d5361cef34bd701722360bcb6ddd6c58","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:13:11.472Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-68d268ec9a200530bdd55d70: done: 0.016466 sec","job_status":"done","queue_duration_s":2.023782,"scheduling_latency_s":2.023798,"redis_calls":13,"redis_duration_s":0.002791,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000971,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00182,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010678,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016466,"completed_at":"2026-08-20T06:13:13.512Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1306gitlab # [ 241.254753] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:13:13.514Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"91a9498f91a0004151950771","created_at":"2026-08-20T06:13:11.267Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-34be75c673124c80","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d5361cef34bd701722360bcb6ddd6c58","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:13:11.472Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-91a9498f91a0004151950771: start","job_status":"start","queue_duration_s":2.041643,"scheduling_latency_s":2.041659}1307gitlab # [ 241.267148] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:13:13.531Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"91a9498f91a0004151950771","created_at":"2026-08-20T06:13:11.267Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-34be75c673124c80","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d5361cef34bd701722360bcb6ddd6c58","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:13:11.472Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-91a9498f91a0004151950771: done: 0.017512 sec","job_status":"done","queue_duration_s":2.041643,"scheduling_latency_s":2.041659,"redis_calls":13,"redis_duration_s":0.0028640000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000964,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.0019,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009512,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017512,"completed_at":"2026-08-20T06:13:13.531Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1308gitlab # [ 241.306072] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:13:13.532Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"24300818c1d45090a95b15c4","created_at":"2026-08-20T06:13:11.267Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-34be75c673124c80","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d5361cef34bd701722360bcb6ddd6c58","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:13:11.472Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-24300818c1d45090a95b15c4: start","job_status":"start","queue_duration_s":2.060583,"scheduling_latency_s":2.060599}1309gitlab # [ 241.318585] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:13:13.549Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"24300818c1d45090a95b15c4","created_at":"2026-08-20T06:13:11.267Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-34be75c673124c80","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d5361cef34bd701722360bcb6ddd6c58","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:13:11.472Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-24300818c1d45090a95b15c4: done: 0.016601 sec","job_status":"done","queue_duration_s":2.060583,"scheduling_latency_s":2.060599,"redis_calls":13,"redis_duration_s":0.002831,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000956,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001875,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010818,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016601,"completed_at":"2026-08-20T06:13:13.549Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1310gitlab # [ 241.358312] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:13:13.550Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e259f9656b547ddf25e769aa","created_at":"2026-08-20T06:13:11.267Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-34be75c673124c80","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d5361cef34bd701722360bcb6ddd6c58","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:13:11.472Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e259f9656b547ddf25e769aa: start","job_status":"start","queue_duration_s":2.078569,"scheduling_latency_s":2.078584}1311gitlab # [ 241.370540] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:13:13.579Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e259f9656b547ddf25e769aa","created_at":"2026-08-20T06:13:11.267Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-34be75c673124c80","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d5361cef34bd701722360bcb6ddd6c58","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:13:11.472Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e259f9656b547ddf25e769aa: done: 0.028392 sec","job_status":"done","queue_duration_s":2.078569,"scheduling_latency_s":2.078584,"redis_calls":13,"redis_duration_s":0.009964,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001097,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.008867,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015897,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.028392,"completed_at":"2026-08-20T06:13:13.579Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1312gitlab # [ 241.409751] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:13:13.580Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"06e585c76570673ff76fb67b","created_at":"2026-08-20T06:13:11.267Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-34be75c673124c80","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d5361cef34bd701722360bcb6ddd6c58","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:13:11.472Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-06e585c76570673ff76fb67b: start","job_status":"start","queue_duration_s":2.108597,"scheduling_latency_s":2.108614}1313gitlab # [ 241.422137] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:13:13.813Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"06e585c76570673ff76fb67b","created_at":"2026-08-20T06:13:11.267Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-34be75c673124c80","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d5361cef34bd701722360bcb6ddd6c58","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:13:11.472Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-06e585c76570673ff76fb67b: done: 0.232737 sec","job_status":"done","queue_duration_s":2.108597,"scheduling_latency_s":2.108614,"redis_calls":13,"redis_duration_s":0.1678,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.158245,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.009555,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.050716,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.232737,"completed_at":"2026-08-20T06:13:13.813Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1314gitlab # [ 241.460754] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:13:13.816Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"71f40b678934c8eb54500393","created_at":"2026-08-20T06:13:11.267Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-34be75c673124c80","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d5361cef34bd701722360bcb6ddd6c58","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:13:11.472Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-71f40b678934c8eb54500393: start","job_status":"start","queue_duration_s":2.34418,"scheduling_latency_s":2.344216}1315gitlab # [ 241.472989] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:13:13.848Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"71f40b678934c8eb54500393","created_at":"2026-08-20T06:13:11.267Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-34be75c673124c80","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d5361cef34bd701722360bcb6ddd6c58","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:13:11.472Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-71f40b678934c8eb54500393: done: 0.031865 sec","job_status":"done","queue_duration_s":2.34418,"scheduling_latency_s":2.344216,"redis_calls":13,"redis_duration_s":0.002975,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001008,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001967,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022635,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.031865,"completed_at":"2026-08-20T06:13:13.848Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1316gitlab # [ 241.512363] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:13:13.850Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ae2bdb58360f99155033214c","created_at":"2026-08-20T06:13:11.267Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-34be75c673124c80","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d5361cef34bd701722360bcb6ddd6c58","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:13:11.472Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ae2bdb58360f99155033214c: start","job_status":"start","queue_duration_s":2.378195,"scheduling_latency_s":2.378223}1317gitlab # [ 241.524648] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:13:13.877Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ae2bdb58360f99155033214c","created_at":"2026-08-20T06:13:11.267Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-34be75c673124c80","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d5361cef34bd701722360bcb6ddd6c58","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:13:11.472Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ae2bdb58360f99155033214c: done: 0.026807 sec","job_status":"done","queue_duration_s":2.378195,"scheduling_latency_s":2.378223,"redis_calls":13,"redis_duration_s":0.0033250000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001128,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002197,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017024,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.026807,"completed_at":"2026-08-20T06:13:13.877Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1318gitlab # [ 241.570684] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:13:13.880Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0bc9c36aaa570c6c0c480c3a","created_at":"2026-08-20T06:13:11.267Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-34be75c673124c80","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d5361cef34bd701722360bcb6ddd6c58","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:13:11.472Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0bc9c36aaa570c6c0c480c3a: start","job_status":"start","queue_duration_s":2.407963,"scheduling_latency_s":2.407987}1319gitlab # [ 241.585498] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:13:13.902Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0bc9c36aaa570c6c0c480c3a","created_at":"2026-08-20T06:13:11.267Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-34be75c673124c80","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d5361cef34bd701722360bcb6ddd6c58","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:13:11.472Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0bc9c36aaa570c6c0c480c3a: done: 0.021818 sec","job_status":"done","queue_duration_s":2.407963,"scheduling_latency_s":2.407987,"redis_calls":13,"redis_duration_s":0.003066,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001015,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002051,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014531,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.021818,"completed_at":"2026-08-20T06:13:13.902Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1320gitlab # [ 241.631607] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:13:13.903Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3f4a128673616688754d62bc","created_at":"2026-08-20T06:13:11.267Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-34be75c673124c80","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d5361cef34bd701722360bcb6ddd6c58","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:13:11.472Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3f4a128673616688754d62bc: start","job_status":"start","queue_duration_s":2.431408,"scheduling_latency_s":2.431429}1321gitlab # [ 241.644272] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:13:13.924Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3f4a128673616688754d62bc","created_at":"2026-08-20T06:13:11.267Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-34be75c673124c80","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d5361cef34bd701722360bcb6ddd6c58","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:13:11.472Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3f4a128673616688754d62bc: done: 0.020746 sec","job_status":"done","queue_duration_s":2.431408,"scheduling_latency_s":2.431429,"redis_calls":13,"redis_duration_s":0.002968,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001029,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001939,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01387,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.020746,"completed_at":"2026-08-20T06:13:13.924Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1322gitlab # [ 241.683641] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:13:13.926Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7fab011fe8b137d544940bca","created_at":"2026-08-20T06:13:11.267Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-34be75c673124c80","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d5361cef34bd701722360bcb6ddd6c58","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:13:11.472Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7fab011fe8b137d544940bca: start","job_status":"start","queue_duration_s":2.453702,"scheduling_latency_s":2.453722}1323gitlab # [ 241.696187] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:13:13.944Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7fab011fe8b137d544940bca","created_at":"2026-08-20T06:13:11.267Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-34be75c673124c80","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d5361cef34bd701722360bcb6ddd6c58","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:13:11.472Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7fab011fe8b137d544940bca: done: 0.018504 sec","job_status":"done","queue_duration_s":2.453702,"scheduling_latency_s":2.453722,"redis_calls":13,"redis_duration_s":0.002955,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000951,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002004,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011974,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018504,"completed_at":"2026-08-20T06:13:13.944Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1324gitlab # [ 241.735046] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:13:13.945Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ab950c42a76e8728e44a6bc0","created_at":"2026-08-20T06:13:11.267Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-34be75c673124c80","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d5361cef34bd701722360bcb6ddd6c58","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:13:11.472Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ab950c42a76e8728e44a6bc0: start","job_status":"start","queue_duration_s":2.473599,"scheduling_latency_s":2.473617}1325gitlab # [ 241.748658] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:13:13.962Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ab950c42a76e8728e44a6bc0","created_at":"2026-08-20T06:13:11.267Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-34be75c673124c80","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d5361cef34bd701722360bcb6ddd6c58","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:13:11.472Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ab950c42a76e8728e44a6bc0: done: 0.016894 sec","job_status":"done","queue_duration_s":2.473599,"scheduling_latency_s":2.473617,"redis_calls":13,"redis_duration_s":0.003197,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001394,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001803,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009894,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016894,"completed_at":"2026-08-20T06:13:13.962Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1326gitlab # [ 241.787694] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:13:13.964Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d2b2799e557f2efcc948d739","created_at":"2026-08-20T06:13:11.267Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-34be75c673124c80","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d5361cef34bd701722360bcb6ddd6c58","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:13:11.472Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d2b2799e557f2efcc948d739: start","job_status":"start","queue_duration_s":2.492464,"scheduling_latency_s":2.492485}1327gitlab # [ 241.800373] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:13:13.980Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d2b2799e557f2efcc948d739","created_at":"2026-08-20T06:13:11.267Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-34be75c673124c80","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d5361cef34bd701722360bcb6ddd6c58","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:13:11.472Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d2b2799e557f2efcc948d739: done: 0.016143 sec","job_status":"done","queue_duration_s":2.492464,"scheduling_latency_s":2.492485,"redis_calls":13,"redis_duration_s":0.0028190000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000946,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001873,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010141,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016143,"completed_at":"2026-08-20T06:13:13.980Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1328gitlab # [ 241.845058] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:13:13.982Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"55d9efc2f00b13df834050fc","created_at":"2026-08-20T06:13:11.267Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-34be75c673124c80","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d5361cef34bd701722360bcb6ddd6c58","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:13:11.472Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-55d9efc2f00b13df834050fc: start","job_status":"start","queue_duration_s":2.509992,"scheduling_latency_s":2.510008}1329gitlab # [ 241.883779] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:13:13.998Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"55d9efc2f00b13df834050fc","created_at":"2026-08-20T06:13:11.267Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-34be75c673124c80","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d5361cef34bd701722360bcb6ddd6c58","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:13:11.472Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-55d9efc2f00b13df834050fc: done: 0.015729 sec","job_status":"done","queue_duration_s":2.509992,"scheduling_latency_s":2.510008,"redis_calls":13,"redis_duration_s":0.002768,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000905,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001863,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010037,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015729,"completed_at":"2026-08-20T06:13:13.997Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1330gitlab # [ 241.972744] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:13:13.999Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cb9ce010a923af40a83ce65f","created_at":"2026-08-20T06:13:11.267Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-34be75c673124c80","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d5361cef34bd701722360bcb6ddd6c58","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:13:11.472Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cb9ce010a923af40a83ce65f: start","job_status":"start","queue_duration_s":2.527066,"scheduling_latency_s":2.527082}1331gitlab # [ 241.992481] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:13:14.015Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cb9ce010a923af40a83ce65f","created_at":"2026-08-20T06:13:11.267Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-34be75c673124c80","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d5361cef34bd701722360bcb6ddd6c58","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:13:11.472Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cb9ce010a923af40a83ce65f: done: 0.015764 sec","job_status":"done","queue_duration_s":2.527066,"scheduling_latency_s":2.527082,"redis_calls":13,"redis_duration_s":0.002814,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000943,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001871,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010084,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015764,"completed_at":"2026-08-20T06:13:14.015Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1332gitlab # [ 242.049569] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:13:14.016Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"651cf1e8e09f3a9f68181b37","created_at":"2026-08-20T06:13:11.267Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-34be75c673124c80","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d5361cef34bd701722360bcb6ddd6c58","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:13:11.472Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-651cf1e8e09f3a9f68181b37: start","job_status":"start","queue_duration_s":2.54426,"scheduling_latency_s":2.544276}1333gitlab # [ 242.064690] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:13:14.032Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"651cf1e8e09f3a9f68181b37","created_at":"2026-08-20T06:13:11.267Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-34be75c673124c80","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d5361cef34bd701722360bcb6ddd6c58","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:13:11.472Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-651cf1e8e09f3a9f68181b37: done: 0.015721 sec","job_status":"done","queue_duration_s":2.54426,"scheduling_latency_s":2.544276,"redis_calls":13,"redis_duration_s":0.002767,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000906,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001861,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009474,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015721,"completed_at":"2026-08-20T06:13:14.032Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1334gitlab # [ 242.110611] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:13:14.034Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9b4bb95c5e844539eaa6f30c","created_at":"2026-08-20T06:13:11.267Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-34be75c673124c80","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d5361cef34bd701722360bcb6ddd6c58","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:13:11.472Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9b4bb95c5e844539eaa6f30c: start","job_status":"start","queue_duration_s":2.561924,"scheduling_latency_s":2.561939}1335gitlab # [ 242.123246] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:13:14.049Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9b4bb95c5e844539eaa6f30c","created_at":"2026-08-20T06:13:11.267Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-34be75c673124c80","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d5361cef34bd701722360bcb6ddd6c58","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:13:11.472Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9b4bb95c5e844539eaa6f30c: done: 0.015424 sec","job_status":"done","queue_duration_s":2.561924,"scheduling_latency_s":2.561939,"redis_calls":13,"redis_duration_s":0.0026049999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000913,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001692,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009815,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015424,"completed_at":"2026-08-20T06:13:14.049Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1336gitlab # [ 242.163725] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:13:14.051Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5858c46623699f199bb6f99a","created_at":"2026-08-20T06:13:11.267Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-34be75c673124c80","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d5361cef34bd701722360bcb6ddd6c58","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:13:11.472Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5858c46623699f199bb6f99a: start","job_status":"start","queue_duration_s":2.578718,"scheduling_latency_s":2.578733}1337gitlab # [ 242.176332] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:13:14.066Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5858c46623699f199bb6f99a","created_at":"2026-08-20T06:13:11.267Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-34be75c673124c80","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d5361cef34bd701722360bcb6ddd6c58","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:13:11.472Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5858c46623699f199bb6f99a: done: 0.015949 sec","job_status":"done","queue_duration_s":2.578718,"scheduling_latency_s":2.578733,"redis_calls":13,"redis_duration_s":0.0035399999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000937,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002603,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009953,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015949,"completed_at":"2026-08-20T06:13:14.066Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1338gitlab # [ 242.215892] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:13:14.068Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"16fcd5a338c8013286b3a710","created_at":"2026-08-20T06:13:11.267Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-34be75c673124c80","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d5361cef34bd701722360bcb6ddd6c58","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:13:11.472Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-16fcd5a338c8013286b3a710: start","job_status":"start","queue_duration_s":2.596066,"scheduling_latency_s":2.59608}1339gitlab # [ 242.228610] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:13:14.083Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"16fcd5a338c8013286b3a710","created_at":"2026-08-20T06:13:11.267Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-34be75c673124c80","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d5361cef34bd701722360bcb6ddd6c58","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:13:11.472Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-16fcd5a338c8013286b3a710: done: 0.015385 sec","job_status":"done","queue_duration_s":2.596066,"scheduling_latency_s":2.59608,"redis_calls":13,"redis_duration_s":0.002737,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00096,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001777,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009807,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015385,"completed_at":"2026-08-20T06:13:14.083Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1340gitlab # [ 242.267588] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:13:14.085Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"967a7dcddad9cb4f77f56e42","created_at":"2026-08-20T06:13:11.267Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-34be75c673124c80","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d5361cef34bd701722360bcb6ddd6c58","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:13:11.472Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-967a7dcddad9cb4f77f56e42: start","job_status":"start","queue_duration_s":2.61288,"scheduling_latency_s":2.612896}1341gitlab # [ 242.280062] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:13:14.112Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"967a7dcddad9cb4f77f56e42","created_at":"2026-08-20T06:13:11.267Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-34be75c673124c80","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d5361cef34bd701722360bcb6ddd6c58","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:13:11.472Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-967a7dcddad9cb4f77f56e42: done: 0.027434 sec","job_status":"done","queue_duration_s":2.61288,"scheduling_latency_s":2.612896,"redis_calls":13,"redis_duration_s":0.003802,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001281,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002521,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01951,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.027434,"completed_at":"2026-08-20T06:13:14.112Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1342gitlab # [ 242.318360] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:13:14.116Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"623602120a454e249b942e0f","created_at":"2026-08-20T06:13:11.267Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-34be75c673124c80","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d5361cef34bd701722360bcb6ddd6c58","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:13:11.472Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-623602120a454e249b942e0f: start","job_status":"start","queue_duration_s":2.644226,"scheduling_latency_s":2.644265}1343gitlab # [ 242.330675] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:13:14.151Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"623602120a454e249b942e0f","created_at":"2026-08-20T06:13:11.267Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-34be75c673124c80","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d5361cef34bd701722360bcb6ddd6c58","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:13:11.472Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-623602120a454e249b942e0f: done: 0.034935 sec","job_status":"done","queue_duration_s":2.644226,"scheduling_latency_s":2.644265,"redis_calls":13,"redis_duration_s":0.0034,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001274,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002126,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024478,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.034935,"completed_at":"2026-08-20T06:13:14.151Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1344gitlab # [ 242.370229] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:13:14.153Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4be1e7620566a7e2bcf1df89","created_at":"2026-08-20T06:13:11.267Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-34be75c673124c80","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d5361cef34bd701722360bcb6ddd6c58","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:13:11.472Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4be1e7620566a7e2bcf1df89: start","job_status":"start","queue_duration_s":2.681057,"scheduling_latency_s":2.681085}1345gitlab # [ 242.382306] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:13:14.176Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4be1e7620566a7e2bcf1df89","created_at":"2026-08-20T06:13:11.267Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-34be75c673124c80","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d5361cef34bd701722360bcb6ddd6c58","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:13:11.472Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4be1e7620566a7e2bcf1df89: done: 0.023408 sec","job_status":"done","queue_duration_s":2.681057,"scheduling_latency_s":2.681085,"redis_calls":13,"redis_duration_s":0.002524,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001039,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001485,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016077,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.023408,"completed_at":"2026-08-20T06:13:14.176Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1346gitlab # [ 242.421053] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:13:14.178Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c75e28183c823150475510f3","created_at":"2026-08-20T06:13:11.267Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-34be75c673124c80","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d5361cef34bd701722360bcb6ddd6c58","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:13:11.472Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c75e28183c823150475510f3: start","job_status":"start","queue_duration_s":2.705872,"scheduling_latency_s":2.705893}1347gitlab # [ 242.433301] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:13:14.197Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c75e28183c823150475510f3","created_at":"2026-08-20T06:13:11.267Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-34be75c673124c80","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d5361cef34bd701722360bcb6ddd6c58","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:13:11.472Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c75e28183c823150475510f3: done: 0.018931 sec","job_status":"done","queue_duration_s":2.705872,"scheduling_latency_s":2.705893,"redis_calls":13,"redis_duration_s":0.001802,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000634,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001168,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012562,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018931,"completed_at":"2026-08-20T06:13:14.197Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1348gitlab # [ 242.472081] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:13:14.199Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2fdd1e5b4b5eaa0d2b93b0ab","created_at":"2026-08-20T06:13:11.267Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-34be75c673124c80","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d5361cef34bd701722360bcb6ddd6c58","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:13:11.472Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2fdd1e5b4b5eaa0d2b93b0ab: start","job_status":"start","queue_duration_s":2.726896,"scheduling_latency_s":2.726915}1349gitlab # [ 242.483974] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:13:14.215Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2fdd1e5b4b5eaa0d2b93b0ab","created_at":"2026-08-20T06:13:11.267Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-34be75c673124c80","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d5361cef34bd701722360bcb6ddd6c58","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:13:11.472Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2fdd1e5b4b5eaa0d2b93b0ab: done: 0.016105 sec","job_status":"done","queue_duration_s":2.726896,"scheduling_latency_s":2.726915,"redis_calls":13,"redis_duration_s":0.0015769999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000563,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001014,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011262,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016105,"completed_at":"2026-08-20T06:13:14.215Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1350gitlab # [ 242.523277] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:13:14.216Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"970b52b86e8082ded5286591","created_at":"2026-08-20T06:13:11.267Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-34be75c673124c80","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d5361cef34bd701722360bcb6ddd6c58","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:13:11.472Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-970b52b86e8082ded5286591: start","job_status":"start","queue_duration_s":2.744204,"scheduling_latency_s":2.74422}1351gitlab # [ 242.536939] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:13:14.232Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"970b52b86e8082ded5286591","created_at":"2026-08-20T06:13:11.267Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-34be75c673124c80","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d5361cef34bd701722360bcb6ddd6c58","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:13:11.472Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-970b52b86e8082ded5286591: done: 0.015735 sec","job_status":"done","queue_duration_s":2.744204,"scheduling_latency_s":2.74422,"redis_calls":13,"redis_duration_s":0.001556,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000571,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000985,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011077,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015735,"completed_at":"2026-08-20T06:13:14.232Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1352gitlab # [ 242.582708] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:13:14.233Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f715b2c4b81572640265894b","created_at":"2026-08-20T06:13:11.267Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-34be75c673124c80","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d5361cef34bd701722360bcb6ddd6c58","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:13:11.472Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f715b2c4b81572640265894b: start","job_status":"start","queue_duration_s":2.761028,"scheduling_latency_s":2.761045}1353gitlab # [ 242.597486] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:13:14.249Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f715b2c4b81572640265894b","created_at":"2026-08-20T06:13:11.267Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-34be75c673124c80","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d5361cef34bd701722360bcb6ddd6c58","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:13:11.472Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f715b2c4b81572640265894b: done: 0.015823 sec","job_status":"done","queue_duration_s":2.761028,"scheduling_latency_s":2.761045,"redis_calls":13,"redis_duration_s":0.001534,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000584,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00095,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010529,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015823,"completed_at":"2026-08-20T06:13:14.249Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1354gitlab # [ 242.643044] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:13:14.250Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5f47a4613d745f375f2d2896","created_at":"2026-08-20T06:13:11.267Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-34be75c673124c80","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d5361cef34bd701722360bcb6ddd6c58","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:13:11.472Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5f47a4613d745f375f2d2896: start","job_status":"start","queue_duration_s":2.777982,"scheduling_latency_s":2.777999}1355gitlab # [ 242.655751] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:13:14.265Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5f47a4613d745f375f2d2896","created_at":"2026-08-20T06:13:11.267Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-34be75c673124c80","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d5361cef34bd701722360bcb6ddd6c58","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:13:11.472Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5f47a4613d745f375f2d2896: done: 0.015311 sec","job_status":"done","queue_duration_s":2.777982,"scheduling_latency_s":2.777999,"redis_calls":13,"redis_duration_s":0.0016950000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000549,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001146,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010482,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015311,"completed_at":"2026-08-20T06:13:14.265Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1356gitlab # [ 242.695115] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:13:14.266Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4143d1838b421d4c949a7034","created_at":"2026-08-20T06:13:11.267Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-34be75c673124c80","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d5361cef34bd701722360bcb6ddd6c58","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:13:11.472Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4143d1838b421d4c949a7034: start","job_status":"start","queue_duration_s":2.794475,"scheduling_latency_s":2.794492}1357gitlab # [ 242.707692] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:13:14.281Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4143d1838b421d4c949a7034","created_at":"2026-08-20T06:13:11.267Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-34be75c673124c80","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d5361cef34bd701722360bcb6ddd6c58","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:13:11.472Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4143d1838b421d4c949a7034: done: 0.014842 sec","job_status":"done","queue_duration_s":2.794475,"scheduling_latency_s":2.794492,"redis_calls":13,"redis_duration_s":0.001448,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00052,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000928,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010275,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014842,"completed_at":"2026-08-20T06:13:14.281Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1358gitlab # [ 242.747098] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:13:14.282Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"52f4b57dbb99a8026f50d759","created_at":"2026-08-20T06:13:11.267Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-34be75c673124c80","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d5361cef34bd701722360bcb6ddd6c58","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:13:11.472Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-52f4b57dbb99a8026f50d759: start","job_status":"start","queue_duration_s":2.810414,"scheduling_latency_s":2.810431}1359gitlab # [ 242.760542] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:13:14.297Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"52f4b57dbb99a8026f50d759","created_at":"2026-08-20T06:13:11.267Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-34be75c673124c80","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d5361cef34bd701722360bcb6ddd6c58","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:13:11.472Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-52f4b57dbb99a8026f50d759: done: 0.014991 sec","job_status":"done","queue_duration_s":2.810414,"scheduling_latency_s":2.810431,"redis_calls":13,"redis_duration_s":0.0014190000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000521,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000898,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010271,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014991,"completed_at":"2026-08-20T06:13:14.297Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1360gitlab # [ 242.799925] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:13:14.298Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f7b8d51d9628269ea7b8331f","created_at":"2026-08-20T06:13:11.267Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-34be75c673124c80","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d5361cef34bd701722360bcb6ddd6c58","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:13:11.472Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f7b8d51d9628269ea7b8331f: start","job_status":"start","queue_duration_s":2.826489,"scheduling_latency_s":2.826505}1361gitlab # [ 242.812608] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:13:14.313Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f7b8d51d9628269ea7b8331f","created_at":"2026-08-20T06:13:11.267Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-34be75c673124c80","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d5361cef34bd701722360bcb6ddd6c58","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:13:11.472Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f7b8d51d9628269ea7b8331f: done: 0.014834 sec","job_status":"done","queue_duration_s":2.826489,"scheduling_latency_s":2.826505,"redis_calls":13,"redis_duration_s":0.001528,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000536,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000992,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010374,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014834,"completed_at":"2026-08-20T06:13:14.313Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1362gitlab # [ 242.852862] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:13:14.314Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5c3fed4acf1b59963115878e","created_at":"2026-08-20T06:13:11.267Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-34be75c673124c80","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d5361cef34bd701722360bcb6ddd6c58","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:13:11.472Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5c3fed4acf1b59963115878e: start","job_status":"start","queue_duration_s":2.842381,"scheduling_latency_s":2.842396}1363gitlab # [ 242.890385] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:13:14.329Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5c3fed4acf1b59963115878e","created_at":"2026-08-20T06:13:11.267Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-34be75c673124c80","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d5361cef34bd701722360bcb6ddd6c58","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:13:11.472Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5c3fed4acf1b59963115878e: done: 0.014821 sec","job_status":"done","queue_duration_s":2.842381,"scheduling_latency_s":2.842396,"redis_calls":13,"redis_duration_s":0.001429,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000529,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.0009,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01044,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014821,"completed_at":"2026-08-20T06:13:14.329Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1364gitlab # [ 242.960583] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:13:14.330Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"85c3c540912da547ea14f8d0","created_at":"2026-08-20T06:13:11.267Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-34be75c673124c80","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d5361cef34bd701722360bcb6ddd6c58","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:13:11.472Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-85c3c540912da547ea14f8d0: start","job_status":"start","queue_duration_s":2.858275,"scheduling_latency_s":2.858292}1365gitlab # [ 242.976581] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:13:14.345Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"85c3c540912da547ea14f8d0","created_at":"2026-08-20T06:13:11.267Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-34be75c673124c80","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d5361cef34bd701722360bcb6ddd6c58","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:13:11.472Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-85c3c540912da547ea14f8d0: done: 0.014695 sec","job_status":"done","queue_duration_s":2.858275,"scheduling_latency_s":2.858292,"redis_calls":13,"redis_duration_s":0.001415,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000513,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000902,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010229,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014695,"completed_at":"2026-08-20T06:13:14.345Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1366gitlab # [ 243.023894] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:13:14.346Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e9c9ae82f2def1d7e5e368c7","created_at":"2026-08-20T06:13:11.267Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-34be75c673124c80","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d5361cef34bd701722360bcb6ddd6c58","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:13:11.472Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e9c9ae82f2def1d7e5e368c7: start","job_status":"start","queue_duration_s":2.874023,"scheduling_latency_s":2.874039}1367gitlab # [ 243.037961] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:13:14.361Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e9c9ae82f2def1d7e5e368c7","created_at":"2026-08-20T06:13:11.267Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-34be75c673124c80","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d5361cef34bd701722360bcb6ddd6c58","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:13:11.472Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e9c9ae82f2def1d7e5e368c7: done: 0.014947 sec","job_status":"done","queue_duration_s":2.874023,"scheduling_latency_s":2.874039,"redis_calls":13,"redis_duration_s":0.001482,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000541,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000941,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010449,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014947,"completed_at":"2026-08-20T06:13:14.361Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1368gitlab # [ 243.078483] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:13:14.362Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"47548dd73147ff5d7c854643","created_at":"2026-08-20T06:13:11.267Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-34be75c673124c80","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d5361cef34bd701722360bcb6ddd6c58","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:13:11.472Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-47548dd73147ff5d7c854643: start","job_status":"start","queue_duration_s":2.890076,"scheduling_latency_s":2.890093}1369gitlab # [ 243.091135] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:13:14.377Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"47548dd73147ff5d7c854643","created_at":"2026-08-20T06:13:11.267Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-34be75c673124c80","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d5361cef34bd701722360bcb6ddd6c58","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:13:11.472Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-47548dd73147ff5d7c854643: done: 0.014901 sec","job_status":"done","queue_duration_s":2.890076,"scheduling_latency_s":2.890093,"redis_calls":13,"redis_duration_s":0.001425,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000524,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000901,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010174,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014901,"completed_at":"2026-08-20T06:13:14.377Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1370gitlab # [ 243.130982] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:13:14.378Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e106a6d99dc9d868c7323609","created_at":"2026-08-20T06:13:11.267Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-34be75c673124c80","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d5361cef34bd701722360bcb6ddd6c58","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:13:11.472Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e106a6d99dc9d868c7323609: start","job_status":"start","queue_duration_s":2.906046,"scheduling_latency_s":2.906062}1371gitlab # [ 243.143570] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:13:14.395Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e106a6d99dc9d868c7323609","created_at":"2026-08-20T06:13:11.267Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-34be75c673124c80","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d5361cef34bd701722360bcb6ddd6c58","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:13:11.472Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e106a6d99dc9d868c7323609: done: 0.017307 sec","job_status":"done","queue_duration_s":2.906046,"scheduling_latency_s":2.906062,"redis_calls":13,"redis_duration_s":0.001442,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000525,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000917,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00992,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017307,"completed_at":"2026-08-20T06:13:14.395Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1372gitlab # [ 243.184449] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:13:14.396Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"0df68cc9b2d3c27a96f1a8e2","created_at":"2026-08-20T06:13:13.043Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-49f171082c724716","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"c3280d5f93fa5d734d74a159ca9bb46b","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:13:13.057Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-0df68cc9b2d3c27a96f1a8e2: start","job_status":"start","queue_duration_s":1.339288,"scheduling_latency_s":1.339304}1373gitlab # [ 243.196903] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:13:14.414Z","message":"No existing merge request to be cleaned up."}1374gitlab # [ 243.198608] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:13:14.429Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"0df68cc9b2d3c27a96f1a8e2","created_at":"2026-08-20T06:13:13.043Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-49f171082c724716","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"c3280d5f93fa5d734d74a159ca9bb46b","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:13:13.057Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-0df68cc9b2d3c27a96f1a8e2: done: 0.032295 sec","job_status":"done","queue_duration_s":1.339288,"scheduling_latency_s":1.339304,"redis_calls":13,"redis_duration_s":0.001773,"redis_read_bytes":12,"redis_write_bytes":1401,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000288,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":301,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000641,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":431,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000844,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":669,"db_count":4,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020261,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00025316,"duration_s":0.032295,"completed_at":"2026-08-20T06:13:14.429Z","load_balancing_strategy":"primary","db_duration_s":0.007098,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1375gitlab # [ 243.239464] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:13:14.430Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"cdd8cc52638e64578888d481","created_at":"2026-08-20T06:13:13.043Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-49f171082c724716","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"c3280d5f93fa5d734d74a159ca9bb46b","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:13:13.057Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-cdd8cc52638e64578888d481: start","job_status":"start","queue_duration_s":1.372839,"scheduling_latency_s":1.372856}1376gitlab # [ 243.251886] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:13:14.441Z","message":"No existing merge request to be cleaned up."}1377gitlab # [ 243.253692] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:13:14.450Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"cdd8cc52638e64578888d481","created_at":"2026-08-20T06:13:13.043Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-49f171082c724716","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"c3280d5f93fa5d734d74a159ca9bb46b","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:13:13.057Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-cdd8cc52638e64578888d481: done: 0.01983 sec","job_status":"done","queue_duration_s":1.372839,"scheduling_latency_s":1.372856,"redis_calls":10,"redis_duration_s":0.0013289999999999999,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00059,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000739,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013703,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01983,"completed_at":"2026-08-20T06:13:14.450Z","load_balancing_strategy":"primary","db_duration_s":0.002702,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1378gitlab # [ 243.292092] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:13:14.451Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"7cbcf52465342b58c5aa3e49","created_at":"2026-08-20T06:13:13.043Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-49f171082c724716","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"c3280d5f93fa5d734d74a159ca9bb46b","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:13:13.057Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-7cbcf52465342b58c5aa3e49: start","job_status":"start","queue_duration_s":1.393775,"scheduling_latency_s":1.393792}1379gitlab # [ 243.304380] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:13:14.462Z","message":"No existing merge request to be cleaned up."}1380gitlab # [ 243.305994] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:13:14.470Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"7cbcf52465342b58c5aa3e49","created_at":"2026-08-20T06:13:13.043Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-49f171082c724716","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"c3280d5f93fa5d734d74a159ca9bb46b","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:13:13.057Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-7cbcf52465342b58c5aa3e49: done: 0.019218 sec","job_status":"done","queue_duration_s":1.393775,"scheduling_latency_s":1.393792,"redis_calls":10,"redis_duration_s":0.00133,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000578,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000752,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013313,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019218,"completed_at":"2026-08-20T06:13:14.470Z","load_balancing_strategy":"primary","db_duration_s":0.002506,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1381gitlab # [ 243.344391] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:13:14.471Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"cc44d8cdc9822cb0ffcfcb33","created_at":"2026-08-20T06:13:13.043Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-49f171082c724716","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"c3280d5f93fa5d734d74a159ca9bb46b","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:13:13.057Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-cc44d8cdc9822cb0ffcfcb33: start","job_status":"start","queue_duration_s":1.414044,"scheduling_latency_s":1.414062}1382gitlab # [ 243.356638] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:13:14.482Z","message":"No existing merge request to be cleaned up."}1383gitlab # [ 243.358269] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:13:14.491Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"cc44d8cdc9822cb0ffcfcb33","created_at":"2026-08-20T06:13:13.043Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-49f171082c724716","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"c3280d5f93fa5d734d74a159ca9bb46b","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:13:13.057Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-cc44d8cdc9822cb0ffcfcb33: done: 0.019825 sec","job_status":"done","queue_duration_s":1.414044,"scheduling_latency_s":1.414062,"redis_calls":10,"redis_duration_s":0.0014030000000000002,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000595,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000808,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013653,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019825,"completed_at":"2026-08-20T06:13:14.491Z","load_balancing_strategy":"primary","db_duration_s":0.002405,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1384gitlab # [ 269.385912] setup-gitlab-start[2937]: W, [2026-08-20T06:13:42.292545 #2937] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1385gitlab # [ 293.574889] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:14:06.479Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"121825881d66eaa4b8cc5ea4","created_at":"2026-08-20T06:14:06.458Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-d05502bc9eab4b30","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"375c2f73fe4b51841ebd803d284c1b2c","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-20T06:14:06.475Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-121825881d66eaa4b8cc5ea4: start","job_status":"start","queue_duration_s":0.003931,"scheduling_latency_s":0.00398}1386gitlab # [ 293.770770] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:14:06.675Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"121825881d66eaa4b8cc5ea4","created_at":"2026-08-20T06:14:06.458Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-d05502bc9eab4b30","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"375c2f73fe4b51841ebd803d284c1b2c","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-20T06:14:06.475Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-121825881d66eaa4b8cc5ea4: done: 0.196226 sec","job_status":"done","queue_duration_s":0.003931,"scheduling_latency_s":0.00398,"redis_calls":13,"redis_duration_s":0.093301,"redis_read_bytes":773,"redis_write_bytes":1111,"redis_feature_flag_calls":6,"redis_feature_flag_duration_s":0.017101,"redis_feature_flag_read_bytes":768,"redis_feature_flag_write_bytes":400,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.073683,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":491,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002517,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":220,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.014,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.014,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.04763,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.196226,"completed_at":"2026-08-20T06:14:06.675Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.022392,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1387gitlab # [ 293.864997] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:14:06.691Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"e668fb9c12e1c76d1469762c","created_at":"2026-08-20T06:14:06.496Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-d05502bc9eab4b30","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1b80e4d40ad05adbdb3e7bf73a5d73fa","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-20T06:14:06.512Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-e668fb9c12e1c76d1469762c: start","job_status":"start","queue_duration_s":0.179011,"scheduling_latency_s":0.179064}1388gitlab # [ 293.932806] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:14:06.838Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"e668fb9c12e1c76d1469762c","created_at":"2026-08-20T06:14:06.496Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-d05502bc9eab4b30","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1b80e4d40ad05adbdb3e7bf73a5d73fa","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-20T06:14:06.512Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-e668fb9c12e1c76d1469762c: done: 0.146712 sec","job_status":"done","queue_duration_s":0.179011,"scheduling_latency_s":0.179064,"redis_calls":8,"redis_duration_s":0.050492,"redis_read_bytes":133,"redis_write_bytes":811,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.001925,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":70,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.045773,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002794,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.01,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.045892,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.146712,"completed_at":"2026-08-20T06:14:06.838Z","load_balancing_strategy":"primary","db_duration_s":0.010377,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1389gitlab # [ 294.028537] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:14:06.855Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"dc1a15951f59456732cda6bd","created_at":"2026-08-20T06:14:06.562Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-d05502bc9eab4b30","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b33c5c737e18eff4744e32f52648134b","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-20T06:14:06.573Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-dc1a15951f59456732cda6bd: start","job_status":"start","queue_duration_s":0.282274,"scheduling_latency_s":0.282332}1390gitlab # [ 294.132093] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:14:07.039Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0}1391gitlab # [ 294.171404] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:14:07.077Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"dc1a15951f59456732cda6bd","created_at":"2026-08-20T06:14:06.562Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-d05502bc9eab4b30","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b33c5c737e18eff4744e32f52648134b","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-20T06:14:06.573Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-dc1a15951f59456732cda6bd: done: 0.222044 sec","job_status":"done","queue_duration_s":0.282274,"scheduling_latency_s":0.282332,"redis_calls":7,"redis_duration_s":0.017642,"redis_read_bytes":5,"redis_write_bytes":821,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.005668,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":557,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.011974,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":264,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.028224,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.222044,"completed_at":"2026-08-20T06:14:07.077Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1392gitlab # [ 294.263973] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:14:07.112Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"0526290159c2e58b922adef4","created_at":"2026-08-20T06:14:06.590Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-d05502bc9eab4b30","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b4b40ce5c30266454ede7c8e825a3a9d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-20T06:14:06.601Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-0526290159c2e58b922adef4: start","job_status":"start","queue_duration_s":0.510598,"scheduling_latency_s":0.510668}1393gitlab # [ 294.282076] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:14:07.141Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0}1394gitlab # [ 294.313413] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:14:07.219Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"0526290159c2e58b922adef4","created_at":"2026-08-20T06:14:06.590Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-d05502bc9eab4b30","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b4b40ce5c30266454ede7c8e825a3a9d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-20T06:14:06.601Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-0526290159c2e58b922adef4: done: 0.107123 sec","job_status":"done","queue_duration_s":0.510598,"scheduling_latency_s":0.510668,"redis_calls":7,"redis_duration_s":0.015689,"redis_read_bytes":5,"redis_write_bytes":766,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002836,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":524,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.012853,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":242,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.031698,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.107123,"completed_at":"2026-08-20T06:14:07.219Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1395gitlab # [ 294.411452] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:14:07.240Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"7689dcd46be3c2e08b86435e","created_at":"2026-08-20T06:14:06.657Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-d05502bc9eab4b30","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"bcd088c8ed0c8adbeb23dfd01154a48b","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-20T06:14:06.669Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-7689dcd46be3c2e08b86435e: start","job_status":"start","queue_duration_s":0.570432,"scheduling_latency_s":0.570497}1396gitlab # [ 294.431774] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:14:07.302Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"7689dcd46be3c2e08b86435e","created_at":"2026-08-20T06:14:06.657Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-d05502bc9eab4b30","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"bcd088c8ed0c8adbeb23dfd01154a48b","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-20T06:14:06.669Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-7689dcd46be3c2e08b86435e: done: 0.062936 sec","job_status":"done","queue_duration_s":0.570432,"scheduling_latency_s":0.570497,"redis_calls":8,"redis_duration_s":0.0025859999999999998,"redis_read_bytes":133,"redis_write_bytes":875,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000373,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":49,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001571,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000642,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022923,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.062936,"completed_at":"2026-08-20T06:14:07.302Z","load_balancing_strategy":"primary","db_duration_s":0.003126,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1397gitlab # [ 294.484514] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:14:07.304Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"e30844b9cc413a19b56a9f5d","created_at":"2026-08-20T06:14:06.689Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-d05502bc9eab4b30","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2c31c0ed3d2391182c25f4f30ff163d8","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-08-20T06:14:06.713Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-e30844b9cc413a19b56a9f5d: start","job_status":"start","queue_duration_s":0.591579,"scheduling_latency_s":0.591605}1398gitlab # [ 294.499415] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:14:07.333Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"e30844b9cc413a19b56a9f5d","created_at":"2026-08-20T06:14:06.689Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-d05502bc9eab4b30","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2c31c0ed3d2391182c25f4f30ff163d8","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-08-20T06:14:06.713Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-e30844b9cc413a19b56a9f5d: done: 0.028404 sec","job_status":"done","queue_duration_s":0.591579,"scheduling_latency_s":0.591605,"redis_calls":12,"redis_duration_s":0.001768,"redis_read_bytes":11,"redis_write_bytes":1562,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000292,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000751,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":634,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000725,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":591,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017609,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00051646,"exclusive_lock_hold_duration_s":0.00579028,"duration_s":0.028404,"completed_at":"2026-08-20T06:14:07.333Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00264,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1399gitlab # [ 294.542261] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:14:07.334Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"9f57a5a78c1774b7b09c0d74","created_at":"2026-08-20T06:14:06.757Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-d05502bc9eab4b30","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"203a606f0597063c26bf20163bb548b7","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-20T06:14:06.783Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-9f57a5a78c1774b7b09c0d74: start","job_status":"start","queue_duration_s":0.550558,"scheduling_latency_s":0.550575}1400gitlab # [ 294.556063] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:14:07.352Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"9f57a5a78c1774b7b09c0d74","created_at":"2026-08-20T06:14:06.757Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-d05502bc9eab4b30","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"203a606f0597063c26bf20163bb548b7","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-20T06:14:06.783Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-9f57a5a78c1774b7b09c0d74: done: 0.018033 sec","job_status":"done","queue_duration_s":0.550558,"scheduling_latency_s":0.550575,"redis_calls":9,"redis_duration_s":0.0013289999999999999,"redis_read_bytes":7,"redis_write_bytes":1072,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000684,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000645,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":560,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012674,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00050506,"exclusive_lock_hold_duration_s":0.00309182,"duration_s":0.018033,"completed_at":"2026-08-20T06:14:07.352Z","load_balancing_strategy":"primary","db_duration_s":0.000576,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1401gitlab # [ 294.597894] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:14:07.353Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"2215ad4eb65b0f94c3642ae1","created_at":"2026-08-20T06:14:06.827Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-d05502bc9eab4b30","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7fadd782c6554e89d094e74b7fd5f335","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-08-20T06:14:06.847Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-2215ad4eb65b0f94c3642ae1: start","job_status":"start","queue_duration_s":0.506108,"scheduling_latency_s":0.506124}1402gitlab # [ 294.611554] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:14:07.374Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"2215ad4eb65b0f94c3642ae1","created_at":"2026-08-20T06:14:06.827Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-d05502bc9eab4b30","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7fadd782c6554e89d094e74b7fd5f335","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-08-20T06:14:06.847Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-2215ad4eb65b0f94c3642ae1: done: 0.021203 sec","job_status":"done","queue_duration_s":0.506108,"scheduling_latency_s":0.506124,"redis_calls":12,"redis_duration_s":0.001746,"redis_read_bytes":10,"redis_write_bytes":1174,"redis_cache_calls":2,"redis_cache_duration_s":0.000403,"redis_cache_read_bytes":1,"redis_cache_write_bytes":93,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000305,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000748,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":562,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00029,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":214,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013353,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00024086,"duration_s":0.021203,"completed_at":"2026-08-20T06:14:07.374Z","load_balancing_strategy":"primary","db_duration_s":0.000482,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1403gitlab # [ 294.654804] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:14:07.375Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"db9cc6850151e00e9ad7d857","created_at":"2026-08-20T06:14:06.853Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-d05502bc9eab4b30","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c6f4303a09f6da1d741e9bb09e56226a","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-20T06:14:06.862Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-db9cc6850151e00e9ad7d857: start","job_status":"start","queue_duration_s":0.513566,"scheduling_latency_s":0.513583}1404gitlab # [ 294.669986] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:14:07.410Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"db9cc6850151e00e9ad7d857","created_at":"2026-08-20T06:14:06.853Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-d05502bc9eab4b30","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c6f4303a09f6da1d741e9bb09e56226a","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-20T06:14:06.862Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-db9cc6850151e00e9ad7d857: done: 0.03478 sec","job_status":"done","queue_duration_s":0.513566,"scheduling_latency_s":0.513583,"redis_calls":9,"redis_duration_s":0.0013289999999999999,"redis_read_bytes":7,"redis_write_bytes":1169,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000676,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000653,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":615,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.01,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019933,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00053906,"exclusive_lock_hold_duration_s":0.0127926,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.03478,"completed_at":"2026-08-20T06:14:07.410Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.010277,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1405gitlab # [ 294.714212] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:14:07.411Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"2c8493cc24dd0c8c6d5f2737","created_at":"2026-08-20T06:14:06.882Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-d05502bc9eab4b30","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"be9f8055ff048a2005bbc714dc89475f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-20T06:14:06.890Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-2c8493cc24dd0c8c6d5f2737: start","job_status":"start","queue_duration_s":0.521662,"scheduling_latency_s":0.521679}1406gitlab # [ 294.782717] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:14:07.690Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"2c8493cc24dd0c8c6d5f2737","created_at":"2026-08-20T06:14:06.882Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-d05502bc9eab4b30","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"be9f8055ff048a2005bbc714dc89475f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-20T06:14:06.890Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-2c8493cc24dd0c8c6d5f2737: done: 0.278169 sec","job_status":"done","queue_duration_s":0.521662,"scheduling_latency_s":0.521679,"redis_calls":11,"redis_duration_s":0.001925,"redis_read_bytes":9,"redis_write_bytes":1262,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000329,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":275,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000747,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":476,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000849,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":511,"db_count":130,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":130,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.053,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":130,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":84,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.053,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.206794,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.0005597,"exclusive_lock_hold_duration_s":0.25891452,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"main","turbo_mode":false},"duration_s":0.278169,"completed_at":"2026-08-20T06:14:07.689Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.082392,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1407gitlab # [ 294.847162] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:14:07.691Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"93888e7107876345f52f5d5c","created_at":"2026-08-20T06:14:06.906Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-d05502bc9eab4b30","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fdbe5767d6f54e5ef5a2bac3e2665c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-20T06:14:06.911Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-93888e7107876345f52f5d5c: start","job_status":"start","queue_duration_s":0.780149,"scheduling_latency_s":0.780166}1408gitlab # [ 294.887773] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:14:07.792Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"93888e7107876345f52f5d5c","created_at":"2026-08-20T06:14:06.906Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-d05502bc9eab4b30","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fdbe5767d6f54e5ef5a2bac3e2665c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-20T06:14:06.911Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-93888e7107876345f52f5d5c: done: 0.101096 sec","job_status":"done","queue_duration_s":0.780149,"scheduling_latency_s":0.780166,"redis_calls":60,"redis_duration_s":0.013334,"redis_read_bytes":108,"redis_write_bytes":41059,"redis_queues_calls":2,"redis_queues_duration_s":0.000555,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37435,"redis_queues_metadata_calls":55,"redis_queues_metadata_duration_s":0.01217,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3324,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000609,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":300,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.088255,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.101096,"completed_at":"2026-08-20T06:14:07.792Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1409gitlab # [ 294.954932] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:14:07.794Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"3b6087ecef3644cc3e2798d8","created_at":"2026-08-20T06:14:06.915Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-d05502bc9eab4b30","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c07fedca947068ec0c4dd7032e081182","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-20T06:14:06.920Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-3b6087ecef3644cc3e2798d8: start","job_status":"start","queue_duration_s":0.873564,"scheduling_latency_s":0.873585}1410gitlab # [ 294.971092] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:14:07.802Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0}1411gitlab # [ 294.974511] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:14:07.807Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"3b6087ecef3644cc3e2798d8","created_at":"2026-08-20T06:14:06.915Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-d05502bc9eab4b30","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c07fedca947068ec0c4dd7032e081182","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-20T06:14:06.920Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-3b6087ecef3644cc3e2798d8: done: 0.013343 sec","job_status":"done","queue_duration_s":0.873564,"scheduling_latency_s":0.873585,"redis_calls":7,"redis_duration_s":0.000941,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000682,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000259,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008094,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013343,"completed_at":"2026-08-20T06:14:07.807Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1412gitlab # [ 295.017159] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:14:07.808Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"c4c7a9a2fde94aba07ad5d5e","created_at":"2026-08-20T06:14:06.929Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-d05502bc9eab4b30","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"49811fce7802341120a6fb10d7eebc5a","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-20T06:14:06.935Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-c4c7a9a2fde94aba07ad5d5e: start","job_status":"start","queue_duration_s":0.872931,"scheduling_latency_s":0.87295}1413gitlab # [ 295.031554] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:14:07.816Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0}1414gitlab # [ 295.035033] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:14:07.822Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"c4c7a9a2fde94aba07ad5d5e","created_at":"2026-08-20T06:14:06.929Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-d05502bc9eab4b30","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"49811fce7802341120a6fb10d7eebc5a","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-20T06:14:06.935Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-c4c7a9a2fde94aba07ad5d5e: done: 0.013758 sec","job_status":"done","queue_duration_s":0.872931,"scheduling_latency_s":0.87295,"redis_calls":7,"redis_duration_s":0.00097,"redis_read_bytes":5,"redis_write_bytes":826,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000706,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000264,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008713,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013758,"completed_at":"2026-08-20T06:14:07.822Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1415gitlab # [ 295.075692] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:14:07.823Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"30d63d9d363ab1e5dc866e3e","created_at":"2026-08-20T06:14:06.939Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-d05502bc9eab4b30","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8698a60be71cf06af1f6ace775e4b173","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-20T06:14:06.944Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-30d63d9d363ab1e5dc866e3e: start","job_status":"start","queue_duration_s":0.879482,"scheduling_latency_s":0.879501}1416gitlab # [ 295.090070] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:14:07.851Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"30d63d9d363ab1e5dc866e3e","created_at":"2026-08-20T06:14:06.939Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-d05502bc9eab4b30","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8698a60be71cf06af1f6ace775e4b173","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-20T06:14:06.944Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-30d63d9d363ab1e5dc866e3e: done: 0.027498 sec","job_status":"done","queue_duration_s":0.879482,"scheduling_latency_s":0.879501,"redis_calls":7,"redis_duration_s":0.001714,"redis_read_bytes":5,"redis_write_bytes":681,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001281,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":473,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000433,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":208,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016139,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.027498,"completed_at":"2026-08-20T06:14:07.851Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004217,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1417gitlab # [ 295.130492] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:14:07.854Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"ec4aefe138ba084bd3e426cf","created_at":"2026-08-20T06:14:06.975Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-d05502bc9eab4b30","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fe2fdf4a9370c789b936a3c978810923","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-20T06:14:06.979Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-ec4aefe138ba084bd3e426cf: start","job_status":"start","queue_duration_s":0.875286,"scheduling_latency_s":0.875329}1418gitlab # [ 295.143816] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:14:07.873Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0}1419gitlab # [ 295.147247] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:14:07.885Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"ec4aefe138ba084bd3e426cf","created_at":"2026-08-20T06:14:06.975Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-d05502bc9eab4b30","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fe2fdf4a9370c789b936a3c978810923","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-20T06:14:06.979Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-ec4aefe138ba084bd3e426cf: done: 0.031145 sec","job_status":"done","queue_duration_s":0.875286,"scheduling_latency_s":0.875329,"redis_calls":7,"redis_duration_s":0.002018,"redis_read_bytes":5,"redis_write_bytes":806,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00148,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":548,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000538,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":258,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020985,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.031145,"completed_at":"2026-08-20T06:14:07.885Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1420gitlab # [ 295.186986] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:14:07.887Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"08d2f3691503a285ceea03b0","created_at":"2026-08-20T06:14:07.008Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-d05502bc9eab4b30","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fb2efffe12e22cdfce395709cfba3035","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-08-20T06:14:07.028Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-08d2f3691503a285ceea03b0: start","job_status":"start","queue_duration_s":0.858596,"scheduling_latency_s":0.858628}1421gitlab # [ 295.201631] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:14:07.939Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"08d2f3691503a285ceea03b0","created_at":"2026-08-20T06:14:07.008Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-d05502bc9eab4b30","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fb2efffe12e22cdfce395709cfba3035","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-08-20T06:14:07.028Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-08d2f3691503a285ceea03b0: done: 0.051621 sec","job_status":"done","queue_duration_s":0.858596,"scheduling_latency_s":0.858628,"redis_calls":10,"redis_duration_s":0.003183,"redis_read_bytes":9,"redis_write_bytes":1225,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000515,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001979,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":634,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000689,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":250,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.034573,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00074736,"duration_s":0.051621,"completed_at":"2026-08-20T06:14:07.938Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005091,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1422gitlab # [ 295.246631] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:14:07.941Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"1c3cd48930776f6d60ed4fa1","created_at":"2026-08-20T06:14:07.042Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-d05502bc9eab4b30","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"370816e822209e3966767daa31a34eda","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-20T06:14:07.053Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-1c3cd48930776f6d60ed4fa1: start","job_status":"start","queue_duration_s":0.888557,"scheduling_latency_s":0.888588}1423gitlab # [ 295.289488] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:14:07.977Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"1c3cd48930776f6d60ed4fa1","created_at":"2026-08-20T06:14:07.042Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-d05502bc9eab4b30","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"370816e822209e3966767daa31a34eda","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-20T06:14:07.053Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-1c3cd48930776f6d60ed4fa1: done: 0.035947 sec","job_status":"done","queue_duration_s":0.888557,"scheduling_latency_s":0.888588,"redis_calls":10,"redis_duration_s":0.00344,"redis_read_bytes":8,"redis_write_bytes":1239,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002032,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":636,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001408,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":603,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023502,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00703838,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.035947,"completed_at":"2026-08-20T06:14:07.977Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003124,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1424gitlab # [ 295.355672] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:14:07.980Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"e886beed30778e6aaa9932e9","created_at":"2026-08-20T06:14:07.058Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-d05502bc9eab4b30","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9c45a40124f4414d74bb7762619deaeb","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-20T06:14:07.071Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-e886beed30778e6aaa9932e9: start","job_status":"start","queue_duration_s":0.908452,"scheduling_latency_s":0.908483}1425gitlab # [ 295.371572] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:14:08.047Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"e886beed30778e6aaa9932e9","created_at":"2026-08-20T06:14:07.058Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-d05502bc9eab4b30","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9c45a40124f4414d74bb7762619deaeb","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-20T06:14:07.071Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-e886beed30778e6aaa9932e9: done: 0.067264 sec","job_status":"done","queue_duration_s":0.908452,"scheduling_latency_s":0.908483,"redis_calls":9,"redis_duration_s":0.004024,"redis_read_bytes":7,"redis_write_bytes":1162,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002356,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":551,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001668,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":611,"db_count":6,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.012,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.045555,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00076014,"exclusive_lock_hold_duration_s":0.0369467,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.067264,"completed_at":"2026-08-20T06:14:08.047Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.013982,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1426gitlab # [ 295.416788] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:14:08.050Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"e8603881a2247b0ba804d326","created_at":"2026-08-20T06:14:07.084Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-d05502bc9eab4b30","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9e3d9e30015453ef76c00676fc4105c5","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-20T06:14:07.091Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-e8603881a2247b0ba804d326: start","job_status":"start","queue_duration_s":0.959021,"scheduling_latency_s":0.95906}1427gitlab # [ 295.430508] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:14:08.066Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0}1428gitlab # [ 295.434305] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:14:08.076Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"e8603881a2247b0ba804d326","created_at":"2026-08-20T06:14:07.084Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-d05502bc9eab4b30","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9e3d9e30015453ef76c00676fc4105c5","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-20T06:14:07.091Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-e8603881a2247b0ba804d326: done: 0.026283 sec","job_status":"done","queue_duration_s":0.959021,"scheduling_latency_s":0.95906,"redis_calls":7,"redis_duration_s":0.001866,"redis_read_bytes":5,"redis_write_bytes":801,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001352,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":545,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000514,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":256,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016635,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.026283,"completed_at":"2026-08-20T06:14:08.076Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1429gitlab # [ 295.474077] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:14:08.078Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::UpdateLockedUnknownArtifactsWorker","jid":"2f4febe5cd2d1a6dfceffe81","created_at":"2026-08-20T06:14:07.104Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-d05502bc9eab4b30","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1af40bb4043ec2d745586c52495e9e4b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:912858db94fb8c9da5e144f8394730b16dbb4d7f396606379d4f42078eef6e20","size_limiter":"validated","enqueued_at":"2026-08-20T06:14:07.153Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UpdateLockedUnknownArtifactsWorker JID-2f4febe5cd2d1a6dfceffe81: start","job_status":"start","queue_duration_s":0.924725,"scheduling_latency_s":0.924753}1430gitlab # [ 295.488665] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:14:08.312Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::UpdateLockedUnknownArtifactsWorker","jid":"2f4febe5cd2d1a6dfceffe81","created_at":"2026-08-20T06:14:07.104Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-d05502bc9eab4b30","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1af40bb4043ec2d745586c52495e9e4b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:912858db94fb8c9da5e144f8394730b16dbb4d7f396606379d4f42078eef6e20","size_limiter":"validated","enqueued_at":"2026-08-20T06:14:07.153Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UpdateLockedUnknownArtifactsWorker JID-2f4febe5cd2d1a6dfceffe81: done: 0.234145 sec","job_status":"done","queue_duration_s":0.924725,"scheduling_latency_s":0.924753,"redis_calls":12,"redis_duration_s":0.002255,"redis_read_bytes":11,"redis_write_bytes":1447,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00041,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":319,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000949,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":586,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000896,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":542,"db_count":101,"db_write_count":0,"db_cached_count":99,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":101,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":99,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.013,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":100,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":99,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.012,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.202151,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00057352,"exclusive_lock_hold_duration_s":0.20703217999999998,"extra.ci_update_locked_unknown_artifacts_worker.removed_count":0,"extra.ci_update_locked_unknown_artifacts_worker.locked_count":0,"duration_s":0.234145,"completed_at":"2026-08-20T06:14:08.312Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.024355,"urgency":"throttled","target_duration_s":300,"target_scheduling_latency_s":null}1431gitlab # [ 295.533202] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:14:08.313Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"b1c630d5d93923527814bd93","created_at":"2026-08-20T06:14:07.159Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-d05502bc9eab4b30","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"575bf0a083081c7b87f80278e6c9d807","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-20T06:14:07.168Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-b1c630d5d93923527814bd93: start","job_status":"start","queue_duration_s":1.145479,"scheduling_latency_s":1.145502}1432gitlab # [ 295.547923] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:14:08.328Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"b1c630d5d93923527814bd93","created_at":"2026-08-20T06:14:07.159Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-d05502bc9eab4b30","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"575bf0a083081c7b87f80278e6c9d807","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-20T06:14:07.168Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-b1c630d5d93923527814bd93: done: 0.014544 sec","job_status":"done","queue_duration_s":1.145479,"scheduling_latency_s":1.145502,"redis_calls":7,"redis_duration_s":0.000989,"redis_read_bytes":5,"redis_write_bytes":776,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000715,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000274,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":246,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008804,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.014544,"completed_at":"2026-08-20T06:14:08.328Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1433gitlab # [ 295.589922] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:14:08.329Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"8da2753819249601ea32bc5e","created_at":"2026-08-20T06:14:07.174Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-d05502bc9eab4b30","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1d1d152c0dceee0f0ab62e7c3f065b61","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-20T06:14:07.181Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-8da2753819249601ea32bc5e: start","job_status":"start","queue_duration_s":1.148126,"scheduling_latency_s":1.148145}1434gitlab # [ 295.605856] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:14:08.346Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"8da2753819249601ea32bc5e","created_at":"2026-08-20T06:14:07.174Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-d05502bc9eab4b30","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1d1d152c0dceee0f0ab62e7c3f065b61","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-20T06:14:07.181Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-8da2753819249601ea32bc5e: done: 0.017179 sec","job_status":"done","queue_duration_s":1.148126,"scheduling_latency_s":1.148145,"redis_calls":9,"redis_duration_s":0.001356,"redis_read_bytes":7,"redis_write_bytes":1087,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000709,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000647,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":566,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011243,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000509,"exclusive_lock_hold_duration_s":0.00249434,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.017179,"completed_at":"2026-08-20T06:14:08.346Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0007,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1435gitlab # [ 295.656944] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:14:08.348Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"c36bb380b6030d3156a3d720","created_at":"2026-08-20T06:14:07.190Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-d05502bc9eab4b30","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ac9afc5a97b3432d073d97ba47e2ce9e","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-20T06:14:07.203Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-c36bb380b6030d3156a3d720: start","job_status":"start","queue_duration_s":1.144394,"scheduling_latency_s":1.14441}1436gitlab # [ 295.671932] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:14:08.362Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"c36bb380b6030d3156a3d720","created_at":"2026-08-20T06:14:07.190Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-d05502bc9eab4b30","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ac9afc5a97b3432d073d97ba47e2ce9e","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-20T06:14:07.203Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-c36bb380b6030d3156a3d720: done: 0.014284 sec","job_status":"done","queue_duration_s":1.144394,"scheduling_latency_s":1.14441,"redis_calls":7,"redis_duration_s":0.001083,"redis_read_bytes":5,"redis_write_bytes":831,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000781,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":563,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000302,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":268,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009614,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.014284,"completed_at":"2026-08-20T06:14:08.362Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1437gitlab # [ 295.718698] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:14:08.363Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"63d924404cf8145a5cb9fb1a","created_at":"2026-08-20T06:14:07.222Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-d05502bc9eab4b30","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7caf85b55021b8c4d8d6b83e83792ab1","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-20T06:14:07.231Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-63d924404cf8145a5cb9fb1a: start","job_status":"start","queue_duration_s":1.13212,"scheduling_latency_s":1.132136}1438gitlab # [ 295.783470] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:14:08.690Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"63d924404cf8145a5cb9fb1a","created_at":"2026-08-20T06:14:07.222Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-d05502bc9eab4b30","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7caf85b55021b8c4d8d6b83e83792ab1","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-20T06:14:07.231Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-63d924404cf8145a5cb9fb1a: done: 0.327167 sec","job_status":"done","queue_duration_s":1.13212,"scheduling_latency_s":1.132136,"redis_calls":562,"redis_duration_s":0.06869600000000001,"redis_read_bytes":560,"redis_write_bytes":48760,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000809,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":470,"redis_shared_state_calls":557,"redis_shared_state_duration_s":0.067887,"redis_shared_state_read_bytes":556,"redis_shared_state_write_bytes":48290,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.293448,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.327167,"completed_at":"2026-08-20T06:14:08.690Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1439gitlab # [ 295.838557] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:14:08.692Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"e360ed4315d21d7832974821","created_at":"2026-08-20T06:14:07.238Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-d05502bc9eab4b30","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8a894e54fc649d93e3b0782d95b34b71","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-08-20T06:14:07.247Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-e360ed4315d21d7832974821: start","job_status":"start","queue_duration_s":1.444466,"scheduling_latency_s":1.444493}1440gitlab # [ 295.857936] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:14:08.743Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"e360ed4315d21d7832974821","created_at":"2026-08-20T06:14:07.238Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-d05502bc9eab4b30","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8a894e54fc649d93e3b0782d95b34b71","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-08-20T06:14:07.247Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-e360ed4315d21d7832974821: done: 0.050901 sec","job_status":"done","queue_duration_s":1.444466,"scheduling_latency_s":1.444493,"redis_calls":14,"redis_duration_s":0.002726,"redis_read_bytes":16,"redis_write_bytes":4030,"redis_queues_calls":2,"redis_queues_duration_s":0.000321,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3019,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.001873,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":727,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000532,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":284,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.039329,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.050901,"completed_at":"2026-08-20T06:14:08.743Z","load_balancing_strategy":"primary","db_duration_s":0.005542,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1441gitlab # [ 295.899912] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:14:08.744Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"89e7fc5e063a127a5abecc71","created_at":"2026-08-20T06:14:07.702Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-16a859331aeb45c7","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fdbe5767d6f54e5ef5a2bac3e2665c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:14:07.785Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-89e7fc5e063a127a5abecc71: start","job_status":"start","queue_duration_s":0.959539,"scheduling_latency_s":0.959562}1442gitlab # [ 295.912730] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:14:08.761Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"89e7fc5e063a127a5abecc71","created_at":"2026-08-20T06:14:07.702Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-16a859331aeb45c7","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fdbe5767d6f54e5ef5a2bac3e2665c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:14:07.785Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-89e7fc5e063a127a5abecc71: done: 0.016621 sec","job_status":"done","queue_duration_s":0.959539,"scheduling_latency_s":0.959562,"redis_calls":13,"redis_duration_s":0.001589,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00056,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001029,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011193,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016621,"completed_at":"2026-08-20T06:14:08.761Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1443gitlab # [ 295.952607] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:14:08.762Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b20df2ca777f3d109256b202","created_at":"2026-08-20T06:14:07.702Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-16a859331aeb45c7","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fdbe5767d6f54e5ef5a2bac3e2665c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:14:07.785Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b20df2ca777f3d109256b202: start","job_status":"start","queue_duration_s":0.977279,"scheduling_latency_s":0.977298}1444gitlab # [ 295.965007] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:14:08.777Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b20df2ca777f3d109256b202","created_at":"2026-08-20T06:14:07.702Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-16a859331aeb45c7","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fdbe5767d6f54e5ef5a2bac3e2665c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:14:07.785Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b20df2ca777f3d109256b202: done: 0.015516 sec","job_status":"done","queue_duration_s":0.977279,"scheduling_latency_s":0.977298,"redis_calls":13,"redis_duration_s":0.001547,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000554,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000993,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010375,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015516,"completed_at":"2026-08-20T06:14:08.777Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1445gitlab # [ 296.004669] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:14:08.779Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a266027c576bc4e7ed5dccc0","created_at":"2026-08-20T06:14:07.702Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-16a859331aeb45c7","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fdbe5767d6f54e5ef5a2bac3e2665c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:14:07.785Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a266027c576bc4e7ed5dccc0: start","job_status":"start","queue_duration_s":0.99426,"scheduling_latency_s":0.994277}1446gitlab # [ 296.016730] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:14:08.794Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a266027c576bc4e7ed5dccc0","created_at":"2026-08-20T06:14:07.702Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-16a859331aeb45c7","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fdbe5767d6f54e5ef5a2bac3e2665c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:14:07.785Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a266027c576bc4e7ed5dccc0: done: 0.0154 sec","job_status":"done","queue_duration_s":0.99426,"scheduling_latency_s":0.994277,"redis_calls":13,"redis_duration_s":0.0015379999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000545,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000993,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010671,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.0154,"completed_at":"2026-08-20T06:14:08.794Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1447gitlab # [ 296.057715] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:14:08.796Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"211cb3c797dc2ee08e69dde0","created_at":"2026-08-20T06:14:07.702Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-16a859331aeb45c7","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fdbe5767d6f54e5ef5a2bac3e2665c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:14:07.785Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-211cb3c797dc2ee08e69dde0: start","job_status":"start","queue_duration_s":1.010825,"scheduling_latency_s":1.010842}1448gitlab # [ 296.070259] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:14:08.811Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"211cb3c797dc2ee08e69dde0","created_at":"2026-08-20T06:14:07.702Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-16a859331aeb45c7","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fdbe5767d6f54e5ef5a2bac3e2665c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:14:07.785Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-211cb3c797dc2ee08e69dde0: done: 0.015131 sec","job_status":"done","queue_duration_s":1.010825,"scheduling_latency_s":1.010842,"redis_calls":13,"redis_duration_s":0.0018310000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000894,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000937,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010594,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015131,"completed_at":"2026-08-20T06:14:08.811Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1449gitlab # [ 296.110271] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:14:08.812Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7f4485343807791835b3e56d","created_at":"2026-08-20T06:14:07.702Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-16a859331aeb45c7","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fdbe5767d6f54e5ef5a2bac3e2665c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:14:07.785Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7f4485343807791835b3e56d: start","job_status":"start","queue_duration_s":1.027115,"scheduling_latency_s":1.027132}1450gitlab # [ 296.123014] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:14:08.827Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7f4485343807791835b3e56d","created_at":"2026-08-20T06:14:07.702Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-16a859331aeb45c7","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fdbe5767d6f54e5ef5a2bac3e2665c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:14:07.785Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7f4485343807791835b3e56d: done: 0.015287 sec","job_status":"done","queue_duration_s":1.027115,"scheduling_latency_s":1.027132,"redis_calls":13,"redis_duration_s":0.00149,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000545,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000945,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010301,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015287,"completed_at":"2026-08-20T06:14:08.827Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1451gitlab # [ 296.162995] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:14:08.829Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b2f5871c4ea1f4fc4a55ddab","created_at":"2026-08-20T06:14:07.702Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-16a859331aeb45c7","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fdbe5767d6f54e5ef5a2bac3e2665c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:14:07.785Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b2f5871c4ea1f4fc4a55ddab: start","job_status":"start","queue_duration_s":1.043955,"scheduling_latency_s":1.043972}1452gitlab # [ 296.175719] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:14:08.845Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b2f5871c4ea1f4fc4a55ddab","created_at":"2026-08-20T06:14:07.702Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-16a859331aeb45c7","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fdbe5767d6f54e5ef5a2bac3e2665c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:14:07.785Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b2f5871c4ea1f4fc4a55ddab: done: 0.016101 sec","job_status":"done","queue_duration_s":1.043955,"scheduling_latency_s":1.043972,"redis_calls":13,"redis_duration_s":0.002058,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000877,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001181,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011213,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016101,"completed_at":"2026-08-20T06:14:08.845Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1453gitlab # [ 296.215537] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:14:08.846Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a242908a2eda75486cce683f","created_at":"2026-08-20T06:14:07.702Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-16a859331aeb45c7","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fdbe5767d6f54e5ef5a2bac3e2665c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:14:07.785Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a242908a2eda75486cce683f: start","job_status":"start","queue_duration_s":1.061193,"scheduling_latency_s":1.06121}1454gitlab # [ 296.228553] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:14:08.861Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a242908a2eda75486cce683f","created_at":"2026-08-20T06:14:07.702Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-16a859331aeb45c7","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fdbe5767d6f54e5ef5a2bac3e2665c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:14:07.785Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a242908a2eda75486cce683f: done: 0.015211 sec","job_status":"done","queue_duration_s":1.061193,"scheduling_latency_s":1.06121,"redis_calls":13,"redis_duration_s":0.001594,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000539,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001055,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010385,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015211,"completed_at":"2026-08-20T06:14:08.861Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1455gitlab # [ 296.270946] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:14:08.863Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"89703b2004a937eb70ba18d7","created_at":"2026-08-20T06:14:07.702Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-16a859331aeb45c7","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fdbe5767d6f54e5ef5a2bac3e2665c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:14:07.785Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-89703b2004a937eb70ba18d7: start","job_status":"start","queue_duration_s":1.078161,"scheduling_latency_s":1.07818}1456gitlab # [ 296.283815] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:14:08.878Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"89703b2004a937eb70ba18d7","created_at":"2026-08-20T06:14:07.702Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-16a859331aeb45c7","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fdbe5767d6f54e5ef5a2bac3e2665c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:14:07.785Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-89703b2004a937eb70ba18d7: done: 0.015017 sec","job_status":"done","queue_duration_s":1.078161,"scheduling_latency_s":1.07818,"redis_calls":13,"redis_duration_s":0.001519,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000554,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000965,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01044,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015017,"completed_at":"2026-08-20T06:14:08.878Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1457gitlab # [ 296.323960] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:14:08.879Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"49944a3b8ff275fcbac624b6","created_at":"2026-08-20T06:14:07.702Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-16a859331aeb45c7","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fdbe5767d6f54e5ef5a2bac3e2665c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:14:07.785Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-49944a3b8ff275fcbac624b6: start","job_status":"start","queue_duration_s":1.094257,"scheduling_latency_s":1.094273}1458gitlab # [ 296.336702] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:14:08.894Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"49944a3b8ff275fcbac624b6","created_at":"2026-08-20T06:14:07.702Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-16a859331aeb45c7","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fdbe5767d6f54e5ef5a2bac3e2665c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:14:07.785Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-49944a3b8ff275fcbac624b6: done: 0.015121 sec","job_status":"done","queue_duration_s":1.094257,"scheduling_latency_s":1.094273,"redis_calls":13,"redis_duration_s":0.001578,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000558,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00102,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010569,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015121,"completed_at":"2026-08-20T06:14:08.894Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1459gitlab # [ 296.376622] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:14:08.895Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2cec4774b740c6e14945118c","created_at":"2026-08-20T06:14:07.702Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-16a859331aeb45c7","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fdbe5767d6f54e5ef5a2bac3e2665c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:14:07.785Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2cec4774b740c6e14945118c: start","job_status":"start","queue_duration_s":1.110504,"scheduling_latency_s":1.110521}1460gitlab # [ 296.389025] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:14:08.910Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2cec4774b740c6e14945118c","created_at":"2026-08-20T06:14:07.702Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-16a859331aeb45c7","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fdbe5767d6f54e5ef5a2bac3e2665c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:14:07.785Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2cec4774b740c6e14945118c: done: 0.014944 sec","job_status":"done","queue_duration_s":1.110504,"scheduling_latency_s":1.110521,"redis_calls":13,"redis_duration_s":0.0014919999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000526,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000966,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010107,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014944,"completed_at":"2026-08-20T06:14:08.910Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1461gitlab # [ 296.436058] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:14:08.912Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a1c977aa8fc2649d6b040d54","created_at":"2026-08-20T06:14:07.702Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-16a859331aeb45c7","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fdbe5767d6f54e5ef5a2bac3e2665c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:14:07.785Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a1c977aa8fc2649d6b040d54: start","job_status":"start","queue_duration_s":1.126987,"scheduling_latency_s":1.127003}1462gitlab # [ 296.452092] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:14:08.934Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a1c977aa8fc2649d6b040d54","created_at":"2026-08-20T06:14:07.702Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-16a859331aeb45c7","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fdbe5767d6f54e5ef5a2bac3e2665c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:14:07.785Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a1c977aa8fc2649d6b040d54: done: 0.022551 sec","job_status":"done","queue_duration_s":1.126987,"scheduling_latency_s":1.127003,"redis_calls":13,"redis_duration_s":0.00155,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000583,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000967,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017987,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.022551,"completed_at":"2026-08-20T06:14:08.934Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1463gitlab # [ 296.501941] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:14:08.936Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ed99bd2ce8034ad0669123f3","created_at":"2026-08-20T06:14:07.702Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-16a859331aeb45c7","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fdbe5767d6f54e5ef5a2bac3e2665c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:14:07.785Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ed99bd2ce8034ad0669123f3: start","job_status":"start","queue_duration_s":1.150777,"scheduling_latency_s":1.150794}1464gitlab # [ 296.515124] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:14:08.951Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ed99bd2ce8034ad0669123f3","created_at":"2026-08-20T06:14:07.702Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-16a859331aeb45c7","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fdbe5767d6f54e5ef5a2bac3e2665c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:14:07.785Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ed99bd2ce8034ad0669123f3: done: 0.015079 sec","job_status":"done","queue_duration_s":1.150777,"scheduling_latency_s":1.150794,"redis_calls":13,"redis_duration_s":0.001767,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000797,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00097,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010298,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015079,"completed_at":"2026-08-20T06:14:08.950Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1465gitlab # [ 296.554955] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:14:08.952Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"508502e332eabb4bd7a17728","created_at":"2026-08-20T06:14:07.702Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-16a859331aeb45c7","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fdbe5767d6f54e5ef5a2bac3e2665c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:14:07.785Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-508502e332eabb4bd7a17728: start","job_status":"start","queue_duration_s":1.166974,"scheduling_latency_s":1.166991}1466gitlab # [ 296.567470] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:14:08.966Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"508502e332eabb4bd7a17728","created_at":"2026-08-20T06:14:07.702Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-16a859331aeb45c7","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fdbe5767d6f54e5ef5a2bac3e2665c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:14:07.785Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-508502e332eabb4bd7a17728: done: 0.014515 sec","job_status":"done","queue_duration_s":1.166974,"scheduling_latency_s":1.166991,"redis_calls":13,"redis_duration_s":0.001444,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000522,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000922,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010062,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014515,"completed_at":"2026-08-20T06:14:08.966Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1467gitlab # [ 296.607370] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:14:08.967Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bb95c7cd9a8395551e9e45df","created_at":"2026-08-20T06:14:07.702Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-16a859331aeb45c7","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fdbe5767d6f54e5ef5a2bac3e2665c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:14:07.785Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bb95c7cd9a8395551e9e45df: start","job_status":"start","queue_duration_s":1.182619,"scheduling_latency_s":1.182636}1468gitlab # [ 296.625864] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:14:08.982Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bb95c7cd9a8395551e9e45df","created_at":"2026-08-20T06:14:07.702Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-16a859331aeb45c7","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fdbe5767d6f54e5ef5a2bac3e2665c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:14:07.785Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bb95c7cd9a8395551e9e45df: done: 0.01448 sec","job_status":"done","queue_duration_s":1.182619,"scheduling_latency_s":1.182636,"redis_calls":13,"redis_duration_s":0.001506,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00056,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000946,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009997,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01448,"completed_at":"2026-08-20T06:14:08.982Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1469gitlab # [ 296.678040] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:14:08.983Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7f6ea1406afd9e43ce5bfd85","created_at":"2026-08-20T06:14:07.702Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-16a859331aeb45c7","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fdbe5767d6f54e5ef5a2bac3e2665c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:14:07.785Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7f6ea1406afd9e43ce5bfd85: start","job_status":"start","queue_duration_s":1.198174,"scheduling_latency_s":1.198191}1470gitlab # [ 296.695984] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:14:08.998Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7f6ea1406afd9e43ce5bfd85","created_at":"2026-08-20T06:14:07.702Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-16a859331aeb45c7","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fdbe5767d6f54e5ef5a2bac3e2665c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:14:07.785Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7f6ea1406afd9e43ce5bfd85: done: 0.01475 sec","job_status":"done","queue_duration_s":1.198174,"scheduling_latency_s":1.198191,"redis_calls":13,"redis_duration_s":0.001571,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000539,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001032,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010082,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01475,"completed_at":"2026-08-20T06:14:08.998Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1471gitlab # [ 296.740402] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:14:08.999Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d47a7cdab35a34a4fbdfec90","created_at":"2026-08-20T06:14:07.702Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-16a859331aeb45c7","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fdbe5767d6f54e5ef5a2bac3e2665c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:14:07.785Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d47a7cdab35a34a4fbdfec90: start","job_status":"start","queue_duration_s":1.213995,"scheduling_latency_s":1.214013}1472gitlab # [ 296.752664] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:14:09.013Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d47a7cdab35a34a4fbdfec90","created_at":"2026-08-20T06:14:07.702Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-16a859331aeb45c7","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fdbe5767d6f54e5ef5a2bac3e2665c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:14:07.785Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d47a7cdab35a34a4fbdfec90: done: 0.014454 sec","job_status":"done","queue_duration_s":1.213995,"scheduling_latency_s":1.214013,"redis_calls":13,"redis_duration_s":0.001494,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000537,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000957,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009997,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014454,"completed_at":"2026-08-20T06:14:09.013Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1473gitlab # [ 296.791953] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:14:09.014Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"debace6603e0080861e7d836","created_at":"2026-08-20T06:14:07.702Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-16a859331aeb45c7","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fdbe5767d6f54e5ef5a2bac3e2665c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:14:07.785Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-debace6603e0080861e7d836: start","job_status":"start","queue_duration_s":1.229557,"scheduling_latency_s":1.229572}1474gitlab # [ 296.804610] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:14:09.029Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"debace6603e0080861e7d836","created_at":"2026-08-20T06:14:07.702Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-16a859331aeb45c7","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fdbe5767d6f54e5ef5a2bac3e2665c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:14:07.785Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-debace6603e0080861e7d836: done: 0.014779 sec","job_status":"done","queue_duration_s":1.229557,"scheduling_latency_s":1.229572,"redis_calls":13,"redis_duration_s":0.001507,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000562,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000945,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010201,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014779,"completed_at":"2026-08-20T06:14:09.029Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1475gitlab # [ 296.843852] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:14:09.030Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c47e55139b5ba52b9867e9f9","created_at":"2026-08-20T06:14:07.702Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-16a859331aeb45c7","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fdbe5767d6f54e5ef5a2bac3e2665c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:14:07.785Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c47e55139b5ba52b9867e9f9: start","job_status":"start","queue_duration_s":1.245466,"scheduling_latency_s":1.245484}1476gitlab # [ 296.857671] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:14:09.045Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c47e55139b5ba52b9867e9f9","created_at":"2026-08-20T06:14:07.702Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-16a859331aeb45c7","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fdbe5767d6f54e5ef5a2bac3e2665c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:14:07.785Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c47e55139b5ba52b9867e9f9: done: 0.014867 sec","job_status":"done","queue_duration_s":1.245466,"scheduling_latency_s":1.245484,"redis_calls":13,"redis_duration_s":0.0016749999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000543,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001132,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010101,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014867,"completed_at":"2026-08-20T06:14:09.045Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1477gitlab # [ 296.897516] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:14:09.046Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"83774b2d4fe944b6fac25585","created_at":"2026-08-20T06:14:07.702Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-16a859331aeb45c7","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fdbe5767d6f54e5ef5a2bac3e2665c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:14:07.785Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-83774b2d4fe944b6fac25585: start","job_status":"start","queue_duration_s":1.261415,"scheduling_latency_s":1.261431}1478gitlab # [ 296.909984] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:14:09.061Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"83774b2d4fe944b6fac25585","created_at":"2026-08-20T06:14:07.702Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-16a859331aeb45c7","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fdbe5767d6f54e5ef5a2bac3e2665c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:14:07.785Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-83774b2d4fe944b6fac25585: done: 0.014623 sec","job_status":"done","queue_duration_s":1.261415,"scheduling_latency_s":1.261431,"redis_calls":13,"redis_duration_s":0.0014529999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00053,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000923,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010076,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014623,"completed_at":"2026-08-20T06:14:09.061Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1479gitlab # [ 296.949548] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:14:09.062Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f2a5d4c4b27af2808a754e86","created_at":"2026-08-20T06:14:07.702Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-16a859331aeb45c7","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fdbe5767d6f54e5ef5a2bac3e2665c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:14:07.785Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f2a5d4c4b27af2808a754e86: start","job_status":"start","queue_duration_s":1.277131,"scheduling_latency_s":1.277147}1480gitlab # [ 296.962225] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:14:09.076Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f2a5d4c4b27af2808a754e86","created_at":"2026-08-20T06:14:07.702Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-16a859331aeb45c7","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fdbe5767d6f54e5ef5a2bac3e2665c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:14:07.785Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f2a5d4c4b27af2808a754e86: done: 0.014522 sec","job_status":"done","queue_duration_s":1.277131,"scheduling_latency_s":1.277147,"redis_calls":13,"redis_duration_s":0.001447,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000533,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000914,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010015,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014522,"completed_at":"2026-08-20T06:14:09.076Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1481gitlab # [ 297.001558] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:14:09.077Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"264ec69ed2352813b6671f52","created_at":"2026-08-20T06:14:07.702Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-16a859331aeb45c7","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fdbe5767d6f54e5ef5a2bac3e2665c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:14:07.785Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-264ec69ed2352813b6671f52: start","job_status":"start","queue_duration_s":1.292733,"scheduling_latency_s":1.29275}1482gitlab # [ 297.014002] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:14:09.093Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"264ec69ed2352813b6671f52","created_at":"2026-08-20T06:14:07.702Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-16a859331aeb45c7","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fdbe5767d6f54e5ef5a2bac3e2665c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:14:07.785Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-264ec69ed2352813b6671f52: done: 0.01531 sec","job_status":"done","queue_duration_s":1.292733,"scheduling_latency_s":1.29275,"redis_calls":13,"redis_duration_s":0.0015040000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000554,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00095,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010254,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01531,"completed_at":"2026-08-20T06:14:09.093Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1483gitlab # [ 297.052932] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:14:09.094Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d564583970370264da548cdc","created_at":"2026-08-20T06:14:07.702Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-16a859331aeb45c7","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fdbe5767d6f54e5ef5a2bac3e2665c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:14:07.785Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d564583970370264da548cdc: start","job_status":"start","queue_duration_s":1.309169,"scheduling_latency_s":1.309187}1484gitlab # [ 297.067570] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:14:09.111Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d564583970370264da548cdc","created_at":"2026-08-20T06:14:07.702Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-16a859331aeb45c7","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fdbe5767d6f54e5ef5a2bac3e2665c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:14:07.785Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d564583970370264da548cdc: done: 0.017034 sec","job_status":"done","queue_duration_s":1.309169,"scheduling_latency_s":1.309187,"redis_calls":13,"redis_duration_s":0.002173,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00097,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001203,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011454,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017034,"completed_at":"2026-08-20T06:14:09.111Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1485gitlab # [ 297.111649] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:14:09.112Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"62311bbcc0f48928633287e0","created_at":"2026-08-20T06:14:07.702Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-16a859331aeb45c7","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fdbe5767d6f54e5ef5a2bac3e2665c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:14:07.785Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-62311bbcc0f48928633287e0: start","job_status":"start","queue_duration_s":1.327704,"scheduling_latency_s":1.327723}1486gitlab # [ 297.124667] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:14:09.128Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"62311bbcc0f48928633287e0","created_at":"2026-08-20T06:14:07.702Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-16a859331aeb45c7","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fdbe5767d6f54e5ef5a2bac3e2665c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:14:07.785Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-62311bbcc0f48928633287e0: done: 0.015204 sec","job_status":"done","queue_duration_s":1.327704,"scheduling_latency_s":1.327723,"redis_calls":13,"redis_duration_s":0.0015999999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000558,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001042,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010042,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015204,"completed_at":"2026-08-20T06:14:09.128Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1487gitlab # [ 297.164756] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:14:09.129Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b0b304c67059c11b9f87c290","created_at":"2026-08-20T06:14:07.702Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-16a859331aeb45c7","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fdbe5767d6f54e5ef5a2bac3e2665c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:14:07.785Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b0b304c67059c11b9f87c290: start","job_status":"start","queue_duration_s":1.34404,"scheduling_latency_s":1.344057}1488gitlab # [ 297.177573] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:14:09.144Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b0b304c67059c11b9f87c290","created_at":"2026-08-20T06:14:07.702Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-16a859331aeb45c7","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fdbe5767d6f54e5ef5a2bac3e2665c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:14:07.785Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b0b304c67059c11b9f87c290: done: 0.015006 sec","job_status":"done","queue_duration_s":1.34404,"scheduling_latency_s":1.344057,"redis_calls":13,"redis_duration_s":0.001728,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00056,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001168,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010169,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015006,"completed_at":"2026-08-20T06:14:09.144Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1489gitlab # [ 297.223624] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:14:09.145Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9faeb10b8c9269efcc747096","created_at":"2026-08-20T06:14:07.702Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-16a859331aeb45c7","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fdbe5767d6f54e5ef5a2bac3e2665c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:14:07.785Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9faeb10b8c9269efcc747096: start","job_status":"start","queue_duration_s":1.360401,"scheduling_latency_s":1.360419}1490gitlab # [ 297.236595] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:14:09.160Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9faeb10b8c9269efcc747096","created_at":"2026-08-20T06:14:07.702Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-16a859331aeb45c7","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fdbe5767d6f54e5ef5a2bac3e2665c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:14:07.785Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9faeb10b8c9269efcc747096: done: 0.014922 sec","job_status":"done","queue_duration_s":1.360401,"scheduling_latency_s":1.360419,"redis_calls":13,"redis_duration_s":0.0016920000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000595,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001097,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010018,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014922,"completed_at":"2026-08-20T06:14:09.160Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1491gitlab # [ 297.278574] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:14:09.161Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e4357a0cfabad701a11ebc32","created_at":"2026-08-20T06:14:07.702Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-16a859331aeb45c7","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fdbe5767d6f54e5ef5a2bac3e2665c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:14:07.785Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e4357a0cfabad701a11ebc32: start","job_status":"start","queue_duration_s":1.376485,"scheduling_latency_s":1.376502}1492gitlab # [ 297.291121] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:14:09.176Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e4357a0cfabad701a11ebc32","created_at":"2026-08-20T06:14:07.702Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-16a859331aeb45c7","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fdbe5767d6f54e5ef5a2bac3e2665c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:14:07.785Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e4357a0cfabad701a11ebc32: done: 0.014975 sec","job_status":"done","queue_duration_s":1.376485,"scheduling_latency_s":1.376502,"redis_calls":13,"redis_duration_s":0.0018470000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000661,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001186,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010044,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014975,"completed_at":"2026-08-20T06:14:09.176Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1493gitlab # [ 297.331526] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:14:09.178Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8dbc6ee87e181a1a5475f69b","created_at":"2026-08-20T06:14:07.702Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-16a859331aeb45c7","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fdbe5767d6f54e5ef5a2bac3e2665c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:14:07.785Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8dbc6ee87e181a1a5475f69b: start","job_status":"start","queue_duration_s":1.39312,"scheduling_latency_s":1.393138}1494gitlab # [ 297.344392] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:14:09.194Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8dbc6ee87e181a1a5475f69b","created_at":"2026-08-20T06:14:07.702Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-16a859331aeb45c7","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fdbe5767d6f54e5ef5a2bac3e2665c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:14:07.785Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8dbc6ee87e181a1a5475f69b: done: 0.015734 sec","job_status":"done","queue_duration_s":1.39312,"scheduling_latency_s":1.393138,"redis_calls":13,"redis_duration_s":0.002519,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000858,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001661,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01011,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015734,"completed_at":"2026-08-20T06:14:09.193Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1495gitlab # [ 297.383424] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:14:09.195Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"09c03a7338c1df510952d10d","created_at":"2026-08-20T06:14:07.702Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-16a859331aeb45c7","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fdbe5767d6f54e5ef5a2bac3e2665c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:14:07.785Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-09c03a7338c1df510952d10d: start","job_status":"start","queue_duration_s":1.410205,"scheduling_latency_s":1.410221}1496gitlab # [ 297.395831] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:14:09.211Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"09c03a7338c1df510952d10d","created_at":"2026-08-20T06:14:07.702Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-16a859331aeb45c7","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fdbe5767d6f54e5ef5a2bac3e2665c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:14:07.785Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-09c03a7338c1df510952d10d: done: 0.016377 sec","job_status":"done","queue_duration_s":1.410205,"scheduling_latency_s":1.410221,"redis_calls":13,"redis_duration_s":0.0032949999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000986,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002309,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010118,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016377,"completed_at":"2026-08-20T06:14:09.211Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1497gitlab # [ 297.435391] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:14:09.213Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c02476d483fb75745fc4e99a","created_at":"2026-08-20T06:14:07.702Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-16a859331aeb45c7","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fdbe5767d6f54e5ef5a2bac3e2665c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:14:07.785Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c02476d483fb75745fc4e99a: start","job_status":"start","queue_duration_s":1.428005,"scheduling_latency_s":1.428022}1498gitlab # [ 297.448239] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:14:09.229Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c02476d483fb75745fc4e99a","created_at":"2026-08-20T06:14:07.702Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-16a859331aeb45c7","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fdbe5767d6f54e5ef5a2bac3e2665c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:14:07.785Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c02476d483fb75745fc4e99a: done: 0.016044 sec","job_status":"done","queue_duration_s":1.428005,"scheduling_latency_s":1.428022,"redis_calls":13,"redis_duration_s":0.0028539999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001007,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001847,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01016,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016044,"completed_at":"2026-08-20T06:14:09.229Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1499gitlab # [ 297.494564] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:14:09.230Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0016c5b297781f8aee32a1a1","created_at":"2026-08-20T06:14:07.702Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-16a859331aeb45c7","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fdbe5767d6f54e5ef5a2bac3e2665c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:14:07.785Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0016c5b297781f8aee32a1a1: start","job_status":"start","queue_duration_s":1.445435,"scheduling_latency_s":1.445451}1500gitlab # [ 297.509534] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:14:09.246Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0016c5b297781f8aee32a1a1","created_at":"2026-08-20T06:14:07.702Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-16a859331aeb45c7","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fdbe5767d6f54e5ef5a2bac3e2665c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:14:07.785Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0016c5b297781f8aee32a1a1: done: 0.015708 sec","job_status":"done","queue_duration_s":1.445435,"scheduling_latency_s":1.445451,"redis_calls":13,"redis_duration_s":0.003256,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001423,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001833,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009482,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015708,"completed_at":"2026-08-20T06:14:09.246Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1501gitlab # [ 297.556621] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:14:09.247Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2746ee37521b367f01c59804","created_at":"2026-08-20T06:14:07.702Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-16a859331aeb45c7","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fdbe5767d6f54e5ef5a2bac3e2665c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:14:07.785Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2746ee37521b367f01c59804: start","job_status":"start","queue_duration_s":1.462582,"scheduling_latency_s":1.462598}1502gitlab # [ 297.572539] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:14:09.263Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2746ee37521b367f01c59804","created_at":"2026-08-20T06:14:07.702Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-16a859331aeb45c7","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fdbe5767d6f54e5ef5a2bac3e2665c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:14:07.785Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2746ee37521b367f01c59804: done: 0.015894 sec","job_status":"done","queue_duration_s":1.462582,"scheduling_latency_s":1.462598,"redis_calls":13,"redis_duration_s":0.00318,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001192,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001988,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009718,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015894,"completed_at":"2026-08-20T06:14:09.263Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1503gitlab # [ 297.620836] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:14:09.265Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"10f3dac52cf5e577c145a885","created_at":"2026-08-20T06:14:07.702Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-16a859331aeb45c7","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fdbe5767d6f54e5ef5a2bac3e2665c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:14:07.785Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-10f3dac52cf5e577c145a885: start","job_status":"start","queue_duration_s":1.479896,"scheduling_latency_s":1.479912}1504gitlab # [ 297.636507] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:14:09.280Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"10f3dac52cf5e577c145a885","created_at":"2026-08-20T06:14:07.702Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-16a859331aeb45c7","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fdbe5767d6f54e5ef5a2bac3e2665c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:14:07.785Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-10f3dac52cf5e577c145a885: done: 0.01559 sec","job_status":"done","queue_duration_s":1.479896,"scheduling_latency_s":1.479912,"redis_calls":13,"redis_duration_s":0.002996,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000944,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002052,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009491,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01559,"completed_at":"2026-08-20T06:14:09.280Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1505gitlab # [ 297.685573] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:14:09.281Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c39a44fbe7bdf4012fafc050","created_at":"2026-08-20T06:14:07.702Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-16a859331aeb45c7","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fdbe5767d6f54e5ef5a2bac3e2665c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:14:07.785Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c39a44fbe7bdf4012fafc050: start","job_status":"start","queue_duration_s":1.496576,"scheduling_latency_s":1.496591}1506gitlab # [ 297.700830] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:14:09.296Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c39a44fbe7bdf4012fafc050","created_at":"2026-08-20T06:14:07.702Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-16a859331aeb45c7","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fdbe5767d6f54e5ef5a2bac3e2665c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:14:07.785Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c39a44fbe7bdf4012fafc050: done: 0.014449 sec","job_status":"done","queue_duration_s":1.496576,"scheduling_latency_s":1.496591,"redis_calls":13,"redis_duration_s":0.001973,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000743,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00123,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009546,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014449,"completed_at":"2026-08-20T06:14:09.296Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1507gitlab # [ 297.740199] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:14:09.297Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f811f81d58ca2e7ad372c031","created_at":"2026-08-20T06:14:07.702Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-16a859331aeb45c7","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fdbe5767d6f54e5ef5a2bac3e2665c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:14:07.785Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f811f81d58ca2e7ad372c031: start","job_status":"start","queue_duration_s":1.512384,"scheduling_latency_s":1.5124}1508gitlab # [ 297.752622] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:14:09.313Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f811f81d58ca2e7ad372c031","created_at":"2026-08-20T06:14:07.702Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-16a859331aeb45c7","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fdbe5767d6f54e5ef5a2bac3e2665c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:14:07.785Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f811f81d58ca2e7ad372c031: done: 0.015955 sec","job_status":"done","queue_duration_s":1.512384,"scheduling_latency_s":1.5124,"redis_calls":13,"redis_duration_s":0.0030299999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001024,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002006,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009845,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015955,"completed_at":"2026-08-20T06:14:09.313Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1509gitlab # [ 297.792009] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:14:09.315Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"44fda97228d49cc719ed480e","created_at":"2026-08-20T06:14:07.702Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-16a859331aeb45c7","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fdbe5767d6f54e5ef5a2bac3e2665c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:14:07.785Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-44fda97228d49cc719ed480e: start","job_status":"start","queue_duration_s":1.529833,"scheduling_latency_s":1.52985}1510gitlab # [ 297.804441] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:14:09.330Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"44fda97228d49cc719ed480e","created_at":"2026-08-20T06:14:07.702Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-16a859331aeb45c7","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fdbe5767d6f54e5ef5a2bac3e2665c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:14:07.785Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-44fda97228d49cc719ed480e: done: 0.015439 sec","job_status":"done","queue_duration_s":1.529833,"scheduling_latency_s":1.52985,"redis_calls":13,"redis_duration_s":0.002836,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000954,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001882,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009637,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015439,"completed_at":"2026-08-20T06:14:09.330Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1511gitlab # [ 297.849308] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:14:09.331Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"81b9d7fbbbdbb0a42064eb1d","created_at":"2026-08-20T06:14:07.702Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-16a859331aeb45c7","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fdbe5767d6f54e5ef5a2bac3e2665c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:14:07.785Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-81b9d7fbbbdbb0a42064eb1d: start","job_status":"start","queue_duration_s":1.546672,"scheduling_latency_s":1.546688}1512gitlab # [ 297.861799] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:14:09.347Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"81b9d7fbbbdbb0a42064eb1d","created_at":"2026-08-20T06:14:07.702Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-16a859331aeb45c7","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fdbe5767d6f54e5ef5a2bac3e2665c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:14:07.785Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-81b9d7fbbbdbb0a42064eb1d: done: 0.015233 sec","job_status":"done","queue_duration_s":1.546672,"scheduling_latency_s":1.546688,"redis_calls":13,"redis_duration_s":0.002631,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000971,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00166,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009657,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015233,"completed_at":"2026-08-20T06:14:09.347Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1513gitlab # [ 297.902409] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:14:09.348Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"85ad1e2c29b099a7da3338c6","created_at":"2026-08-20T06:14:07.702Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-16a859331aeb45c7","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fdbe5767d6f54e5ef5a2bac3e2665c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:14:07.785Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-85ad1e2c29b099a7da3338c6: start","job_status":"start","queue_duration_s":1.563377,"scheduling_latency_s":1.563393}1514gitlab # [ 297.914744] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:14:09.364Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"85ad1e2c29b099a7da3338c6","created_at":"2026-08-20T06:14:07.702Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-16a859331aeb45c7","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fdbe5767d6f54e5ef5a2bac3e2665c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:14:07.785Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-85ad1e2c29b099a7da3338c6: done: 0.015938 sec","job_status":"done","queue_duration_s":1.563377,"scheduling_latency_s":1.563393,"redis_calls":13,"redis_duration_s":0.003169,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001172,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001997,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009713,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015938,"completed_at":"2026-08-20T06:14:09.364Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1515gitlab # [ 297.954644] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:14:09.365Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9ab0d63f973f83427777e1ef","created_at":"2026-08-20T06:14:07.702Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-16a859331aeb45c7","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fdbe5767d6f54e5ef5a2bac3e2665c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:14:07.785Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9ab0d63f973f83427777e1ef: start","job_status":"start","queue_duration_s":1.580506,"scheduling_latency_s":1.580521}1516gitlab # [ 297.966943] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:14:09.381Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9ab0d63f973f83427777e1ef","created_at":"2026-08-20T06:14:07.702Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-16a859331aeb45c7","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fdbe5767d6f54e5ef5a2bac3e2665c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:14:07.785Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9ab0d63f973f83427777e1ef: done: 0.015734 sec","job_status":"done","queue_duration_s":1.580506,"scheduling_latency_s":1.580521,"redis_calls":13,"redis_duration_s":0.0028120000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000987,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001825,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0098,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015734,"completed_at":"2026-08-20T06:14:09.381Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1517gitlab # [ 298.006425] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:14:09.383Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0e228fe6643f2630dc795318","created_at":"2026-08-20T06:14:07.702Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-16a859331aeb45c7","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fdbe5767d6f54e5ef5a2bac3e2665c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:14:07.785Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0e228fe6643f2630dc795318: start","job_status":"start","queue_duration_s":1.597796,"scheduling_latency_s":1.597819}1518gitlab # [ 298.019096] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:14:09.407Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0e228fe6643f2630dc795318","created_at":"2026-08-20T06:14:07.702Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-16a859331aeb45c7","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fdbe5767d6f54e5ef5a2bac3e2665c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:14:07.785Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0e228fe6643f2630dc795318: done: 0.02416 sec","job_status":"done","queue_duration_s":1.597796,"scheduling_latency_s":1.597819,"redis_calls":13,"redis_duration_s":0.008526,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.004629,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003897,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012692,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.02416,"completed_at":"2026-08-20T06:14:09.407Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1519gitlab # [ 298.059193] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:14:09.408Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5607fcc0d91f7db165442380","created_at":"2026-08-20T06:14:07.702Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-16a859331aeb45c7","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fdbe5767d6f54e5ef5a2bac3e2665c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:14:07.785Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5607fcc0d91f7db165442380: start","job_status":"start","queue_duration_s":1.623746,"scheduling_latency_s":1.623768}1520gitlab # [ 298.071862] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:14:09.429Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5607fcc0d91f7db165442380","created_at":"2026-08-20T06:14:07.702Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-16a859331aeb45c7","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fdbe5767d6f54e5ef5a2bac3e2665c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:14:07.785Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5607fcc0d91f7db165442380: done: 0.020134 sec","job_status":"done","queue_duration_s":1.623746,"scheduling_latency_s":1.623768,"redis_calls":13,"redis_duration_s":0.0037610000000000005,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000956,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002805,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012221,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.020134,"completed_at":"2026-08-20T06:14:09.428Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1521gitlab # [ 298.118618] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:14:09.430Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5f99e4fa5f829dfacabe9950","created_at":"2026-08-20T06:14:07.702Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-16a859331aeb45c7","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fdbe5767d6f54e5ef5a2bac3e2665c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:14:07.785Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5f99e4fa5f829dfacabe9950: start","job_status":"start","queue_duration_s":1.645617,"scheduling_latency_s":1.645643}1522gitlab # [ 298.133311] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:14:09.449Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5f99e4fa5f829dfacabe9950","created_at":"2026-08-20T06:14:07.702Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-16a859331aeb45c7","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fdbe5767d6f54e5ef5a2bac3e2665c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:14:07.785Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5f99e4fa5f829dfacabe9950: done: 0.019164 sec","job_status":"done","queue_duration_s":1.645617,"scheduling_latency_s":1.645643,"redis_calls":13,"redis_duration_s":0.0025599999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000841,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001719,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012199,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019164,"completed_at":"2026-08-20T06:14:09.449Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1523gitlab # [ 298.180870] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:14:09.451Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0e4e07ec975d6b07569ff10b","created_at":"2026-08-20T06:14:07.702Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-16a859331aeb45c7","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fdbe5767d6f54e5ef5a2bac3e2665c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:14:07.785Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0e4e07ec975d6b07569ff10b: start","job_status":"start","queue_duration_s":1.66665,"scheduling_latency_s":1.666675}1524gitlab # [ 298.195120] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:14:09.471Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0e4e07ec975d6b07569ff10b","created_at":"2026-08-20T06:14:07.702Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-16a859331aeb45c7","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fdbe5767d6f54e5ef5a2bac3e2665c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:14:07.785Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0e4e07ec975d6b07569ff10b: done: 0.019695 sec","job_status":"done","queue_duration_s":1.66665,"scheduling_latency_s":1.666675,"redis_calls":13,"redis_duration_s":0.0037739999999999996,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001338,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002436,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011772,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019695,"completed_at":"2026-08-20T06:14:09.471Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1525gitlab # [ 298.234378] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:14:09.473Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2d7ec9a0b6c9eb3b5ce7b3c6","created_at":"2026-08-20T06:14:07.702Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-16a859331aeb45c7","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fdbe5767d6f54e5ef5a2bac3e2665c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:14:07.785Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2d7ec9a0b6c9eb3b5ce7b3c6: start","job_status":"start","queue_duration_s":1.688226,"scheduling_latency_s":1.688247}1526gitlab # [ 298.246909] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:14:09.492Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2d7ec9a0b6c9eb3b5ce7b3c6","created_at":"2026-08-20T06:14:07.702Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-16a859331aeb45c7","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fdbe5767d6f54e5ef5a2bac3e2665c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:14:07.785Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2d7ec9a0b6c9eb3b5ce7b3c6: done: 0.018744 sec","job_status":"done","queue_duration_s":1.688226,"scheduling_latency_s":1.688247,"redis_calls":13,"redis_duration_s":0.003097,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000931,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002166,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011705,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018744,"completed_at":"2026-08-20T06:14:09.492Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1527gitlab # [ 298.287693] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:14:09.493Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fa0b7baad44cf0805b2a361c","created_at":"2026-08-20T06:14:07.702Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-16a859331aeb45c7","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fdbe5767d6f54e5ef5a2bac3e2665c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:14:07.785Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fa0b7baad44cf0805b2a361c: start","job_status":"start","queue_duration_s":1.70841,"scheduling_latency_s":1.708429}1528gitlab # [ 298.301026] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:14:09.510Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fa0b7baad44cf0805b2a361c","created_at":"2026-08-20T06:14:07.702Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-16a859331aeb45c7","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fdbe5767d6f54e5ef5a2bac3e2665c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:14:07.785Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fa0b7baad44cf0805b2a361c: done: 0.017189 sec","job_status":"done","queue_duration_s":1.70841,"scheduling_latency_s":1.708429,"redis_calls":13,"redis_duration_s":0.00226,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000757,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001503,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011286,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017189,"completed_at":"2026-08-20T06:14:09.510Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1529gitlab # [ 298.340627] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:14:09.514Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"278aea7ac0cae4704518a9c7","created_at":"2026-08-20T06:14:07.702Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-16a859331aeb45c7","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fdbe5767d6f54e5ef5a2bac3e2665c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:14:07.785Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-278aea7ac0cae4704518a9c7: start","job_status":"start","queue_duration_s":1.728759,"scheduling_latency_s":1.72878}1530gitlab # [ 298.353190] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:14:09.531Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"278aea7ac0cae4704518a9c7","created_at":"2026-08-20T06:14:07.702Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-16a859331aeb45c7","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fdbe5767d6f54e5ef5a2bac3e2665c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:14:07.785Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-278aea7ac0cae4704518a9c7: done: 0.017081 sec","job_status":"done","queue_duration_s":1.728759,"scheduling_latency_s":1.72878,"redis_calls":13,"redis_duration_s":0.002158,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000778,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00138,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011169,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017081,"completed_at":"2026-08-20T06:14:09.530Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1531gitlab # [ 298.414764] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:14:09.532Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d01e65f9fd7cd8735f981d75","created_at":"2026-08-20T06:14:07.702Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-16a859331aeb45c7","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fdbe5767d6f54e5ef5a2bac3e2665c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:14:07.785Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d01e65f9fd7cd8735f981d75: start","job_status":"start","queue_duration_s":1.747262,"scheduling_latency_s":1.747279}1532gitlab # [ 298.434493] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:14:09.550Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d01e65f9fd7cd8735f981d75","created_at":"2026-08-20T06:14:07.702Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-16a859331aeb45c7","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fdbe5767d6f54e5ef5a2bac3e2665c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:14:07.785Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d01e65f9fd7cd8735f981d75: done: 0.018161 sec","job_status":"done","queue_duration_s":1.747262,"scheduling_latency_s":1.747279,"redis_calls":13,"redis_duration_s":0.003218,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000976,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002242,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011298,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018161,"completed_at":"2026-08-20T06:14:09.550Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1533gitlab # [ 298.480912] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:14:09.552Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f977cd576ec9b40a0cd5617b","created_at":"2026-08-20T06:14:07.702Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-16a859331aeb45c7","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fdbe5767d6f54e5ef5a2bac3e2665c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:14:07.785Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f977cd576ec9b40a0cd5617b: start","job_status":"start","queue_duration_s":1.76707,"scheduling_latency_s":1.76709}1534gitlab # [ 298.500723] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:14:09.570Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f977cd576ec9b40a0cd5617b","created_at":"2026-08-20T06:14:07.702Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-16a859331aeb45c7","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fdbe5767d6f54e5ef5a2bac3e2665c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:14:07.785Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f977cd576ec9b40a0cd5617b: done: 0.018318 sec","job_status":"done","queue_duration_s":1.76707,"scheduling_latency_s":1.76709,"redis_calls":13,"redis_duration_s":0.003274,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001074,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.0022,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011331,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018318,"completed_at":"2026-08-20T06:14:09.570Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1535gitlab # [ 298.541859] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:14:09.572Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"88e2d665490929934abbf0b2","created_at":"2026-08-20T06:14:07.702Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-16a859331aeb45c7","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fdbe5767d6f54e5ef5a2bac3e2665c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:14:07.785Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-88e2d665490929934abbf0b2: start","job_status":"start","queue_duration_s":1.787016,"scheduling_latency_s":1.787035}1536gitlab # [ 298.554577] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:14:09.589Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"88e2d665490929934abbf0b2","created_at":"2026-08-20T06:14:07.702Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-16a859331aeb45c7","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fdbe5767d6f54e5ef5a2bac3e2665c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:14:07.785Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-88e2d665490929934abbf0b2: done: 0.016852 sec","job_status":"done","queue_duration_s":1.787016,"scheduling_latency_s":1.787035,"redis_calls":13,"redis_duration_s":0.002486,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000879,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001607,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010716,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016852,"completed_at":"2026-08-20T06:14:09.588Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1537gitlab # [ 298.594347] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:14:09.590Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b1697acd0b8e4804ba85ec59","created_at":"2026-08-20T06:14:07.702Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-16a859331aeb45c7","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fdbe5767d6f54e5ef5a2bac3e2665c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:14:07.785Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b1697acd0b8e4804ba85ec59: start","job_status":"start","queue_duration_s":1.805181,"scheduling_latency_s":1.805197}1538gitlab # [ 298.607106] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:14:09.606Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b1697acd0b8e4804ba85ec59","created_at":"2026-08-20T06:14:07.702Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-16a859331aeb45c7","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fdbe5767d6f54e5ef5a2bac3e2665c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:14:07.785Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b1697acd0b8e4804ba85ec59: done: 0.016378 sec","job_status":"done","queue_duration_s":1.805181,"scheduling_latency_s":1.805197,"redis_calls":13,"redis_duration_s":0.0031339999999999996,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001158,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001976,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00984,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016378,"completed_at":"2026-08-20T06:14:09.606Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1539gitlab # [ 298.647992] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:14:09.608Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"961530c4d016d87c89e025eb","created_at":"2026-08-20T06:14:07.702Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-16a859331aeb45c7","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fdbe5767d6f54e5ef5a2bac3e2665c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:14:07.785Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-961530c4d016d87c89e025eb: start","job_status":"start","queue_duration_s":1.823101,"scheduling_latency_s":1.823118}1540gitlab # [ 298.660561] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:14:09.625Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"961530c4d016d87c89e025eb","created_at":"2026-08-20T06:14:07.702Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-16a859331aeb45c7","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fdbe5767d6f54e5ef5a2bac3e2665c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:14:07.785Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-961530c4d016d87c89e025eb: done: 0.016978 sec","job_status":"done","queue_duration_s":1.823101,"scheduling_latency_s":1.823118,"redis_calls":13,"redis_duration_s":0.002953,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00095,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002003,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010562,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016978,"completed_at":"2026-08-20T06:14:09.625Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1541gitlab # [ 298.701369] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:14:09.627Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"996a1db6e94ae1fb2923560b","created_at":"2026-08-20T06:14:08.704Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-7a7d12e2a87f43b3","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"8a894e54fc649d93e3b0782d95b34b71","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:14:08.735Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-996a1db6e94ae1fb2923560b: start","job_status":"start","queue_duration_s":0.892017,"scheduling_latency_s":0.892037}1542gitlab # [ 298.713857] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:14:09.641Z","message":"No existing merge request to be cleaned up."}1543gitlab # [ 298.715464] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:14:09.652Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"996a1db6e94ae1fb2923560b","created_at":"2026-08-20T06:14:08.704Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-7a7d12e2a87f43b3","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"8a894e54fc649d93e3b0782d95b34b71","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:14:08.735Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-996a1db6e94ae1fb2923560b: done: 0.024828 sec","job_status":"done","queue_duration_s":0.892017,"scheduling_latency_s":0.892037,"redis_calls":10,"redis_duration_s":0.003215,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001613,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001602,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015588,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.024828,"completed_at":"2026-08-20T06:14:09.652Z","load_balancing_strategy":"primary","db_duration_s":0.003808,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1544gitlab # [ 298.754491] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:14:09.653Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"3586467bc08952b2b83c749c","created_at":"2026-08-20T06:14:08.704Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-7a7d12e2a87f43b3","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"8a894e54fc649d93e3b0782d95b34b71","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:14:08.735Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-3586467bc08952b2b83c749c: start","job_status":"start","queue_duration_s":0.918328,"scheduling_latency_s":0.918346}1545gitlab # [ 298.766843] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:14:09.666Z","message":"No existing merge request to be cleaned up."}1546gitlab # [ 298.768484] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:14:09.676Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"3586467bc08952b2b83c749c","created_at":"2026-08-20T06:14:08.704Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-7a7d12e2a87f43b3","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"8a894e54fc649d93e3b0782d95b34b71","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:14:08.735Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-3586467bc08952b2b83c749c: done: 0.022812 sec","job_status":"done","queue_duration_s":0.918328,"scheduling_latency_s":0.918346,"redis_calls":10,"redis_duration_s":0.002701,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001148,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001553,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014225,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.022812,"completed_at":"2026-08-20T06:14:09.676Z","load_balancing_strategy":"primary","db_duration_s":0.004029,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1547gitlab # [ 298.806953] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:14:09.678Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"63c3dbb84564221c8c5db35f","created_at":"2026-08-20T06:14:08.704Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-7a7d12e2a87f43b3","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"8a894e54fc649d93e3b0782d95b34b71","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:14:08.735Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-63c3dbb84564221c8c5db35f: start","job_status":"start","queue_duration_s":0.94273,"scheduling_latency_s":0.942748}1548gitlab # [ 298.819227] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:14:09.690Z","message":"No existing merge request to be cleaned up."}1549gitlab # [ 298.820966] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:14:09.700Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"63c3dbb84564221c8c5db35f","created_at":"2026-08-20T06:14:08.704Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-7a7d12e2a87f43b3","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"8a894e54fc649d93e3b0782d95b34b71","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:14:08.735Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-63c3dbb84564221c8c5db35f: done: 0.022659 sec","job_status":"done","queue_duration_s":0.94273,"scheduling_latency_s":0.942748,"redis_calls":10,"redis_duration_s":0.0032760000000000003,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001112,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.002164,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013947,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.022659,"completed_at":"2026-08-20T06:14:09.700Z","load_balancing_strategy":"primary","db_duration_s":0.003101,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1550gitlab # [ 298.859898] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:14:09.702Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"72db7e6ae1beac203eb1e4c5","created_at":"2026-08-20T06:14:08.704Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-7a7d12e2a87f43b3","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"8a894e54fc649d93e3b0782d95b34b71","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:14:08.735Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-72db7e6ae1beac203eb1e4c5: start","job_status":"start","queue_duration_s":0.966902,"scheduling_latency_s":0.966918}1551gitlab # [ 298.872392] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:14:09.713Z","message":"No existing merge request to be cleaned up."}1552gitlab # [ 298.874049] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:14:09.722Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"72db7e6ae1beac203eb1e4c5","created_at":"2026-08-20T06:14:08.704Z","trace_propagation_headers":{"sentry-trace":"b623e9e19a7d4b8bbd2c209bb43da641-7a7d12e2a87f43b3","baggage":"sentry-trace_id=b623e9e19a7d4b8bbd2c209bb43da641,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"8a894e54fc649d93e3b0782d95b34b71","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:14:08.735Z","job_size_bytes":2,"pid":2002,"sidekiq_tid":"mapm","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-72db7e6ae1beac203eb1e4c5: done: 0.020424 sec","job_status":"done","queue_duration_s":0.966902,"scheduling_latency_s":0.966918,"redis_calls":10,"redis_duration_s":0.0025859999999999998,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001072,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001514,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012828,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020424,"completed_at":"2026-08-20T06:14:09.722Z","load_balancing_strategy":"primary","db_duration_s":0.002685,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1553gitlab # [ 309.142049] redis[785]: 10 changes in 300 seconds. Saving...1554gitlab # [ 309.150173] redis[785]: Background saving started by pid 32811555gitlab # [ 309.154346] redis[3281]: BGSAVE done, 454 keys saved, 0 keys skipped, 117752 bytes written.1556gitlab # [ 309.158637] redis[3281]: DB saved on disk1557gitlab # [ 309.160955] redis[3281]: Fork CoW for RDB: current 1 MB, peak 1 MB, average 0 MB1558gitlab # [ 309.243307] redis[785]: Background saving terminated with success1559gitlab # [ 311.179765] postgres[863]: [863] LOG: checkpoint starting: time1560gitlab # [ 311.714668] gitaly[891]: time="2026-08-20T06:14:24.620Z" level=info msg="burden monitor stats" pid=8911561gitlab # [ 313.609648] postgres[3271]: [3271] ERROR: relation "table_without_models" does not exist1562gitlab # [ 313.614123] postgres[3271]: [3271] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1563gitlab # [ 319.245222] runuser[2932]: pam_unix(runuser:session): session closed for user gitlab1564gitlab # [ 319.247237] setup-gitlab-start[2910]: + systemctl restart gitlab-sidekiq.service1565gitlab # [ 319.282377] systemd[1]: Stopping gitlab-sidekiq.service...1566gitlab # [ 319.283815] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:14:32.190Z","message":"Shutting down"}1567gitlab # [ 319.285553] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:14:32.190Z","message":"Scheduler exiting..."}1568gitlab # [ 319.287137] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:14:32.191Z","message":"Terminating quiet threads for default capsule"}1569gitlab # [ 319.289110] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:14:32.191Z","message":"Scheduler exiting..."}1570gitlab # [ 319.785233] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:14:32.692Z","message":"Pausing to allow jobs to finish..."}1571gitlab # [ 322.290299] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:14:35.196Z","message":"Bye!"}1572gitlab # [ 322.329852] sidekiq-cluster[2002]: {"severity":"INFO","time":"2026-08-20T06:14:35.237Z","message":"stopped","memwd_reason":"background task stopped","memwd_handler_class":"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler","memwd_sleep_time_s":3,"pid":2002,"worker_id":"sidekiq_0","memwd_rss_bytes":972783616,"retry":0}1573gitlab # [ 323.163457] systemd[1]: gitlab-sidekiq.service: Deactivated successfully.1574gitlab # [ 323.163896] systemd[1]: Stopped gitlab-sidekiq.service.1575gitlab # [ 323.164205] systemd[1]: gitlab-sidekiq.service: Consumed 1min 52.163s CPU time over 3min 22.397s wall clock time, 957.1M memory peak, 4.5M read from disk.1576gitlab # [ 323.177987] systemd[1]: Started gitlab-sidekiq.service.1577gitlab # [ 323.182580] setup-gitlab-start[2910]: + mkdir -p /var/lib/secrets1578gitlab # [ 323.187654] setup-gitlab-start[2910]: + echo nixbot-test-token-of-20-chars1579gitlab # [ 323.190713] setup-gitlab-start[2910]: + chmod 644 /var/lib/secrets/gitlab-token1580gitlab # [ 323.193785] setup-gitlab-start[2910]: + curl -fs -X POST -H 'PRIVATE-TOKEN: nixbot-test-token-of-20-chars' -H 'Content-Type: application/json' -d '{"name":"test-flake","visibility":"public","topics":["build-with-buildbot"]}' http://gitlab/api/v4/projects1581gitlab # [ 325.066703] gitaly[891]: time="2026-08-20T06:14:37.973Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M0EWX8B4AWG8VJ9DGG1G6W64 error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-20T06:14:47.010" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T06:14:37.972" pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1582gitlab # [ 325.066961] gitaly[891]: time="2026-08-20T06:14:37.974Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0EWX8B4AWG8VJ9DGG1G6W64 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-20T06:14:47.010" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=95 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T06:14:37.972" grpc.time_ms=1.159 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1583gitlab # [ 325.280880] gitaly[891]: time="2026-08-20T06:14:38.188Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M0EWX8B4AWG8VJ9DGG1G6W64 error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-20T06:14:48.007" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T06:14:38.188" pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1584gitlab # [ 325.294038] gitaly[891]: time="2026-08-20T06:14:38.188Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0EWX8B4AWG8VJ9DGG1G6W64 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-20T06:14:48.007" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T06:14:38.188" grpc.time_ms=0.353 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1585gitlab # [ 325.348486] gitaly[891]: time="2026-08-20T06:14:38.256Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0EWX8B4AWG8VJ9DGG1G6W64 diskcache=810a886c-3120-4142-9537-2bb314f53166 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-08-20T06:14:48.019" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T06:14:38.199" pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1586gitlab # [ 325.361739] gitaly[891]: time="2026-08-20T06:14:38.256Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=28 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1435 command.oublock=32 command.real_time_ms=38 command.spawn_token_fork_ms=13 command.system_time_ms=17 command.user_time_ms=11 component=gitaly.UnaryServerInterceptor correlation_id=01M0EWX8B4AWG8VJ9DGG1G6W64 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-08-20T06:14:48.019" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T06:14:38.199" grpc.time_ms=56.557 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1587gitlab # [ 325.376970] gitaly[891]: time="2026-08-20T06:14:38.275Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01M0EWX8B4AWG8VJ9DGG1G6W64 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-20T06:14:48.093" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T06:14:38.274" pid=891 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root1588gitlab # [ 325.387821] gitaly[891]: time="2026-08-20T06:14:38.275Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0EWX8B4AWG8VJ9DGG1G6W64 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-20T06:14:48.093" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T06:14:38.274" grpc.time_ms=1.501 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1589gitlab # [ 325.399161] gitaly[891]: time="2026-08-20T06:14:38.293Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=2 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EWX8B4AWG8VJ9DGG1G6W64 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-20T06:14:48.102" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T06:14:38.283" grpc.time_ms=10.562 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1590gitlab # [ 325.474211] gitaly[891]: time="2026-08-20T06:14:38.381Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M0EWX8B4AWG8VJ9DGG1G6W64 error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-20T06:14:48.201" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T06:14:38.381" pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1591gitlab # [ 325.488650] gitaly[891]: time="2026-08-20T06:14:38.382Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0EWX8B4AWG8VJ9DGG1G6W64 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-20T06:14:48.201" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T06:14:38.381" grpc.time_ms=0.414 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1592gitlab # [ 325.539853] gitaly[891]: time="2026-08-20T06:14:38.447Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0EWX8B4AWG8VJ9DGG1G6W64 diskcache=b2b628e2-f507-4126-99c6-7eddd8993ca5 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-08-20T06:14:48.216" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T06:14:38.397" pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1593gitlab # [ 325.561734] gitaly[891]: time="2026-08-20T06:14:38.447Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=29 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1437 command.oublock=32 command.real_time_ms=31 command.spawn_token_fork_ms=4 command.system_time_ms=24 command.user_time_ms=5 component=gitaly.UnaryServerInterceptor correlation_id=01M0EWX8B4AWG8VJ9DGG1G6W64 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-08-20T06:14:48.216" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=137 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T06:14:38.397" grpc.time_ms=50.604 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1594gitlab # [ 325.583725] gitaly[891]: time="2026-08-20T06:14:38.455Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01M0EWX8B4AWG8VJ9DGG1G6W64 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-20T06:14:48.274" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T06:14:38.454" pid=891 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root1595gitlab # [ 325.597965] gitaly[891]: time="2026-08-20T06:14:38.455Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0EWX8B4AWG8VJ9DGG1G6W64 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-20T06:14:48.274" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T06:14:38.454" grpc.time_ms=0.739 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1596gitlab # [ 325.611593] gitaly[891]: time="2026-08-20T06:14:38.473Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=570 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=6 component=gitaly.UnaryServerInterceptor correlation_id=01M0EWX8B4AWG8VJ9DGG1G6W64 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-20T06:14:48.279" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T06:14:38.460" grpc.time_ms=13.17 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1597gitlab # [ 325.628517] gitaly[891]: time="2026-08-20T06:14:38.517Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0EWX8B4AWG8VJ9DGG1G6W64 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-20T06:14:48.006" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T06:14:38.516" grpc.time_ms=0.347 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1598gitlab # [ 325.641708] gitaly[891]: time="2026-08-20T06:14:38.526Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0EWX8B4AWG8VJ9DGG1G6W64 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-08-20T06:14:48.016" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T06:14:38.526" grpc.time_ms=0.354 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1599gitlab # [ 326.363994] gitaly[891]: time="2026-08-20T06:14:39.271Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M0EWX8B4AWG8VJ9DGG1G6W64 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-20T06:14:49.072" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T06:14:39.253" grpc.time_ms=17.615 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1600gitlab # [ 326.821253] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/20:06:14:39 +0000] "POST /api/v4/projects HTTP/1.1" 201 4828 "" "curl/8.21.0" 35941601gitlab # [ 326.828301] setup-gitlab-start[2910]: + mkdir -p /tmp/test-flake1602gitlab # [ 326.831203] setup-gitlab-start[2910]: + cd /tmp/test-flake1603gitlab # [ 326.834017] setup-gitlab-start[2910]: + git init -b master1604gitlab # [ 326.839995] setup-gitlab-start[3393]: Initialized empty Git repository in /tmp/test-flake/.git/1605gitlab # [ 326.843782] setup-gitlab-start[2910]: + git config user.name test1606gitlab # [ 326.846555] setup-gitlab-start[2910]: + git config user.email test@example.com1607gitlab # [ 326.850572] setup-gitlab-start[2910]: + cat1608gitlab # [ 326.853479] setup-gitlab-start[2910]: + git add flake.nix1609gitlab # [ 326.865808] setup-gitlab-start[2910]: + git commit -m 'initial commit'1610gitlab # [ 326.885878] setup-gitlab-start[3402]: [master (root-commit) 92dfd74] initial commit1611gitlab # [ 326.890112] setup-gitlab-start[3402]: 1 file changed, 10 insertions(+)1612gitlab # [ 326.893042] setup-gitlab-start[3402]: create mode 100644 flake.nix1613gitlab # [ 326.895621] setup-gitlab-start[2910]: + git remote add origin http://oauth2:nixbot-test-token-of-20-chars@gitlab/root/test-flake.git1614gitlab # [ 326.901437] setup-gitlab-start[2910]: + git push -u origin master1615gitlab # [ 327.009605] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/20:06:14:39 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.55.0" 661616gitlab # [ 327.543238] gitaly[891]: time="2026-08-20T06:14:40.450Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=581 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EWXC1EV23C0941GHG0C5W5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=242 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T06:14:40.435" grpc.time_ms=14.853 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1617gitlab # [ 327.557331] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/20:06:14:40 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 178 "" "git/2.55.0" 5331618gitlab # [ 327.981853] gitaly[891]: time="2026-08-20T06:14:40.889Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=12 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EWXCJSMX4YSNV9GED54BJ5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-20T06:14:50.002" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=169 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T06:14:40.872" grpc.time_ms=16.483 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1619gitlab # [ 328.079325] gitaly[891]: time="2026-08-20T06:14:40.986Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=301 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EWXCJSMX4YSNV9GED54BJ5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-08-20T06:15:10.066" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-08-20T06:14:40.967" grpc.time_ms=19.368 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1620gitlab # [ 328.149657] gitaly[891]: time="2026-08-20T06:14:41.056Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01M0EWXCJSMX4YSNV9GED54BJ5 duration_ms=390ns method=POST pid=891 status=200 url="http://unix/api/v4/internal/allowed"1621gitlab # [ 328.213429] gitaly[891]: time="2026-08-20T06:14:41.121Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01M0EWXCJSMX4YSNV9GED54BJ5 duration_ms=63ns method=POST pid=891 status=200 url="http://unix/api/v4/internal/pre_receive"1622gitlab # [ 328.223713] gitaly[891]: time="2026-08-20T06:14:41.121Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EWXCJSMX4YSNV9GED54BJ5 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5315 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T06:14:40.663" grpc.time_ms=458.52 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1623gitlab # [ 328.289026] gitaly[891]: time="2026-08-20T06:14:41.196Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EWXCJSMX4YSNV9GED54BJ5 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4785 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T06:14:41.194" grpc.time_ms=1.581 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1624gitlab # [ 328.331141] sidekiq-cluster[3339]: {"severity":"INFO","time":"2026-08-20T06:14:41.209Z","message":"Starting cluster with 1 processes"}1625gitlab # [ 328.348445] gitaly[891]: time="2026-08-20T06:14:41.256Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EWXCJSMX4YSNV9GED54BJ5 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4784 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T06:14:41.253" grpc.time_ms=2.002 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1626gitlab # [ 328.435230] gitaly[891]: time="2026-08-20T06:14:41.342Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EWXCJSMX4YSNV9GED54BJ5 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4786 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T06:14:41.341" grpc.time_ms=1.218 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1627gitlab # [ 328.624936] gitaly[891]: time="2026-08-20T06:14:41.531Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=2 command.system_time_ms=7 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M0EWXCJSMX4YSNV9GED54BJ5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-20T06:14:51.005" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T06:14:41.516" grpc.time_ms=14.982 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1628gitlab # [ 328.715188] gitaly[891]: time="2026-08-20T06:14:41.622Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=32 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1435 command.oublock=0 command.real_time_ms=36 command.spawn_token_fork_ms=5 command.system_time_ms=22 command.user_time_ms=10 component=gitaly.UnaryServerInterceptor correlation_id=01M0EWXCJSMX4YSNV9GED54BJ5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-08-20T06:14:51.069" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T06:14:41.580" grpc.time_ms=42.305 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1629gitlab # [ 328.791142] gitaly[891]: time="2026-08-20T06:14:41.697Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01M0EWXCJSMX4YSNV9GED54BJ5 duration_ms=294ns method=POST pid=891 status=200 url="http://unix/api/v4/internal/post_receive"1630gitlab # [ 328.804315] gitaly[891]: time="2026-08-20T06:14:41.698Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EWXCJSMX4YSNV9GED54BJ5 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4809 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T06:14:41.402" grpc.time_ms=296.375 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1631gitlab # [ 328.838979] gitaly[891]: time="2026-08-20T06:14:41.746Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01M0EWXCJSMX4YSNV9GED54BJ5 diskcache=bc9b4a96-5a3b-4265-9853-73eec5adef07 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T06:14:40.552" pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1632gitlab # [ 328.869873] gitaly[891]: time="2026-08-20T06:14:41.747Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=367 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=847872 command.minflt=13629 command.oublock=32 command.real_time_ms=1184 command.spawn_token_fork_ms=2 command.system_time_ms=178 command.user_time_ms=189 component=gitaly.StreamServerInterceptor correlation_id=01M0EWXCJSMX4YSNV9GED54BJ5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=684 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=56 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T06:14:40.552" grpc.time_ms=1194.489 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1633gitlab # [ 328.900552] gitlab-workhorse[817]: time="2026-08-20T06:14:41Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=521634gitlab # [ 328.903721] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/20:06:14:41 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.55.0" 12741635gitlab # [ 328.907247] setup-gitlab-start[3406]: To http://gitlab/root/test-flake.git1636gitlab # [ 328.908761] setup-gitlab-start[3406]: * [new branch] master -> master1637gitlab # [ 328.910175] setup-gitlab-start[3406]: branch 'master' set up to track 'origin/master'.1638gitlab # [ 328.912139] systemd[1]: Finished setup-gitlab.service.1639gitlab # [ 328.913342] systemd[1]: Starting nixbot CI service...1640gitlab: (finished: waiting for unit setup-gitlab.service, in 329.57 seconds)1641gitlab: waiting for unit nixbot.service1642gitlab # [ 330.327709] nixbot[3496]: {"ts": "2026-08-20T06:14:43.234Z", "level": "info", "logger": "nixbot.main", "msg": "nixbot starting", "url": "http://localhost:8010", "state_dir": "/var/lib/nixbot"}1643gitlab # [ 330.380727] nixbot[3496]: {"ts": "2026-08-20T06:14:43.288Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 1, "migration": "initial"}1644gitlab # [ 330.423138] nixbot[3496]: {"ts": "2026-08-20T06:14:43.330Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 2, "migration": "scheduled_effects"}1645gitlab # [ 330.432690] nixbot[3496]: {"ts": "2026-08-20T06:14:43.340Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 3, "migration": "gitea_webhook_secrets"}1646gitlab # [ 330.441580] nixbot[3496]: {"ts": "2026-08-20T06:14:43.349Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 4, "migration": "api_tokens"}1647gitlab # [ 330.453566] nixbot[3496]: {"ts": "2026-08-20T06:14:43.361Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 5, "migration": "status_notify"}1648gitlab # [ 330.461756] nixbot[3496]: {"ts": "2026-08-20T06:14:43.369Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 6, "migration": "webhook_secrets"}1649gitlab # [ 330.468305] nixbot[3496]: {"ts": "2026-08-20T06:14:43.373Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 7, "migration": "build_effects"}1650gitlab # [ 330.477707] nixbot[3496]: {"ts": "2026-08-20T06:14:43.385Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 8, "migration": "api_token_groups"}1651gitlab # [ 330.484311] nixbot[3496]: {"ts": "2026-08-20T06:14:43.389Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 9, "migration": "scheduled_effect_runs"}1652gitlab # [ 330.491184] nixbot[3496]: {"ts": "2026-08-20T06:14:43.398Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 10, "migration": "work_queue"}1653gitlab # [ 330.503965] nixbot[3496]: {"ts": "2026-08-20T06:14:43.411Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 11, "migration": "revoked_sessions"}1654gitlab # [ 330.510542] nixbot[3496]: {"ts": "2026-08-20T06:14:43.417Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 12, "migration": "truncate_notify_names"}1655gitlab # [ 330.517384] nixbot[3496]: {"ts": "2026-08-20T06:14:43.421Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 13, "migration": "failed_builds_per_project"}1656gitlab # [ 330.524365] nixbot[3496]: {"ts": "2026-08-20T06:14:43.428Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 14, "migration": "streamed_eval_warnings"}1657gitlab # [ 330.531167] nixbot[3496]: {"ts": "2026-08-20T06:14:43.432Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 15, "migration": "eval_completed"}1658gitlab # [ 330.537513] nixbot[3496]: {"ts": "2026-08-20T06:14:43.435Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 16, "migration": "reconcile_watermark"}1659gitlab # [ 330.543662] nixbot[3496]: {"ts": "2026-08-20T06:14:43.438Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 17, "migration": "check_runs"}1660gitlab # [ 330.549567] nixbot[3496]: {"ts": "2026-08-20T06:14:43.447Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 18, "migration": "effects_commit"}1661gitlab # [ 330.555067] nixbot[3496]: {"ts": "2026-08-20T06:14:43.451Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 19, "migration": "scheduled_run_notify"}1662gitlab # [ 330.560724] nixbot[3496]: {"ts": "2026-08-20T06:14:43.454Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 20, "migration": "log_metadata"}1663gitlab # [ 330.567483] nixbot[3496]: {"ts": "2026-08-20T06:14:43.464Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 21, "migration": "forge_refresh_tokens"}1664gitlab # [ 330.573173] nixbot[3496]: {"ts": "2026-08-20T06:14:43.466Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 22, "migration": "attr_finished_idx"}1665gitlab # [ 330.578323] nixbot[3496]: {"ts": "2026-08-20T06:14:43.470Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 23, "migration": "effect_deps"}1666gitlab # [ 330.582929] nixbot[3496]: {"ts": "2026-08-20T06:14:43.474Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 24, "migration": "drop_forge_tokens"}1667gitlab # [ 331.006005] nixbot[3496]: INFO: Started server process [3496]1668gitlab # [ 331.012475] nixbot[3496]: INFO: Uvicorn running on socket ('::', 8010, 0, 0) (Press CTRL+C to quit)1669gitlab # [ 331.026331] nixbot[3496]: INFO: ::ffff:127.0.0.1:43242 - "GET /health HTTP/1.1" 200 OK1670gitlab # [ 331.033760] systemd[1]: Started nixbot CI service.1671gitlab # [ 331.037886] systemd[1]: Reached target Multi-User System.1672gitlab # [ 331.040521] systemd[1]: Startup finished in 651ms (kernel) + 4.155s (initrd) + 5min 26.233s (userspace) = 5min 31.040s.1673gitlab: (finished: waiting for unit nixbot.service, in 2.14 seconds)1674gitlab: waiting for success: curl --fail -s http://127.0.0.1:8010/health1675gitlab # [ 331.336060] nixbot[3496]: INFO: ::ffff:127.0.0.1:57824 - "GET /health HTTP/1.1" 200 OK1676gitlab: (finished: waiting for success: curl --fail -s http://127.0.0.1:8010/health, in 0.06 seconds)1677subtest: project discovered and webhook registered1678gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks1679gitlab # [ 331.503440] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/20:06:14:44 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 2 "" "curl/8.21.0" 1101680gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks, in 0.17 seconds)1681gitlab # [ 332.262800] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/20:06:14:45 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4909 "" "python-httpx/0.28.1" 12321682gitlab # [ 332.270432] nixbot[3496]: {"ts": "2026-08-20T06:14:45.171Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects?membership=true&archived=false&per_page=100 \"HTTP/1.1 200 OK\""}1683gitlab # [ 332.304755] nixbot[3496]: {"ts": "2026-08-20T06:14:45.212Z", "level": "info", "logger": "nixbot.repos", "msg": "legacy topic import complete", "topics": {"gitlab": "build-with-buildbot"}, "enabled": 1}1684gitlab # [ 332.422138] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/20:06:14:45 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 1081685gitlab # [ 332.429776] nixbot[3496]: {"ts": "2026-08-20T06:14:45.331Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 200 OK\""}1686gitlab # [ 332.436903] nixbot[3496]: {"ts": "2026-08-20T06:14:45.333Z", "level": "info", "logger": "nixbot.hook_registration", "msg": "registering webhook", "repo": "root/test-flake"}1687gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks1688gitlab # [ 332.679436] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/20:06:14:45 +0000] "POST /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 201 919 "" "python-httpx/0.28.1" 2491689gitlab # [ 332.682710] nixbot[3496]: {"ts": "2026-08-20T06:14:45.588Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 201 Created\""}1690gitlab # [ 332.742893] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/20:06:14:45 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 882 "" "curl/8.21.0" 1801691gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks, in 0.24 seconds)1692(finished: subtest: project discovered and webhook registered, in 1.41 seconds)1693subtest: push delivers the webhook1694gitlab: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master1695gitlab # [ 332.849337] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/20:06:14:45 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.55.0" 371696gitlab # [ 332.978648] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/20:06:14:45 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4909 "" "python-httpx/0.28.1" 2791697gitlab # [ 332.986430] nixbot[3496]: {"ts": "2026-08-20T06:14:45.887Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects?membership=true&archived=false&per_page=100 \"HTTP/1.1 200 OK\""}1698gitlab # [ 333.070785] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/20:06:14:45 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 882 "" "python-httpx/0.28.1" 761699gitlab # [ 333.079255] nixbot[3496]: {"ts": "2026-08-20T06:14:45.981Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 200 OK\""}1700gitlab # [ 333.155772] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/20:06:14:46 +0000] "PUT /api/v4/projects/root%2Ftest-flake/hooks/1 HTTP/1.1" 200 919 "" "python-httpx/0.28.1" 761701gitlab # [ 333.164225] nixbot[3496]: {"ts": "2026-08-20T06:14:46.071Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: PUT http://gitlab/api/v4/projects/root%2Ftest-flake/hooks/1 \"HTTP/1.1 200 OK\""}1702gitlab # [ 333.177237] gitaly[891]: time="2026-08-20T06:14:46.081Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=582 command.oublock=0 command.real_time_ms=18 command.spawn_token_fork_ms=17 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EWXHR0KVYGGHF46KMEWK2C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T06:14:46.059" grpc.time_ms=21.185 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1703gitlab # Enumerating objects: 5, done.1704gitlab # [ 333.213716] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/20:06:14:46 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 202 "" "git/2.55.0" 3211705gitlab # Counting objects: 20% (1/5)Counting objects: 40% (2/5)Counting objects: 60% (3/5)Counting objects: 80% (4/5)Counting objects: 100% (5/5)Counting objects: 100% (5/5), done.1706gitlab # Delta compression using up to 4 threads1707gitlab # Compressing objects: 50% (1/2)Compressing objects: 100% (2/2)Compressing objects: 100% (2/2), done.1708gitlab # Writing objects: 33% (1/3)Writing objects: 66% (2/3)Writing objects: 100% (3/3)Writing objects: 100% (3/3), 273 bytes | 136.00 KiB/s, done.1709gitlab # Total 3 (delta 1), reused 0 (delta 0), pack-reused 0 (from 0)1710gitlab # [ 333.267972] gitaly[891]: time="2026-08-20T06:14:46.175Z" level=info msg="finished unary call with code OK" catfile.duration_ms=3 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=3 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=1 command.system_time_ms=6 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M0EWXJ23ZCBTN85RCE0T78PV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindBranch grpc.request.deadline="2026-08-20T06:15:16.054" grpc.request.fullMethod=/gitaly.RefService/FindBranch grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=215 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T06:14:46.154" grpc.time_ms=20.274 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1711gitlab # [ 333.313175] gitaly[891]: time="2026-08-20T06:14:46.220Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EWXJ23ZCBTN85RCE0T78PV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T06:15:16.118" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:14:46.219" grpc.time_ms=0.94 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1712gitlab # [ 333.345198] gitaly[891]: time="2026-08-20T06:14:46.252Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=582 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=4 command.system_time_ms=7 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M0EWXJ23ZCBTN85RCE0T78PV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitIsAncestor grpc.request.deadline="2026-08-20T06:14:56.056" grpc.request.fullMethod=/gitaly.CommitService/CommitIsAncestor grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:14:46.237" grpc.time_ms=15.289 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1713gitlab # [ 333.434816] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/20:06:14:46 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/branches/master HTTP/1.1" 200 732 "" "python-httpx/0.28.1" 2581714gitlab # [ 333.440198] nixbot[3496]: {"ts": "2026-08-20T06:14:46.343Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/repository/branches/master \"HTTP/1.1 200 OK\""}1715gitlab # [ 333.492903] gitaly[891]: time="2026-08-20T06:14:46.400Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=301 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=3 command.system_time_ms=12 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EWXJ3WG3YKR9JMR4GKTDPV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-08-20T06:15:16.081" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-08-20T06:14:46.381" grpc.time_ms=18.339 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1716gitlab # [ 333.521856] gitaly[891]: time="2026-08-20T06:14:46.414Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01M0EWXJ3WG3YKR9JMR4GKTDPV duration_ms=105ns method=POST pid=891 status=200 url="http://unix/api/v4/internal/allowed"1717gitlab # [ 333.536923] gitaly[891]: time="2026-08-20T06:14:46.444Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01M0EWXJ3WG3YKR9JMR4GKTDPV duration_ms=29ns method=POST pid=891 status=200 url="http://unix/api/v4/internal/pre_receive"1718gitlab # [ 333.544367] gitaly[891]: time="2026-08-20T06:14:46.448Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EWXJ3WG3YKR9JMR4GKTDPV grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5315 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T06:14:46.308" grpc.time_ms=139.686 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1719gitlab # [ 333.574434] nixbot[3496]: {"ts": "2026-08-20T06:14:46.482Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 \"HTTP/1.1 200 OK\""}1720gitlab # [ 333.577389] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/20:06:14:46 +0000] "GET /api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 1361721gitlab # [ 333.579857] nixbot[3496]: {"ts": "2026-08-20T06:14:46.486Z", "level": "info", "logger": "nixbot.reconcile", "msg": "reconciliation: building unbuilt head", "project": "root/test-flake", "branch": "master", "pr": null}1722gitlab # [ 333.590215] gitaly[891]: time="2026-08-20T06:14:46.497Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EWXJ3WG3YKR9JMR4GKTDPV grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4785 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T06:14:46.497" grpc.time_ms=0.576 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1723gitlab # [ 333.643809] gitaly[891]: time="2026-08-20T06:14:46.551Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EWXJ3WG3YKR9JMR4GKTDPV grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4784 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T06:14:46.549" grpc.time_ms=2.097 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1724gitlab # [ 333.666463] gitaly[891]: time="2026-08-20T06:14:46.574Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EWXJ3WG3YKR9JMR4GKTDPV grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4786 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T06:14:46.573" grpc.time_ms=0.727 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1725gitlab # [ 333.691940] gitaly[891]: time="2026-08-20T06:14:46.599Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=579 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=2 command.system_time_ms=0 command.user_time_ms=5 component=gitaly.StreamServerInterceptor correlation_id=01M0EWXJFV2TQQ6Q2RWEQ3YYA2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=187 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T06:14:46.591" grpc.time_ms=8.372 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc1726gitlab # [ 333.706312] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/20:06:14:46 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 761727gitlab # [ 333.763449] gitaly[891]: time="2026-08-20T06:14:46.671Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01M0EWXJ3WG3YKR9JMR4GKTDPV duration_ms=57ns method=POST pid=891 status=200 url="http://unix/api/v4/internal/post_receive"1728gitlab # [ 333.769052] gitaly[891]: time="2026-08-20T06:14:46.672Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EWXJ3WG3YKR9JMR4GKTDPV grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4809 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T06:14:46.612" grpc.time_ms=59.37 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1729gitlab # [ 333.791891] gitaly[891]: time="2026-08-20T06:14:46.699Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01M0EWXJ3WG3YKR9JMR4GKTDPV diskcache=f3d46186-8b6b-43ca-a02d-12c4a314bf26 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T06:14:46.236" pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1730gitlab # To http://gitlab/root/test-flake.git1731gitlab # [ 333.807913] gitaly[891]: time="2026-08-20T06:14:46.699Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=184 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=831488 command.minflt=13541 command.oublock=32 command.real_time_ms=456 command.spawn_token_fork_ms=1 command.system_time_ms=110 command.user_time_ms=74 component=gitaly.StreamServerInterceptor correlation_id=01M0EWXJ3WG3YKR9JMR4GKTDPV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=605 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=56 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T06:14:46.236" grpc.time_ms=462.833 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1732gitlab # 92dfd74..1ec9218 [ 333.826753] gitlab-workhorse[817]: time="2026-08-20T06:14:46Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=521733gitlab # master -> master[ 333.829333] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/20:06:14:46 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.55.0" 5601734gitlab # 1735gitlab: (finished: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master, in 1.10 seconds)1736gitlab: must succeed: git -C /tmp/test-flake rev-parse master1737gitlab: (finished: must succeed: git -C /tmp/test-flake rev-parse master, in 0.01 seconds)1738gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce'1739gitlab # [ 333.858909] gitaly[891]: time="2026-08-20T06:14:46.766Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0EWXJJ9ABKF5DG0PRWQGX1F grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T06:14:46.755" pid=891 remote_ip="2001:db8:1::1" request_sha=cbf4cb85c7b4a4aa26c72509fcce4a61c2433abb response_bytes=113 span.kind=server system=grpc1740gitlab # [ 333.874863] gitaly[891]: time="2026-08-20T06:14:46.766Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=2 command.system_time_ms=4 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M0EWXJJ9ABKF5DG0PRWQGX1F grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T06:14:46.755" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc1741gitlab # [ 333.896415] gitlab-workhorse[817]: time="2026-08-20T06:14:46Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=1131742gitlab # [ 333.898735] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/20:06:14:46 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 113 "" "git/2.55.0" 1661743gitlab # [ 333.901220] gitaly[891]: time="2026-08-20T06:14:46.767Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=2 command.system_time_ms=4 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M0EWXJJ9ABKF5DG0PRWQGX1F grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=7 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T06:14:46.755" grpc.time_ms=11.126 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc1744gitlab # [ 333.953531] nixbot[3496]: INFO: ::ffff:127.0.0.1:57826 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce HTTP/1.1" 200 OK1745gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce', in 0.10 seconds)1746gitlab # [ 333.982625] gitaly[891]: time="2026-08-20T06:14:46.890Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0EWXJRCJA0T7JZQZDTTR44K grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T06:14:46.871" pid=891 remote_ip="2001:db8:1::1" request_sha=0ab8647ff4021b80467f0677c3a6ff6d40176d51 response_bytes=418 span.kind=server system=grpc1747gitlab # [ 334.003940] gitaly[891]: time="2026-08-20T06:14:46.890Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=15 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1133 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=0 command.system_time_ms=12 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M0EWXJRCJA0T7JZQZDTTR44K grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T06:14:46.871" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc1748gitlab # [ 334.028484] gitlab-workhorse[817]: time="2026-08-20T06:14:46Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=4181749gitlab # [ 334.031618] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/20:06:14:46 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 418 "" "git/2.55.0" 941750gitlab # [ 334.034981] gitaly[891]: time="2026-08-20T06:14:46.890Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=15 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1133 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=0 command.system_time_ms=12 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M0EWXJRCJA0T7JZQZDTTR44K grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T06:14:46.871" grpc.time_ms=19.447 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc1751gitlab # [ 334.127545] gitaly[891]: time="2026-08-20T06:14:47.035Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=579 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=1 command.system_time_ms=12 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EWXJXCAKWFRDEN2SJW1QN1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=186 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T06:14:47.018" grpc.time_ms=16.744 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc1752gitlab # [ 334.158260] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/20:06:14:47 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 791753gitlab # [ 334.240631] gitaly[891]: time="2026-08-20T06:14:47.147Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0EWXJZYDM4SZMZ8TCWSSSXY grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T06:14:47.128" pid=891 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc1754gitlab # [ 334.252550] gitaly[891]: time="2026-08-20T06:14:47.148Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=583 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=9 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M0EWXJZYDM4SZMZ8TCWSSSXY grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T06:14:47.128" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc1755gitlab # [ 334.266574] gitlab-workhorse[817]: time="2026-08-20T06:14:47Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671756gitlab # [ 334.268537] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/20:06:14:47 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 1111757gitlab # [ 334.270423] gitaly[891]: time="2026-08-20T06:14:47.148Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=583 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=9 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M0EWXJZYDM4SZMZ8TCWSSSXY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T06:14:47.128" grpc.time_ms=19.814 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc1758gitlab # [ 334.373743] gitaly[891]: time="2026-08-20T06:14:47.281Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=580 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=0 command.system_time_ms=9 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EWXK5GZPS00Y01525HKPJ7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=186 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T06:14:47.268" grpc.time_ms=12.991 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc1759gitlab # [ 334.387617] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/20:06:14:47 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 651760gitlab # [ 334.524578] gitaly[891]: time="2026-08-20T06:14:47.432Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0EWXK7N8XSRPMN8NFQ3K4TX grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T06:14:47.396" pid=891 remote_ip="2001:db8:1::1" request_sha=fb62c37b60b550dd367e34acce88d0d3e3444d95 response_bytes=209 span.kind=server system=grpc1761gitlab # [ 334.555874] gitaly[891]: time="2026-08-20T06:14:47.432Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=30 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1102 command.oublock=0 command.real_time_ms=31 command.spawn_token_fork_ms=2 command.system_time_ms=27 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M0EWXK7N8XSRPMN8NFQ3K4TX grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T06:14:47.396" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc1762gitlab # [ 334.590398] gitlab-workhorse[817]: time="2026-08-20T06:14:47Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2091763gitlab # [ 334.594265] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/20:06:14:47 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 209 "" "git/2.55.0" 1471764gitlab # [ 334.597955] gitaly[891]: time="2026-08-20T06:14:47.432Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=30 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1102 command.oublock=0 command.real_time_ms=31 command.spawn_token_fork_ms=2 command.system_time_ms=27 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M0EWXK7N8XSRPMN8NFQ3K4TX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T06:14:47.396" grpc.time_ms=36.16 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc1765gitlab # [ 334.739170] gitaly[891]: time="2026-08-20T06:14:47.646Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EWXKF50DH4483AQ27VZBX0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T06:15:17.544" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:14:47.645" grpc.time_ms=1.269 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1766gitlab # [ 334.812964] gitaly[891]: time="2026-08-20T06:14:47.720Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=15 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=590 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=2 command.system_time_ms=15 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EWXKF50DH4483AQ27VZBX0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-08-20T06:15:17.600" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T06:14:47.701" grpc.time_ms=19.235 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1767gitlab # [ 334.862252] gitaly[891]: time="2026-08-20T06:14:47.769Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EWXKF50DH4483AQ27VZBX0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T06:14:57.242" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T06:14:47.753" grpc.time_ms=15.028 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1768gitlab # [ 334.895762] gitaly[891]: time="2026-08-20T06:14:47.796Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=4 component=gitaly.StreamServerInterceptor correlation_id=01M0EWXKF50DH4483AQ27VZBX0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T06:14:57.273" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T06:14:47.784" grpc.time_ms=12.564 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1769gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce'1770gitlab # [ 335.020577] nixbot[3496]: INFO: ::ffff:127.0.0.1:57836 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce HTTP/1.1" 200 OK1771gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce', in 0.07 seconds)1772gitlab # [ 335.027929] gitaly[891]: time="2026-08-20T06:14:47.928Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0EWXKF50DH4483AQ27VZBX0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-08-20T06:14:57.007" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T06:14:47.928" grpc.time_ms=0.569 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1773gitlab # [ 335.057170] gitaly[891]: time="2026-08-20T06:14:47.960Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=2 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EWXKF50DH4483AQ27VZBX0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-08-20T06:14:57.026" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T06:14:47.947" grpc.time_ms=12.974 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1774gitlab # [ 335.121887] gitaly[891]: time="2026-08-20T06:14:48.029Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EWXKF50DH4483AQ27VZBX0 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4153 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T06:14:48.028" grpc.time_ms=0.949 pid=891 span.kind=server system=grpc1775gitlab # [ 335.170393] gitaly[891]: time="2026-08-20T06:14:48.078Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EWXKF50DH4483AQ27VZBX0 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4155 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T06:14:48.076" grpc.time_ms=1.043 pid=891 span.kind=server system=grpc1776gitlab # [ 335.202826] gitaly[891]: time="2026-08-20T06:14:48.110Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0EWXKF50DH4483AQ27VZBX0 diskcache=d5c94ba6-bd9e-4282-a874-f162262e9525 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-20T06:14:57.003" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T06:14:47.964" pid=891 ref=refs/keep-around/92dfd74e77b6613ee4cddec9d52e931532f92008 remote_ip="2001:db8:1::1" revision=92dfd74e77b6613ee4cddec9d52e931532f92008 span.kind=server system=grpc username=root1777gitlab # [ 335.229674] gitaly[891]: time="2026-08-20T06:14:48.111Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=121 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5096 command.oublock=8 command.real_time_ms=123 command.spawn_token_fork_ms=2 command.system_time_ms=66 command.user_time_ms=55 component=gitaly.UnaryServerInterceptor correlation_id=01M0EWXKF50DH4483AQ27VZBX0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-20T06:14:57.003" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T06:14:47.964" grpc.time_ms=146.22 pid=891 ref=refs/keep-around/92dfd74e77b6613ee4cddec9d52e931532f92008 remote_ip="2001:db8:1::1" revision=92dfd74e77b6613ee4cddec9d52e931532f92008 span.kind=server system=grpc username=root1778gitlab # [ 335.254559] gitaly[891]: time="2026-08-20T06:14:48.118Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EWXKF50DH4483AQ27VZBX0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T06:15:18.016" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:14:48.117" grpc.time_ms=0.895 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1779gitlab # [ 335.568695] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/20:06:14:48 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/92dfd74e77b6613ee4cddec9d52e931532f92008 HTTP/1.1" 201 631 "" "python-httpx/0.28.1" 9491780gitlab # [ 335.576871] nixbot[3496]: {"ts": "2026-08-20T06:14:48.476Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/92dfd74e77b6613ee4cddec9d52e931532f92008 \"HTTP/1.1 201 Created\""}1781gitlab # [ 335.585587] nixbot[3496]: {"ts": "2026-08-20T06:14:48.488Z", "level": "info", "logger": "nixbot.flake_prefetch", "msg": "prefetching flake inputs", "flake_dir": "/var/lib/nixbot/worktrees/1-92dfd74e77b6-0"}1782gitlab # [ 335.695775] systemd[1]: Started Nix Daemon.1783gitlab # [ 335.807258] nix-daemon[3712]: accepted connection from pid 3706, user nixbot1784gitlab # [ 335.919445] nix-daemon[3712]: accepted connection from pid 3719, user nixbot1785gitlab # [ 335.941341] nixbot[3496]: {"ts": "2026-08-20T06:14:48.848Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-92dfd74e77b6-0", "argv0": "bwrap"}1786gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce'1787gitlab # [ 336.093339] nixbot[3496]: INFO: ::ffff:127.0.0.1:57846 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce HTTP/1.1" 200 OK1788gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce', in 0.07 seconds)1789gitlab # [ 336.155853] nix-daemon[3712]: accepted connection from pid 3729, user nixbot1790gitlab # [ 336.239135] nix-daemon[3712]: accepted connection from pid 3742, user nixbot1791gitlab # [ 336.267145] nix-daemon[3712]: accepted connection from pid 3729, user nixbot1792gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce'1793gitlab # [ 337.154734] nixbot[3496]: INFO: ::ffff:127.0.0.1:57862 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce HTTP/1.1" 200 OK1794gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce', in 0.06 seconds)1795gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce'1796gitlab # [ 338.210228] nixbot[3496]: INFO: ::ffff:127.0.0.1:57872 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce HTTP/1.1" 200 OK1797gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce', in 0.05 seconds)1798gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce'1799gitlab # [ 339.266222] nixbot[3496]: INFO: ::ffff:127.0.0.1:57874 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce HTTP/1.1" 200 OK1800gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce', in 0.06 seconds)1801gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce'1802gitlab # [ 340.321458] nixbot[3496]: INFO: ::ffff:127.0.0.1:57888 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce HTTP/1.1" 200 OK1803gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce', in 0.06 seconds)1804gitlab # [ 340.926409] gitaly[891]: time="2026-08-20T06:14:53.832Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EWXSGENA6Y0JTBX86ZRES5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T06:15:23.730" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:14:53.831" grpc.time_ms=1.195 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1805gitlab # [ 341.139573] gitaly[891]: time="2026-08-20T06:14:54.047Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M0EWXSGENA6Y0JTBX86ZRES5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T06:15:04.007" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T06:14:54.028" grpc.time_ms=18.627 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1806gitlab # [ 341.215534] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/20:06:14:54 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/92dfd74e77b6613ee4cddec9d52e931532f92008 HTTP/1.1" 201 669 "" "python-httpx/0.28.1" 4101807gitlab # [ 341.224567] nixbot[3496]: {"ts": "2026-08-20T06:14:54.123Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/92dfd74e77b6613ee4cddec9d52e931532f92008 \"HTTP/1.1 201 Created\""}1808gitlab # [ 341.286880] gitaly[891]: time="2026-08-20T06:14:54.194Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EWXSXG2TTKBCSGXAS4SHD3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T06:15:24.092" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:14:54.192" grpc.time_ms=1.156 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1809gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce'1810gitlab # [ 341.344229] gitaly[891]: time="2026-08-20T06:14:54.251Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=6 component=gitaly.StreamServerInterceptor correlation_id=01M0EWXSXG2TTKBCSGXAS4SHD3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T06:15:04.215" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T06:14:54.236" grpc.time_ms=15.211 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1811gitlab # [ 341.389607] nixbot[3496]: INFO: ::ffff:127.0.0.1:44910 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce HTTP/1.1" 200 OK1812gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce', in 0.07 seconds)1813gitlab # [ 341.413430] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/20:06:14:54 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/92dfd74e77b6613ee4cddec9d52e931532f92008 HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 1921814gitlab # [ 341.422306] nixbot[3496]: {"ts": "2026-08-20T06:14:54.321Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/92dfd74e77b6613ee4cddec9d52e931532f92008 \"HTTP/1.1 201 Created\""}1815gitlab # [ 341.482943] gitaly[891]: time="2026-08-20T06:14:54.390Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EWXT3ZXKYF2K90GF7K02QK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T06:15:24.288" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:14:54.389" grpc.time_ms=1.134 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1816gitlab # [ 341.527488] gitaly[891]: time="2026-08-20T06:14:54.435Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=15 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=3 command.system_time_ms=15 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EWXT3ZXKYF2K90GF7K02QK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T06:15:04.236" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T06:14:54.416" grpc.time_ms=18.801 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1817gitlab # [ 341.579563] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/20:06:14:54 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/92dfd74e77b6613ee4cddec9d52e931532f92008 HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 1511818gitlab # [ 341.588142] nixbot[3496]: {"ts": "2026-08-20T06:14:54.489Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/92dfd74e77b6613ee4cddec9d52e931532f92008 \"HTTP/1.1 201 Created\""}1819gitlab # [ 341.738465] nix-daemon[3712]: accepted connection from pid 3780, user nixbot1820gitlab # [ 341.941576] gitaly[891]: time="2026-08-20T06:14:54.847Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=579 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EWXTGAZ0T3NX9AEA0NQ279 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=192 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T06:14:54.829" grpc.time_ms=18.195 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc1821gitlab # [ 341.979413] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/20:06:14:54 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 1191822gitlab # [ 342.055523] gitaly[891]: time="2026-08-20T06:14:54.962Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0EWXTM4CSASJJ4KZNNE630V grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T06:14:54.943" pid=891 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc1823gitlab # [ 342.087145] gitaly[891]: time="2026-08-20T06:14:54.962Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M0EWXTM4CSASJJ4KZNNE630V grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T06:14:54.943" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc1824gitlab # [ 342.115075] gitaly[891]: time="2026-08-20T06:14:54.994Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M0EWXTM4CSASJJ4KZNNE630V grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T06:14:54.943" grpc.time_ms=19.897 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc1825gitlab # [ 342.136369] gitlab-workhorse[817]: time="2026-08-20T06:14:54Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671826gitlab # [ 342.138690] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/20:06:14:54 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 1421827gitlab # [ 342.256120] nix-daemon[3712]: accepted connection from pid 3805, user nixbot1828gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce'1829gitlab # [ 342.467938] nixbot[3496]: INFO: ::ffff:127.0.0.1:44918 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce HTTP/1.1" 200 OK1830gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce', in 0.08 seconds)1831gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce'1832gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce', in 0.05 seconds)1833gitlab # [ 343.524085] nixbot[3496]: INFO: ::ffff:127.0.0.1:44928 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce HTTP/1.1" 200 OK1834gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce'1835gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce', in 0.05 seconds)1836gitlab # [ 344.577112] nixbot[3496]: INFO: ::ffff:127.0.0.1:44938 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce HTTP/1.1" 200 OK1837gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce'1838gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce', in 0.05 seconds)1839gitlab # [ 345.630364] nixbot[3496]: INFO: ::ffff:127.0.0.1:44948 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce HTTP/1.1" 200 OK1840gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce'1841gitlab # [ 346.685126] nixbot[3496]: INFO: ::ffff:127.0.0.1:44950 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce HTTP/1.1" 200 OK1842gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce', in 0.06 seconds)1843gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce'1844gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce', in 0.05 seconds)1845gitlab # [ 347.741069] nixbot[3496]: INFO: ::ffff:127.0.0.1:44962 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce HTTP/1.1" 200 OK1846gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce'1847gitlab # [ 348.794717] nixbot[3496]: INFO: ::ffff:127.0.0.1:44968 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce HTTP/1.1" 200 OK1848gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce', in 0.06 seconds)1849gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce'1850gitlab # [ 349.849993] nixbot[3496]: INFO: ::ffff:127.0.0.1:44972 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce HTTP/1.1" 200 OK1851gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce', in 0.05 seconds)1852gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce'1853gitlab # [ 350.905329] nixbot[3496]: INFO: ::ffff:127.0.0.1:37610 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce HTTP/1.1" 200 OK1854gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce', in 0.05 seconds)1855gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce'1856gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce', in 0.05 seconds)1857gitlab # [ 351.959633] nixbot[3496]: INFO: ::ffff:127.0.0.1:37624 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce HTTP/1.1" 200 OK1858gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce'1859gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce', in 0.05 seconds)1860gitlab # [ 353.012882] nixbot[3496]: INFO: ::ffff:127.0.0.1:37640 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce HTTP/1.1" 200 OK1861gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce'1862gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce', in 0.05 seconds)1863gitlab # [ 354.065487] nixbot[3496]: INFO: ::ffff:127.0.0.1:37648 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce HTTP/1.1" 200 OK1864gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce'1865gitlab # [ 355.118454] nixbot[3496]: INFO: ::ffff:127.0.0.1:37650 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce HTTP/1.1" 200 OK1866gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce', in 0.06 seconds)1867gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce'1868gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce', in 0.05 seconds)1869gitlab # [ 356.175153] nixbot[3496]: INFO: ::ffff:127.0.0.1:37660 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce HTTP/1.1" 200 OK1870gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce'1871gitlab # [ 357.226841] nixbot[3496]: INFO: ::ffff:127.0.0.1:37672 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce HTTP/1.1" 200 OK1872gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce', in 0.06 seconds)1873gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce'1874gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce', in 0.05 seconds)1875gitlab # [ 358.283021] nixbot[3496]: INFO: ::ffff:127.0.0.1:37684 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce HTTP/1.1" 200 OK1876gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce'1877gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce', in 0.05 seconds)1878gitlab # [ 359.336885] nixbot[3496]: INFO: ::ffff:127.0.0.1:37690 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce HTTP/1.1" 200 OK1879gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce'1880gitlab # [ 360.391192] nixbot[3496]: INFO: ::ffff:127.0.0.1:37692 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce HTTP/1.1" 200 OK1881gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce', in 0.06 seconds)1882gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce'1883gitlab # [ 361.447981] nixbot[3496]: INFO: ::ffff:127.0.0.1:41822 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce HTTP/1.1" 200 OK1884gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce', in 0.06 seconds)1885gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce'1886gitlab # [ 362.503777] nixbot[3496]: INFO: ::ffff:127.0.0.1:41838 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce HTTP/1.1" 200 OK1887gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce', in 0.06 seconds)1888gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce'1889gitlab # [ 363.559958] nixbot[3496]: INFO: ::ffff:127.0.0.1:41840 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce HTTP/1.1" 200 OK1890gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce', in 0.06 seconds)1891gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce'1892gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce', in 0.05 seconds)1893gitlab # [ 364.614881] nixbot[3496]: INFO: ::ffff:127.0.0.1:41846 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce HTTP/1.1" 200 OK1894gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce'1895gitlab # [ 365.666445] nixbot[3496]: INFO: ::ffff:127.0.0.1:41856 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce HTTP/1.1" 200 OK1896gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce', in 0.05 seconds)1897gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce'1898gitlab # [ 366.722920] nixbot[3496]: INFO: ::ffff:127.0.0.1:41864 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce HTTP/1.1" 200 OK1899gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce', in 0.06 seconds)1900gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce'1901gitlab # [ 367.778986] nixbot[3496]: INFO: ::ffff:127.0.0.1:41872 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce HTTP/1.1" 200 OK1902gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce', in 0.05 seconds)1903gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce'1904gitlab # [ 368.833677] nixbot[3496]: INFO: ::ffff:127.0.0.1:41874 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce HTTP/1.1" 200 OK1905gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce', in 0.06 seconds)1906gitlab # [ 369.071803] sidekiq-cluster[3466]: 2026-08-20T06:15:21.978Z pid=3466 tid=yle INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>3466, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>430084096}1907gitlab # [ 369.349272] sidekiq-cluster[3466]: W, [2026-08-20T06:15:22.256937 #3466] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1908gitlab # [ 369.412123] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-20T06:15:22.319Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"}1909gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce'1910gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce', in 0.05 seconds)1911gitlab # [ 369.889884] nixbot[3496]: INFO: ::ffff:127.0.0.1:41884 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce HTTP/1.1" 200 OK1912gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce'1913gitlab # [ 370.942841] nixbot[3496]: INFO: ::ffff:127.0.0.1:52852 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce HTTP/1.1" 200 OK1914gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce', in 0.06 seconds)1915gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce'1916gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce', in 0.05 seconds)1917gitlab # [ 371.999274] nixbot[3496]: INFO: ::ffff:127.0.0.1:52866 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce HTTP/1.1" 200 OK1918gitlab # [ 372.861349] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-20T06:15:25.767Z","message":"GitLab reliable fetch activated!"}1919gitlab # [ 372.861739] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-20T06:15:25.768Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1920gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce'1921gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce', in 0.05 seconds)1922gitlab # [ 373.052151] nixbot[3496]: INFO: ::ffff:127.0.0.1:52874 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce HTTP/1.1" 200 OK1923gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce'1924gitlab # [ 374.106738] nixbot[3496]: INFO: ::ffff:127.0.0.1:52888 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce HTTP/1.1" 200 OK1925gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce', in 0.06 seconds)1926gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce'1927gitlab # [ 375.162751] nixbot[3496]: INFO: ::ffff:127.0.0.1:52890 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce HTTP/1.1" 200 OK1928gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce', in 0.06 seconds)1929gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce'1930gitlab # [ 376.218713] nixbot[3496]: INFO: ::ffff:127.0.0.1:52894 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce HTTP/1.1" 200 OK1931gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce', in 0.06 seconds)1932gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce'1933gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce', in 0.05 seconds)1934gitlab # [ 377.273655] nixbot[3496]: INFO: ::ffff:127.0.0.1:52904 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce HTTP/1.1" 200 OK1935gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce'1936gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce', in 0.05 seconds)1937gitlab # [ 378.326866] nixbot[3496]: INFO: ::ffff:127.0.0.1:52908 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce HTTP/1.1" 200 OK1938gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce'1939gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce', in 0.05 seconds)1940gitlab # [ 379.380210] nixbot[3496]: INFO: ::ffff:127.0.0.1:52916 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce HTTP/1.1" 200 OK1941gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce'1942gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce', in 0.05 seconds)1943gitlab # [ 380.432541] nixbot[3496]: INFO: ::ffff:127.0.0.1:52926 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce HTTP/1.1" 200 OK1944gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce'1945gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce', in 0.05 seconds)1946gitlab # [ 381.483748] nixbot[3496]: INFO: ::ffff:127.0.0.1:58650 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce HTTP/1.1" 200 OK1947gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce'1948gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce', in 0.05 seconds)1949gitlab # [ 382.535998] nixbot[3496]: INFO: ::ffff:127.0.0.1:58654 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce HTTP/1.1" 200 OK1950gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce'1951gitlab # [ 383.588710] nixbot[3496]: INFO: ::ffff:127.0.0.1:58664 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce HTTP/1.1" 200 OK1952gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce', in 0.06 seconds)1953gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce'1954gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce', in 0.05 seconds)1955gitlab # [ 384.645449] nixbot[3496]: INFO: ::ffff:127.0.0.1:58668 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce HTTP/1.1" 200 OK1956gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce'1957gitlab # [ 385.698292] nixbot[3496]: INFO: ::ffff:127.0.0.1:58684 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce HTTP/1.1" 200 OK1958gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce', in 0.06 seconds)1959gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce'1960gitlab # [ 386.754640] nixbot[3496]: INFO: ::ffff:127.0.0.1:58694 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce HTTP/1.1" 200 OK1961gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce', in 0.06 seconds)1962gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce'1963gitlab # [ 387.812696] nixbot[3496]: INFO: ::ffff:127.0.0.1:58704 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce HTTP/1.1" 200 OK1964gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce', in 0.05 seconds)1965gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce'1966gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce', in 0.05 seconds)1967gitlab # [ 388.867468] nixbot[3496]: INFO: ::ffff:127.0.0.1:58720 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce HTTP/1.1" 200 OK1968gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce'1969gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce', in 0.05 seconds)1970gitlab # [ 389.919970] nixbot[3496]: INFO: ::ffff:127.0.0.1:58722 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce HTTP/1.1" 200 OK1971gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce'1972gitlab # [ 390.973013] nixbot[3496]: INFO: ::ffff:127.0.0.1:59968 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce HTTP/1.1" 200 OK1973gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce', in 0.06 seconds)1974gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce'1975gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce', in 0.05 seconds)1976gitlab # [ 392.030754] nixbot[3496]: INFO: ::ffff:127.0.0.1:59984 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce HTTP/1.1" 200 OK1977gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce'1978gitlab # [ 393.082722] nixbot[3496]: INFO: ::ffff:127.0.0.1:59996 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce HTTP/1.1" 200 OK1979gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce', in 0.05 seconds)1980gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce'1981gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce', in 0.05 seconds)1982gitlab # [ 394.140266] nixbot[3496]: INFO: ::ffff:127.0.0.1:60010 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce HTTP/1.1" 200 OK1983gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce'1984gitlab # [ 395.192517] nixbot[3496]: INFO: ::ffff:127.0.0.1:60022 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce HTTP/1.1" 200 OK1985gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce', in 0.05 seconds)1986gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce'1987gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce', in 0.05 seconds)1988gitlab # [ 396.248529] nixbot[3496]: INFO: ::ffff:127.0.0.1:60028 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce HTTP/1.1" 200 OK1989gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce'1990gitlab # [ 397.302086] nixbot[3496]: INFO: ::ffff:127.0.0.1:60044 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce HTTP/1.1" 200 OK1991gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce', in 0.06 seconds)1992gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce'1993gitlab # [ 398.357512] nixbot[3496]: INFO: ::ffff:127.0.0.1:60050 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce HTTP/1.1" 200 OK1994gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce', in 0.06 seconds)1995gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce'1996gitlab # [ 399.412794] nixbot[3496]: INFO: ::ffff:127.0.0.1:60062 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce HTTP/1.1" 200 OK1997gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce', in 0.06 seconds)1998gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce'1999gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce', in 0.05 seconds)2000gitlab # [ 400.469336] nixbot[3496]: INFO: ::ffff:127.0.0.1:60076 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce HTTP/1.1" 200 OK2001gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce'2002gitlab # [ 401.522879] nixbot[3496]: INFO: ::ffff:127.0.0.1:33490 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce HTTP/1.1" 200 OK2003gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce', in 0.06 seconds)2004gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce'2005gitlab # [ 402.578789] nixbot[3496]: INFO: ::ffff:127.0.0.1:33492 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce HTTP/1.1" 200 OK2006gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce', in 0.05 seconds)2007gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce'2008gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce', in 0.05 seconds)2009gitlab # [ 403.634577] nixbot[3496]: INFO: ::ffff:127.0.0.1:33496 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce HTTP/1.1" 200 OK2010gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce'2011gitlab # [ 404.687670] nixbot[3496]: INFO: ::ffff:127.0.0.1:33502 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce HTTP/1.1" 200 OK2012gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce', in 0.06 seconds)2013gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce'2014gitlab # [ 405.742649] nixbot[3496]: INFO: ::ffff:127.0.0.1:33506 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce HTTP/1.1" 200 OK2015gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce', in 0.05 seconds)2016gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce'2017gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce', in 0.06 seconds)2018gitlab # [ 406.801419] nixbot[3496]: INFO: ::ffff:127.0.0.1:33522 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce HTTP/1.1" 200 OK2019gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce'2020gitlab # [ 407.856359] nixbot[3496]: INFO: ::ffff:127.0.0.1:33536 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce HTTP/1.1" 200 OK2021gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce', in 0.06 seconds)2022gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce'2023gitlab # [ 408.913704] nixbot[3496]: INFO: ::ffff:127.0.0.1:33542 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce HTTP/1.1" 200 OK2024gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce', in 0.06 seconds)2025gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce'2026gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce', in 0.05 seconds)2027gitlab # [ 409.973360] nixbot[3496]: INFO: ::ffff:127.0.0.1:33546 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce HTTP/1.1" 200 OK2028gitlab # [ 410.833603] postgres[4028]: [4028] ERROR: relation "table_without_models" does not exist2029gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce'2030gitlab # [ 410.836449] postgres[4028]: [4028] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')2031gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce', in 0.05 seconds)2032gitlab # [ 411.026938] nixbot[3496]: INFO: ::ffff:127.0.0.1:49972 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce HTTP/1.1" 200 OK2033gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce'2034gitlab # [ 412.081751] nixbot[3496]: INFO: ::ffff:127.0.0.1:49982 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce HTTP/1.1" 200 OK2035gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce', in 0.06 seconds)2036gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce'2037gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce', in 0.05 seconds)2038gitlab # [ 413.136995] nixbot[3496]: INFO: ::ffff:127.0.0.1:49998 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce HTTP/1.1" 200 OK2039gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce'2040gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce', in 0.05 seconds)2041gitlab # [ 414.188466] nixbot[3496]: INFO: ::ffff:127.0.0.1:50002 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce HTTP/1.1" 200 OK2042gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce'2043gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce', in 0.05 seconds)2044gitlab # [ 415.241591] nixbot[3496]: INFO: ::ffff:127.0.0.1:50018 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce HTTP/1.1" 200 OK2045gitlab # [ 415.639731] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-20T06:16:08.546Z","message":"Booted Rails 7.2.3.1 application in production environment"}2046gitlab # [ 415.644538] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-20T06:16:08.552Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [aarch64-linux]"}2047gitlab # [ 415.646706] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-20T06:16:08.554Z","message":"See LICENSE and the LGPL-3.0 for licensing details."}2048gitlab # [ 415.649082] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-20T06:16:08.556Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"}2049gitlab # [ 415.651738] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-20T06:16:08.559Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}2050gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce'2051gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce', in 0.05 seconds)2052gitlab # [ 416.295618] nixbot[3496]: INFO: ::ffff:127.0.0.1:50034 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce HTTP/1.1" 200 OK2053gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce'2054gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce', in 0.05 seconds)2055gitlab # [ 417.349541] nixbot[3496]: INFO: ::ffff:127.0.0.1:50044 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce HTTP/1.1" 200 OK2056gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce'2057gitlab # [ 418.368574] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-20T06:16:11.273Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"e21d1ab1fb9279eaf982d219","created_at":"2026-08-20T06:14:38.309Z","trace_propagation_headers":{"sentry-trace":"d35a50d09d4f4e33852ae0abf2bff393-083506e54cd64be2","baggage":"sentry-trace_id=d35a50d09d4f4e33852ae0abf2bff393,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EWX8B4AWG8VJ9DGG1G6W64","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-08-20T06:14:38.350Z","job_size_bytes":2,"pid":3466,"sidekiq_tid":"m8rm","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-e21d1ab1fb9279eaf982d219: start","job_status":"start","queue_duration_s":92.922508,"scheduling_latency_s":92.922609}2058gitlab # [ 418.399120] nixbot[3496]: INFO: ::ffff:127.0.0.1:50048 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce HTTP/1.1" 200 OK2059gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce', in 0.05 seconds)2060gitlab # [ 418.752538] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-20T06:16:11.659Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"e21d1ab1fb9279eaf982d219","created_at":"2026-08-20T06:14:38.309Z","trace_propagation_headers":{"sentry-trace":"d35a50d09d4f4e33852ae0abf2bff393-083506e54cd64be2","baggage":"sentry-trace_id=d35a50d09d4f4e33852ae0abf2bff393,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EWX8B4AWG8VJ9DGG1G6W64","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-08-20T06:14:38.350Z","job_size_bytes":2,"pid":3466,"sidekiq_tid":"m8rm","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-e21d1ab1fb9279eaf982d219: done: 0.385939 sec","job_status":"done","queue_duration_s":92.922508,"scheduling_latency_s":92.922609,"redis_calls":23,"redis_duration_s":0.010423,"redis_read_bytes":910,"redis_write_bytes":2540,"redis_feature_flag_calls":13,"redis_feature_flag_duration_s":0.00567,"redis_feature_flag_read_bytes":902,"redis_feature_flag_write_bytes":1375,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002694,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":606,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002059,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":559,"db_count":10,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":10,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.023,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":9,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.02,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.201921,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.19875142,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.385939,"completed_at":"2026-08-20T06:16:11.659Z","load_balancing_strategy":"primary","db_duration_s":0.10587,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2061gitlab # [ 418.853227] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-20T06:16:11.662Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"9270abf1c7e2353ab07e7dbd","created_at":"2026-08-20T06:14:38.367Z","trace_propagation_headers":{"sentry-trace":"d35a50d09d4f4e33852ae0abf2bff393-083506e54cd64be2","baggage":"sentry-trace_id=d35a50d09d4f4e33852ae0abf2bff393,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EWX8B4AWG8VJ9DGG1G6W64","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-08-20T06:14:38.374Z","job_size_bytes":2,"pid":3466,"sidekiq_tid":"m8rm","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-9270abf1c7e2353ab07e7dbd: start","job_status":"start","queue_duration_s":93.287604,"scheduling_latency_s":93.287642}2062gitlab # [ 418.937168] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-20T06:16:11.844Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"9270abf1c7e2353ab07e7dbd","created_at":"2026-08-20T06:14:38.367Z","trace_propagation_headers":{"sentry-trace":"d35a50d09d4f4e33852ae0abf2bff393-083506e54cd64be2","baggage":"sentry-trace_id=d35a50d09d4f4e33852ae0abf2bff393,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EWX8B4AWG8VJ9DGG1G6W64","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-08-20T06:14:38.374Z","job_size_bytes":2,"pid":3466,"sidekiq_tid":"m8rm","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-9270abf1c7e2353ab07e7dbd: done: 0.182004 sec","job_status":"done","queue_duration_s":93.287604,"scheduling_latency_s":93.287642,"redis_calls":14,"redis_duration_s":0.005303,"redis_read_bytes":140,"redis_write_bytes":1653,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.00104,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":422,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002654,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":680,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001609,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":551,"db_count":8,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.018,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.014,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.134861,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.13897679999999998,"extra.projects_process_sync_events_worker.estimated_total_events":1,"extra.projects_process_sync_events_worker.consumable_events":1,"extra.projects_process_sync_events_worker.processed_events":1,"duration_s":0.182004,"completed_at":"2026-08-20T06:16:11.844Z","load_balancing_strategy":"primary","db_duration_s":0.035875,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2063gitlab # [ 419.036903] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-20T06:16:11.846Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"899b8f962f5231814f650f6d","created_at":"2026-08-20T06:14:39.000Z","trace_propagation_headers":{"sentry-trace":"d35a50d09d4f4e33852ae0abf2bff393-083506e54cd64be2","baggage":"sentry-trace_id=d35a50d09d4f4e33852ae0abf2bff393,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EWX8B4AWG8VJ9DGG1G6W64","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-08-20T06:14:39.009Z","job_size_bytes":5,"pid":3466,"sidekiq_tid":"m8rm","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-899b8f962f5231814f650f6d: start","job_status":"start","queue_duration_s":92.837715,"scheduling_latency_s":92.837745}2064gitlab # [ 419.236977] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-20T06:16:12.143Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"899b8f962f5231814f650f6d","created_at":"2026-08-20T06:14:39.000Z","trace_propagation_headers":{"sentry-trace":"d35a50d09d4f4e33852ae0abf2bff393-083506e54cd64be2","baggage":"sentry-trace_id=d35a50d09d4f4e33852ae0abf2bff393,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EWX8B4AWG8VJ9DGG1G6W64","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-08-20T06:14:39.009Z","job_size_bytes":5,"pid":3466,"sidekiq_tid":"m8rm","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-899b8f962f5231814f650f6d: done: 0.297 sec","job_status":"done","queue_duration_s":92.837715,"scheduling_latency_s":92.837745,"redis_calls":12,"redis_duration_s":0.004064,"redis_read_bytes":138,"redis_write_bytes":1541,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000915,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":491,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002566,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":784,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000583,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":14,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":14,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.026,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.026,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.243552,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00051606,"duration_s":0.297,"completed_at":"2026-08-20T06:16:12.143Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.045048,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2065gitlab # [ 419.336468] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-20T06:16:12.146Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"93dd5b2e07cff8949322d574","created_at":"2026-08-20T06:14:39.065Z","trace_propagation_headers":{"sentry-trace":"d35a50d09d4f4e33852ae0abf2bff393-083506e54cd64be2","baggage":"sentry-trace_id=d35a50d09d4f4e33852ae0abf2bff393,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EWX8B4AWG8VJ9DGG1G6W64","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-08-20T06:14:39.077Z","job_size_bytes":3,"pid":3466,"sidekiq_tid":"m8rm","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-93dd5b2e07cff8949322d574: start","job_status":"start","queue_duration_s":93.069001,"scheduling_latency_s":93.06903}2066gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce'2067gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce', in 0.06 seconds)2068gitlab # [ 419.458760] nixbot[3496]: INFO: ::ffff:127.0.0.1:50064 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce HTTP/1.1" 200 OK2069gitlab # [ 419.690337] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-20T06:16:12.595Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"93dd5b2e07cff8949322d574","created_at":"2026-08-20T06:14:39.065Z","trace_propagation_headers":{"sentry-trace":"d35a50d09d4f4e33852ae0abf2bff393-083506e54cd64be2","baggage":"sentry-trace_id=d35a50d09d4f4e33852ae0abf2bff393,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EWX8B4AWG8VJ9DGG1G6W64","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-08-20T06:14:39.077Z","job_size_bytes":3,"pid":3466,"sidekiq_tid":"m8rm","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-93dd5b2e07cff8949322d574: done: 0.449788 sec","job_status":"done","queue_duration_s":93.069001,"scheduling_latency_s":93.06903,"redis_calls":11,"redis_duration_s":0.004125,"redis_read_bytes":137,"redis_write_bytes":1147,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.001005,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":407,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00232,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":538,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.0008,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":202,"db_count":35,"db_write_count":6,"db_cached_count":2,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":35,"db_replica_write_count":0,"db_primary_write_count":6,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.048,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":34,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":6,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":2,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.386,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.386,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.046,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.327891,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00086216,"duration_s":0.449788,"completed_at":"2026-08-20T06:16:12.595Z","load_balancing_strategy":"primary","db_duration_s":0.132156,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2070gitlab # [ 419.788901] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-20T06:16:12.599Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"dcb276c63a70d634804ca124","created_at":"2026-08-20T06:14:39.085Z","trace_propagation_headers":{"sentry-trace":"d35a50d09d4f4e33852ae0abf2bff393-083506e54cd64be2","baggage":"sentry-trace_id=d35a50d09d4f4e33852ae0abf2bff393,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EWX8B4AWG8VJ9DGG1G6W64","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-08-20T06:14:39.098Z","job_size_bytes":89,"pid":3466,"sidekiq_tid":"m8rm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-dcb276c63a70d634804ca124: start","job_status":"start","queue_duration_s":93.500832,"scheduling_latency_s":93.500869}2071gitlab # [ 419.812354] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-20T06:16:12.666Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"dcb276c63a70d634804ca124","created_at":"2026-08-20T06:14:39.085Z","trace_propagation_headers":{"sentry-trace":"d35a50d09d4f4e33852ae0abf2bff393-083506e54cd64be2","baggage":"sentry-trace_id=d35a50d09d4f4e33852ae0abf2bff393,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EWX8B4AWG8VJ9DGG1G6W64","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-08-20T06:14:39.098Z","job_size_bytes":89,"pid":3466,"sidekiq_tid":"m8rm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-dcb276c63a70d634804ca124: done: 0.067844 sec","job_status":"done","queue_duration_s":93.500832,"scheduling_latency_s":93.500869,"redis_calls":11,"redis_duration_s":0.003987,"redis_read_bytes":137,"redis_write_bytes":1267,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.00115,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":443,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002114,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":594,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000723,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":230,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.044875,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0006824,"duration_s":0.067844,"completed_at":"2026-08-20T06:16:12.666Z","load_balancing_strategy":"primary","db_duration_s":0.010472,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2072gitlab # [ 419.867267] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-20T06:16:12.669Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 92dfd74e77b6613ee4cddec9d52e931532f92008 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"7a81952fd78761752d283915","created_at":"2026-08-20T06:14:41.478Z","trace_propagation_headers":{"sentry-trace":"181e69fd75be480b9a034892514ec20e-1c70b9d8d5474d55","baggage":"sentry-trace_id=181e69fd75be480b9a034892514ec20e,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EWXCJSMX4YSNV9GED54BJ5","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:14:41.488Z","job_size_bytes":185,"pid":3466,"sidekiq_tid":"m8rm","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-7a81952fd78761752d283915: start","job_status":"start","queue_duration_s":91.18117,"scheduling_latency_s":91.181199}2073gitlab # [ 419.884740] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-20T06:16:12.695Z","message":"changes: \"0000000000000000000000000000000000000000 92dfd74e77b6613ee4cddec9d52e931532f92008 refs/heads/master\\n\""}2074gitlab # [ 419.887686] gitaly[891]: time="2026-08-20T06:16:12.750Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EWXCJSMX4YSNV9GED54BJ5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T06:16:22.005" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T06:16:12.735" grpc.time_ms=14.174 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2075gitlab # [ 419.902576] gitaly[891]: time="2026-08-20T06:16:12.776Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=0 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EWXCJSMX4YSNV9GED54BJ5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-20T06:16:22.030" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T06:16:12.760" grpc.time_ms=15.795 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2076gitlab # [ 419.987073] gitaly[891]: time="2026-08-20T06:16:12.894Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=583 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=3 command.system_time_ms=6 command.user_time_ms=6 component=gitaly.StreamServerInterceptor correlation_id=01M0EWXCJSMX4YSNV9GED54BJ5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-08-20T06:16:22.143" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=266 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T06:16:12.873" grpc.time_ms=20.74 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2077gitlab # [ 420.071437] gitaly[891]: time="2026-08-20T06:16:12.979Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EWXCJSMX4YSNV9GED54BJ5 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3936 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T06:16:12.977" grpc.time_ms=1.337 pid=891 span.kind=server system=grpc2078gitlab # [ 420.129238] gitaly[891]: time="2026-08-20T06:16:13.036Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EWXCJSMX4YSNV9GED54BJ5 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3938 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T06:16:13.036" grpc.time_ms=0.739 pid=891 span.kind=server system=grpc2079gitlab # [ 420.152189] gitaly[891]: time="2026-08-20T06:16:13.051Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0EWXCJSMX4YSNV9GED54BJ5 diskcache=ef6e9f3d-e133-4e2c-87c9-2124c0688e82 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-20T06:16:22.183" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T06:16:12.914" pid=891 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root2080gitlab # [ 420.172081] gitaly[891]: time="2026-08-20T06:16:13.052Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=148 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5143 command.oublock=8 command.real_time_ms=131 command.spawn_token_fork_ms=1 command.system_time_ms=117 command.user_time_ms=31 component=gitaly.UnaryServerInterceptor correlation_id=01M0EWXCJSMX4YSNV9GED54BJ5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-20T06:16:22.183" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=148 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T06:16:12.914" grpc.time_ms=137.941 pid=891 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root2081gitlab # [ 420.192525] gitaly[891]: time="2026-08-20T06:16:13.081Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0EWXCJSMX4YSNV9GED54BJ5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-20T06:16:23.009" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T06:16:13.080" grpc.time_ms=0.318 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2082gitlab # [ 420.205863] gitaly[891]: time="2026-08-20T06:16:13.112Z" level=info msg="finished unary call with code OK" command.count=3 command.cpu_time_ms=18 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=858 command.oublock=0 command.real_time_ms=21 command.spawn_token_fork_ms=3 command.system_time_ms=12 command.user_time_ms=6 component=gitaly.UnaryServerInterceptor correlation_id=01M0EWXCJSMX4YSNV9GED54BJ5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-08-20T06:16:23.017" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T06:16:13.087" grpc.time_ms=24.857 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2083gitlab # [ 420.372735] gitaly[891]: time="2026-08-20T06:16:13.280Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=312 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=1 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EWXCJSMX4YSNV9GED54BJ5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindCommits grpc.request.deadline="2026-08-20T06:16:43.066" grpc.request.fullMethod=/gitaly.CommitService/FindCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=173 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:16:13.267" grpc.time_ms=12.521 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2084gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce'2085gitlab # [ 420.432848] gitaly[891]: time="2026-08-20T06:16:13.340Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0EWXCJSMX4YSNV9GED54BJ5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-08-20T06:16:23.268" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T06:16:13.339" grpc.time_ms=0.69 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2086gitlab # [ 420.468104] gitaly[891]: time="2026-08-20T06:16:13.356Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=315 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=1 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EWXCJSMX4YSNV9GED54BJ5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-08-20T06:16:23.274" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=112 grpc.service=gitaly.DiffService grpc.start_time="2026-08-20T06:16:13.344" grpc.time_ms=11.84 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2087gitlab # [ 420.502404] gitaly[891]: time="2026-08-20T06:16:13.410Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=19 command.spawn_token_fork_ms=2 command.system_time_ms=6 command.user_time_ms=8 component=gitaly.StreamServerInterceptor correlation_id=01M0EWXCJSMX4YSNV9GED54BJ5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T06:16:23.008" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T06:16:13.388" grpc.time_ms=21.089 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2088gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce', in 0.07 seconds)2089gitlab # [ 420.531958] nixbot[3496]: INFO: ::ffff:127.0.0.1:50078 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce HTTP/1.1" 200 OK2090gitlab # [ 420.536829] gitaly[891]: time="2026-08-20T06:16:13.444Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=4 command.system_time_ms=6 command.user_time_ms=7 component=gitaly.StreamServerInterceptor correlation_id=01M0EWXCJSMX4YSNV9GED54BJ5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T06:16:23.042" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T06:16:13.424" grpc.time_ms=19.335 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2091gitlab # [ 420.589110] gitaly[891]: time="2026-08-20T06:16:13.496Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=20 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=880 command.oublock=0 command.real_time_ms=23 command.spawn_token_fork_ms=3 command.system_time_ms=17 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M0EWXCJSMX4YSNV9GED54BJ5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-08-20T06:16:43.267" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=155 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=80 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:16:13.468" grpc.time_ms=28.291 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2092gitlab # [ 421.191907] gitaly[891]: time="2026-08-20T06:16:14.099Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EWXCJSMX4YSNV9GED54BJ5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-08-20T06:16:24.026" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:16:14.097" grpc.time_ms=1.701 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2093gitlab # [ 421.263104] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-20T06:16:14.168Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 92dfd74e77b6613ee4cddec9d52e931532f92008 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"7a81952fd78761752d283915","created_at":"2026-08-20T06:14:41.478Z","trace_propagation_headers":{"sentry-trace":"181e69fd75be480b9a034892514ec20e-1c70b9d8d5474d55","baggage":"sentry-trace_id=181e69fd75be480b9a034892514ec20e,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EWXCJSMX4YSNV9GED54BJ5","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:14:41.488Z","job_size_bytes":185,"pid":3466,"sidekiq_tid":"m8rm","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-7a81952fd78761752d283915: done: 1.499323 sec","job_status":"done","queue_duration_s":91.18117,"scheduling_latency_s":91.181199,"gitaly_calls":13,"gitaly_duration_s":0.374993,"redis_calls":198,"redis_allowed_cross_slot_calls":6,"redis_duration_s":0.064933,"redis_read_bytes":2103,"redis_write_bytes":21751,"redis_cache_calls":15,"redis_cache_duration_s":0.006028,"redis_cache_read_bytes":20,"redis_cache_write_bytes":991,"redis_feature_flag_calls":27,"redis_feature_flag_duration_s":0.008944,"redis_feature_flag_read_bytes":1678,"redis_feature_flag_write_bytes":3082,"redis_queues_calls":10,"redis_queues_duration_s":0.002343,"redis_queues_read_bytes":10,"redis_queues_write_bytes":7839,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.00515,"redis_queues_metadata_read_bytes":13,"redis_queues_metadata_write_bytes":1467,"redis_repository_cache_calls":90,"redis_repository_cache_allowed_cross_slot_calls":6,"redis_repository_cache_duration_s":0.027838,"redis_repository_cache_read_bytes":249,"redis_repository_cache_write_bytes":6237,"redis_shared_state_calls":46,"redis_shared_state_duration_s":0.01463,"redis_shared_state_read_bytes":133,"redis_shared_state_write_bytes":2135,"db_count":47,"db_write_count":8,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":47,"db_replica_write_count":0,"db_primary_write_count":8,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.091,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":47,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":8,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.33,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.378,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.091,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.975785,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00089508,"exclusive_lock_hold_duration_s":0.0415702,"duration_s":1.499323,"completed_at":"2026-08-20T06:16:14.168Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.15719,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2094gitlab # [ 421.341486] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-20T06:16:14.172Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","92dfd74e77b6613ee4cddec9d52e931532f92008 1ec92181522c6d831f5b4109cbf4ce466fbfedce refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"30dc6434c5cd50e912c1dd95","created_at":"2026-08-20T06:14:46.650Z","trace_propagation_headers":{"sentry-trace":"7429d374967043b8bb266ead30e0bef7-18694807bc444468","baggage":"sentry-trace_id=7429d374967043b8bb266ead30e0bef7,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EWXJ3WG3YKR9JMR4GKTDPV","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:14:46.653Z","job_size_bytes":185,"pid":3466,"sidekiq_tid":"m8rm","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-30dc6434c5cd50e912c1dd95: start","job_status":"start","queue_duration_s":87.518342,"scheduling_latency_s":87.518385}2095gitlab # [ 421.359073] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-20T06:16:14.195Z","message":"changes: \"92dfd74e77b6613ee4cddec9d52e931532f92008 1ec92181522c6d831f5b4109cbf4ce466fbfedce refs/heads/master\\n\""}2096gitlab # [ 421.361608] gitaly[891]: time="2026-08-20T06:16:14.242Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EWXJ3WG3YKR9JMR4GKTDPV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T06:16:24.154" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T06:16:14.225" grpc.time_ms=17.169 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2097gitlab # [ 421.375032] gitaly[891]: time="2026-08-20T06:16:14.265Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=1 command.system_time_ms=12 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EWXJ3WG3YKR9JMR4GKTDPV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-20T06:16:24.179" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T06:16:14.250" grpc.time_ms=15.31 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2098gitlab # [ 421.388702] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-20T06:16:14.271Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"172048dd6bf336981fad6733","created_at":"2026-08-20T06:16:14.268Z","trace_propagation_headers":{"sentry-trace":"7429d374967043b8bb266ead30e0bef7-c1653027338c48c5","baggage":"sentry-trace_id=7429d374967043b8bb266ead30e0bef7,sentry-release=Unknown"},"correlation_id":"01M0EWXJ3WG3YKR9JMR4GKTDPV","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","duplicate-of":"a749e1be39e315590c88d4f5","job_size_bytes":46,"pid":3466,"job_status":"deduplicated","message":"ProjectCacheWorker JID-172048dd6bf336981fad6733: deduplicated: until executing","deduplication.type":"until executing"}2099gitlab # [ 421.403448] gitaly[891]: time="2026-08-20T06:16:14.307Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=583 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=7 command.user_time_ms=6 component=gitaly.StreamServerInterceptor correlation_id=01M0EWXJ3WG3YKR9JMR4GKTDPV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-08-20T06:16:24.220" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=266 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T06:16:14.290" grpc.time_ms=16.905 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2100gitlab # [ 421.428768] gitaly[891]: time="2026-08-20T06:16:14.336Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=596 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=2 command.system_time_ms=5 command.user_time_ms=6 component=gitaly.StreamServerInterceptor correlation_id=01M0EWXJ3WG3YKR9JMR4GKTDPV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommits grpc.request.deadline="2026-08-20T06:16:44.119" grpc.request.fullMethod=/gitaly.CommitService/ListCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=212 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:16:14.320" grpc.time_ms=16.202 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2101gitlab # [ 421.460704] gitaly[891]: time="2026-08-20T06:16:14.368Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=318 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=1 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EWXJ3WG3YKR9JMR4GKTDPV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-08-20T06:16:24.286" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=116 grpc.service=gitaly.DiffService grpc.start_time="2026-08-20T06:16:14.357" grpc.time_ms=11.103 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2102gitlab # [ 421.494210] gitaly[891]: time="2026-08-20T06:16:14.401Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=6 command.user_time_ms=6 component=gitaly.StreamServerInterceptor correlation_id=01M0EWXJ3WG3YKR9JMR4GKTDPV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T06:16:24.004" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T06:16:14.384" grpc.time_ms=16.744 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2103gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce'2104gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce', in 0.06 seconds)2105gitlab # [ 421.590649] nixbot[3496]: INFO: ::ffff:127.0.0.1:58396 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce HTTP/1.1" 200 OK2106gitlab # [ 421.829766] gitaly[891]: time="2026-08-20T06:16:14.737Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EWXJ3WG3YKR9JMR4GKTDPV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-08-20T06:16:24.209" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:16:14.589" grpc.time_ms=147.363 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2107gitlab # [ 421.868440] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-20T06:16:14.760Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","92dfd74e77b6613ee4cddec9d52e931532f92008 1ec92181522c6d831f5b4109cbf4ce466fbfedce refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"30dc6434c5cd50e912c1dd95","created_at":"2026-08-20T06:14:46.650Z","trace_propagation_headers":{"sentry-trace":"7429d374967043b8bb266ead30e0bef7-18694807bc444468","baggage":"sentry-trace_id=7429d374967043b8bb266ead30e0bef7,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EWXJ3WG3YKR9JMR4GKTDPV","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:14:46.653Z","job_size_bytes":185,"pid":3466,"sidekiq_tid":"m8rm","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-30dc6434c5cd50e912c1dd95: done: 0.588363 sec","job_status":"done","queue_duration_s":87.518342,"scheduling_latency_s":87.518385,"gitaly_calls":7,"gitaly_duration_s":0.268231,"redis_calls":110,"redis_allowed_cross_slot_calls":4,"redis_duration_s":0.039916,"redis_read_bytes":500,"redis_write_bytes":11943,"redis_cache_calls":9,"redis_cache_duration_s":0.004158,"redis_cache_read_bytes":14,"redis_cache_write_bytes":593,"redis_queues_calls":6,"redis_queues_duration_s":0.001723,"redis_queues_read_bytes":8,"redis_queues_write_bytes":5720,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.005846,"redis_queues_metadata_read_bytes":163,"redis_queues_metadata_write_bytes":1428,"redis_repository_cache_calls":41,"redis_repository_cache_allowed_cross_slot_calls":4,"redis_repository_cache_duration_s":0.013978,"redis_repository_cache_read_bytes":176,"redis_repository_cache_write_bytes":2193,"redis_shared_state_calls":44,"redis_shared_state_duration_s":0.014211,"redis_shared_state_read_bytes":139,"redis_shared_state_write_bytes":2009,"db_count":28,"db_write_count":3,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":28,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.043,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":28,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.051,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.051,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.043,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.406656,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00120556,"exclusive_lock_hold_duration_s":0.03237176,"duration_s":0.588363,"completed_at":"2026-08-20T06:16:14.760Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.045216,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2108gitlab # [ 421.960899] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-20T06:16:14.762Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"069446c26528213c00295d1a","created_at":"2026-08-20T06:14:48.129Z","trace_propagation_headers":{"sentry-trace":"57376d0fa0704fef820893a8fc100b28-95072f3547c74a62","baggage":"sentry-trace_id=57376d0fa0704fef820893a8fc100b28,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EWXKF50DH4483AQ27VZBX0","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-08-20T06:14:48.172Z","job_size_bytes":65,"pid":3466,"sidekiq_tid":"m8rm","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-069446c26528213c00295d1a: start","job_status":"start","queue_duration_s":86.590718,"scheduling_latency_s":86.590743}2109gitlab # [ 421.979220] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-20T06:16:14.869Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"069446c26528213c00295d1a","created_at":"2026-08-20T06:14:48.129Z","trace_propagation_headers":{"sentry-trace":"57376d0fa0704fef820893a8fc100b28-95072f3547c74a62","baggage":"sentry-trace_id=57376d0fa0704fef820893a8fc100b28,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EWXKF50DH4483AQ27VZBX0","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-08-20T06:14:48.172Z","job_size_bytes":65,"pid":3466,"sidekiq_tid":"m8rm","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-069446c26528213c00295d1a: done: 0.106772 sec","job_status":"done","queue_duration_s":86.590718,"scheduling_latency_s":86.590743,"redis_calls":16,"redis_duration_s":0.004655,"redis_read_bytes":269,"redis_write_bytes":1850,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.00249,"redis_feature_flag_read_bytes":262,"redis_feature_flag_write_bytes":1032,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001619,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":590,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000546,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":228,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.021,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.012,"db_ci_duration_s":0.009,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.063515,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00048582,"duration_s":0.106772,"completed_at":"2026-08-20T06:16:14.869Z","load_balancing_strategy":"primary","db_duration_s":0.035916,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2110gitlab # [ 422.024745] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-20T06:16:14.872Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"fcd2fabe356e04c57f5bfc04","created_at":"2026-08-20T06:14:48.174Z","trace_propagation_headers":{"sentry-trace":"57376d0fa0704fef820893a8fc100b28-95072f3547c74a62","baggage":"sentry-trace_id=57376d0fa0704fef820893a8fc100b28,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EWXKF50DH4483AQ27VZBX0","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-08-20T06:14:48.189Z","job_size_bytes":65,"pid":3466,"sidekiq_tid":"m8rm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-fcd2fabe356e04c57f5bfc04: start","job_status":"start","queue_duration_s":86.682494,"scheduling_latency_s":86.682517}2111gitlab # [ 422.108705] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-20T06:16:15.015Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"fcd2fabe356e04c57f5bfc04","created_at":"2026-08-20T06:14:48.174Z","trace_propagation_headers":{"sentry-trace":"57376d0fa0704fef820893a8fc100b28-95072f3547c74a62","baggage":"sentry-trace_id=57376d0fa0704fef820893a8fc100b28,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EWXKF50DH4483AQ27VZBX0","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-08-20T06:14:48.189Z","job_size_bytes":65,"pid":3466,"sidekiq_tid":"m8rm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-fcd2fabe356e04c57f5bfc04: done: 0.143381 sec","job_status":"done","queue_duration_s":86.682494,"scheduling_latency_s":86.682517,"redis_calls":21,"redis_duration_s":0.006267,"redis_read_bytes":148,"redis_write_bytes":2264,"redis_feature_flag_calls":9,"redis_feature_flag_duration_s":0.002628,"redis_feature_flag_read_bytes":136,"redis_feature_flag_write_bytes":1264,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001745,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":578,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001894,"redis_shared_state_read_bytes":8,"redis_shared_state_write_bytes":422,"db_count":15,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.042,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.033,"db_ci_duration_s":0.009,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.084468,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0004475,"duration_s":0.143381,"completed_at":"2026-08-20T06:16:15.015Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.048249,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2112gitlab # [ 422.186091] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-20T06:16:15.018Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"411bceafb85c536779f2c835","created_at":"2026-08-20T06:14:48.436Z","trace_propagation_headers":{"sentry-trace":"57376d0fa0704fef820893a8fc100b28-95072f3547c74a62","baggage":"sentry-trace_id=57376d0fa0704fef820893a8fc100b28,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EWXKF50DH4483AQ27VZBX0","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-20T06:14:48.447Z","job_size_bytes":3,"pid":3466,"sidekiq_tid":"m8rm","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-411bceafb85c536779f2c835: start","job_status":"start","queue_duration_s":86.570907,"scheduling_latency_s":86.570933}2113gitlab # [ 422.366226] gitaly[891]: time="2026-08-20T06:16:15.272Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EWXKF50DH4483AQ27VZBX0 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3897 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T06:16:15.271" grpc.time_ms=0.672 pid=891 span.kind=server system=grpc2114gitlab # [ 422.414124] gitaly[891]: time="2026-08-20T06:16:15.321Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EWXKF50DH4483AQ27VZBX0 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3895 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T06:16:15.320" grpc.time_ms=0.853 pid=891 span.kind=server system=grpc2115gitlab # [ 422.469587] gitaly[891]: time="2026-08-20T06:16:15.377Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EWXKF50DH4483AQ27VZBX0 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3897 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T06:16:15.376" grpc.time_ms=0.68 pid=891 span.kind=server system=grpc2116gitlab # [ 422.501685] gitaly[891]: time="2026-08-20T06:16:15.390Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0EWXKF50DH4483AQ27VZBX0 diskcache=08b493cb-b4b2-4417-baca-a4a1877dfd44 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-20T06:16:45.012" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-20T06:16:15.213" pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2117gitlab # [ 422.523534] gitaly[891]: time="2026-08-20T06:16:15.390Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=192 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7300 command.oublock=0 command.real_time_ms=170 command.spawn_token_fork_ms=1 command.system_time_ms=115 command.user_time_ms=77 component=gitaly.UnaryServerInterceptor correlation_id=01M0EWXKF50DH4483AQ27VZBX0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-20T06:16:45.012" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T06:16:15.213" grpc.time_ms=177.073 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2118gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce'2119gitlab # [ 422.653304] nixbot[3496]: INFO: ::ffff:127.0.0.1:58412 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce HTTP/1.1" 200 OK2120gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce', in 0.06 seconds)2121gitlab # [ 422.710608] gitaly[891]: time="2026-08-20T06:16:15.618Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EWXKF50DH4483AQ27VZBX0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-20T06:16:45.416" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:16:15.616" grpc.time_ms=1.46 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2122gitlab # [ 422.794971] gitaly[891]: time="2026-08-20T06:16:15.702Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EWXKF50DH4483AQ27VZBX0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T06:16:45.500" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:16:15.700" grpc.time_ms=1.356 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2123gitlab # [ 422.836400] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-20T06:16:15.742Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"411bceafb85c536779f2c835","created_at":"2026-08-20T06:14:48.436Z","trace_propagation_headers":{"sentry-trace":"57376d0fa0704fef820893a8fc100b28-95072f3547c74a62","baggage":"sentry-trace_id=57376d0fa0704fef820893a8fc100b28,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EWXKF50DH4483AQ27VZBX0","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-20T06:14:48.447Z","job_size_bytes":3,"pid":3466,"sidekiq_tid":"m8rm","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-411bceafb85c536779f2c835: done: 0.72415 sec","job_status":"done","queue_duration_s":86.570907,"scheduling_latency_s":86.570933,"gitaly_calls":3,"gitaly_duration_s":0.191637,"redis_calls":117,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.042528,"redis_read_bytes":457,"redis_write_bytes":27997,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.001725,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.002376,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_feature_flag_calls":40,"redis_feature_flag_duration_s":0.014576,"redis_feature_flag_read_bytes":294,"redis_feature_flag_write_bytes":6581,"redis_queues_calls":25,"redis_queues_duration_s":0.006883,"redis_queues_read_bytes":36,"redis_queues_write_bytes":14491,"redis_queues_metadata_calls":21,"redis_queues_metadata_duration_s":0.009428,"redis_queues_metadata_read_bytes":32,"redis_queues_metadata_write_bytes":3370,"redis_rate_limiting_calls":2,"redis_rate_limiting_duration_s":0.000745,"redis_rate_limiting_read_bytes":2,"redis_rate_limiting_write_bytes":166,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.001663,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003407,"redis_shared_state_read_bytes":11,"redis_shared_state_write_bytes":851,"db_count":52,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":52,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.094,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":35,"db_ci_count":17,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.035,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.04,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.044,"db_ci_duration_s":0.05,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.407939,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.6281329999999999,"duration_s":0.72415,"completed_at":"2026-08-20T06:16:15.742Z","load_balancing_strategy":"primary","db_duration_s":0.111598,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2124gitlab # [ 422.931063] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-20T06:16:15.745Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"a749e1be39e315590c88d4f5","created_at":"2026-08-20T06:16:12.781Z","trace_propagation_headers":{"sentry-trace":"181e69fd75be480b9a034892514ec20e-d16109ea072d45b8","baggage":"sentry-trace_id=181e69fd75be480b9a034892514ec20e,sentry-release=Unknown"},"correlation_id":"01M0EWXCJSMX4YSNV9GED54BJ5","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-08-20T06:16:12.819Z","job_size_bytes":46,"pid":3466,"sidekiq_tid":"m8rm","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-a749e1be39e315590c88d4f5: start","job_status":"start","queue_duration_s":2.925724,"scheduling_latency_s":2.925759}2125gitlab # [ 422.948180] gitaly[891]: time="2026-08-20T06:16:15.832Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0EWXCJSMX4YSNV9GED54BJ5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryInfo grpc.request.deadline="2026-08-20T12:16:15.821" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryInfo grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T06:16:15.822" grpc.time_ms=9.988 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2126gitlab # [ 422.959615] gitaly[891]: time="2026-08-20T06:16:15.862Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=596 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=9 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M0EWXCJSMX4YSNV9GED54BJ5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-08-20T06:16:45.643" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:16:15.844" grpc.time_ms=17.158 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2127gitlab # [ 423.004274] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-20T06:16:15.911Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"a749e1be39e315590c88d4f5","created_at":"2026-08-20T06:16:12.781Z","trace_propagation_headers":{"sentry-trace":"181e69fd75be480b9a034892514ec20e-d16109ea072d45b8","baggage":"sentry-trace_id=181e69fd75be480b9a034892514ec20e,sentry-release=Unknown"},"correlation_id":"01M0EWXCJSMX4YSNV9GED54BJ5","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-08-20T06:16:12.819Z","job_size_bytes":46,"pid":3466,"sidekiq_tid":"m8rm","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-a749e1be39e315590c88d4f5: done: 0.166367 sec","job_status":"done","queue_duration_s":2.925724,"scheduling_latency_s":2.925759,"gitaly_calls":2,"gitaly_duration_s":0.033844,"redis_calls":30,"redis_allowed_cross_slot_calls":2,"redis_duration_s":0.011097,"redis_read_bytes":69,"redis_write_bytes":4886,"redis_feature_flag_calls":6,"redis_feature_flag_duration_s":0.002335,"redis_feature_flag_read_bytes":6,"redis_feature_flag_write_bytes":1005,"redis_queues_calls":3,"redis_queues_duration_s":0.001023,"redis_queues_read_bytes":4,"redis_queues_write_bytes":2114,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002972,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":710,"redis_repository_cache_calls":11,"redis_repository_cache_allowed_cross_slot_calls":2,"redis_repository_cache_duration_s":0.003752,"redis_repository_cache_read_bytes":48,"redis_repository_cache_write_bytes":753,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.001015,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":304,"db_count":10,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":10,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":2,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.004,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.004,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.012,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.103453,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00041004,"duration_s":0.166367,"completed_at":"2026-08-20T06:16:15.911Z","load_balancing_strategy":"primary","db_duration_s":0.019305,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2128gitlab # [ 423.115952] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-20T06:16:15.913Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"8cc4e5497c59615f482d7463","created_at":"2026-08-20T06:16:12.853Z","trace_propagation_headers":{"sentry-trace":"181e69fd75be480b9a034892514ec20e-d16109ea072d45b8","baggage":"sentry-trace_id=181e69fd75be480b9a034892514ec20e,sentry-release=Unknown"},"correlation_id":"01M0EWXCJSMX4YSNV9GED54BJ5","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-08-20T06:16:12.865Z","job_size_bytes":3,"pid":3466,"sidekiq_tid":"m8rm","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-8cc4e5497c59615f482d7463: start","job_status":"start","queue_duration_s":3.047872,"scheduling_latency_s":3.047897}2129gitlab # [ 423.144544] gitaly[891]: time="2026-08-20T06:16:15.976Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0EWXCJSMX4YSNV9GED54BJ5 diskcache=420f2e04-16f5-4982-972c-728ed4d2d60d grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-08-20T12:16:15.944" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:16:15.945" pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2130gitlab # [ 423.158122] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-20T06:16:16.032Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"8cc4e5497c59615f482d7463","created_at":"2026-08-20T06:16:12.853Z","trace_propagation_headers":{"sentry-trace":"181e69fd75be480b9a034892514ec20e-d16109ea072d45b8","baggage":"sentry-trace_id=181e69fd75be480b9a034892514ec20e,sentry-release=Unknown"},"correlation_id":"01M0EWXCJSMX4YSNV9GED54BJ5","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-08-20T06:16:12.865Z","job_size_bytes":3,"pid":3466,"sidekiq_tid":"m8rm","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-8cc4e5497c59615f482d7463: done: 0.119385 sec","job_status":"done","queue_duration_s":3.047872,"scheduling_latency_s":3.047897,"gitaly_calls":1,"gitaly_duration_s":0.034776,"redis_calls":15,"redis_duration_s":0.004688,"redis_read_bytes":68,"redis_write_bytes":1520,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00054,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001802,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":558,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000857,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001489,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":520,"db_count":12,"db_write_count":4,"db_cached_count":0,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":4,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.014,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":4,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.016,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.03,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.014,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.054315,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.08816556,"duration_s":0.119385,"completed_at":"2026-08-20T06:16:16.032Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.024462,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2131gitlab # [ 423.209981] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-20T06:16:16.034Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"d2014230575c344dd1c9d77a","created_at":"2026-08-20T06:16:13.072Z","trace_propagation_headers":{"sentry-trace":"181e69fd75be480b9a034892514ec20e-d16109ea072d45b8","baggage":"sentry-trace_id=181e69fd75be480b9a034892514ec20e,sentry-release=Unknown"},"correlation_id":"01M0EWXCJSMX4YSNV9GED54BJ5","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-08-20T06:16:13.075Z","job_size_bytes":23,"pid":3466,"sidekiq_tid":"m8rm","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-d2014230575c344dd1c9d77a: start","job_status":"start","queue_duration_s":2.958707,"scheduling_latency_s":2.958731}2132gitlab # [ 423.226322] gitaly[891]: time="2026-08-20T06:16:15.977Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=4 command.cpu_time_ms=20 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1172 command.oublock=0 command.real_time_ms=33 command.spawn_token_fork_ms=1 command.system_time_ms=15 command.user_time_ms=5 component=gitaly.UnaryServerInterceptor correlation_id=01M0EWXCJSMX4YSNV9GED54BJ5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-08-20T12:16:15.944" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:16:15.945" grpc.time_ms=31.259 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2133gitlab # [ 423.241521] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-20T06:16:16.097Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"d2014230575c344dd1c9d77a","created_at":"2026-08-20T06:16:13.072Z","trace_propagation_headers":{"sentry-trace":"181e69fd75be480b9a034892514ec20e-d16109ea072d45b8","baggage":"sentry-trace_id=181e69fd75be480b9a034892514ec20e,sentry-release=Unknown"},"correlation_id":"01M0EWXCJSMX4YSNV9GED54BJ5","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-08-20T06:16:13.075Z","job_size_bytes":23,"pid":3466,"sidekiq_tid":"m8rm","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-d2014230575c344dd1c9d77a: done: 0.063049 sec","job_status":"done","queue_duration_s":2.958707,"scheduling_latency_s":2.958731,"gitaly_calls":1,"gitaly_duration_s":0.019064,"redis_calls":16,"redis_duration_s":0.004992,"redis_read_bytes":52,"redis_write_bytes":2049,"redis_queues_calls":1,"redis_queues_duration_s":0.000452,"redis_queues_read_bytes":1,"redis_queues_write_bytes":980,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001378,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":437,"redis_repository_cache_calls":7,"redis_repository_cache_duration_s":0.002208,"redis_repository_cache_read_bytes":44,"redis_repository_cache_write_bytes":344,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000954,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":288,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.033436,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.063049,"completed_at":"2026-08-20T06:16:16.097Z","load_balancing_strategy":"primary","db_duration_s":0.004701,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2134gitlab # [ 423.286481] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-20T06:16:16.099Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"63db4e65092b93a6c8fe8715","created_at":"2026-08-20T06:16:13.902Z","trace_propagation_headers":{"sentry-trace":"181e69fd75be480b9a034892514ec20e-d16109ea072d45b8","baggage":"sentry-trace_id=181e69fd75be480b9a034892514ec20e,sentry-release=Unknown"},"correlation_id":"01M0EWXCJSMX4YSNV9GED54BJ5","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:11d404dedf937b5d548fad2898421e878d3a5230129ad80d5135aa9b62623b4e","size_limiter":"validated","enqueued_at":"2026-08-20T06:16:13.909Z","job_size_bytes":467,"pid":3466,"sidekiq_tid":"m8rm","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-63db4e65092b93a6c8fe8715: start","job_status":"start","queue_duration_s":2.190159,"scheduling_latency_s":2.190181}2135gitlab # [ 423.303499] gitaly[891]: time="2026-08-20T06:16:16.086Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=596 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=1 command.system_time_ms=9 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M0EWXCJSMX4YSNV9GED54BJ5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-08-20T06:16:46.069" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:16:16.069" grpc.time_ms=16.305 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2136gitlab # [ 423.316764] gitaly[891]: time="2026-08-20T06:16:16.132Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EWXCJSMX4YSNV9GED54BJ5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T06:16:46.130" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:16:16.131" grpc.time_ms=0.904 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2137gitlab # [ 423.328920] gitaly[891]: time="2026-08-20T06:16:16.151Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=1 command.system_time_ms=0 command.user_time_ms=13 component=gitaly.UnaryServerInterceptor correlation_id=01M0EWXCJSMX4YSNV9GED54BJ5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-08-20T06:16:26.064" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T06:16:16.135" grpc.time_ms=15.959 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2138gitlab # [ 423.460616] gitaly[891]: time="2026-08-20T06:16:16.367Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EWXCJSMX4YSNV9GED54BJ5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-20T06:16:46.365" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:16:16.365" grpc.time_ms=1.214 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2139gitlab # [ 423.498106] gitaly[891]: time="2026-08-20T06:16:16.376Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=35 command.oublock=0 command.real_time_ms=2 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EWXCJSMX4YSNV9GED54BJ5 error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-08-20T06:16:46.371" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:16:16.372" grpc.time_ms=4.39 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2140gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce'2141gitlab # [ 423.657578] gitaly[891]: time="2026-08-20T06:16:16.565Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=7 command.user_time_ms=6 component=gitaly.StreamServerInterceptor correlation_id=01M0EWXCJSMX4YSNV9GED54BJ5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T06:16:26.166" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T06:16:16.547" grpc.time_ms=17.743 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2142gitlab # [ 423.729848] nixbot[3496]: INFO: ::ffff:127.0.0.1:58418 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce HTTP/1.1" 200 OK2143gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce', in 0.08 seconds)2144gitlab # [ 424.321300] gitaly[891]: time="2026-08-20T06:16:17.228Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=19 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=881 command.oublock=0 command.real_time_ms=23 command.spawn_token_fork_ms=3 command.system_time_ms=16 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M0EWXCJSMX4YSNV9GED54BJ5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-08-20T06:16:47.200" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:16:17.201" grpc.time_ms=27.304 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2145gitlab # [ 424.363371] gitaly[891]: time="2026-08-20T06:16:17.257Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=1 command.system_time_ms=9 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M0EWXCJSMX4YSNV9GED54BJ5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-08-20T06:16:47.232" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:16:17.232" grpc.time_ms=24.377 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2146gitlab # [ 424.394753] sidekiq-cluster[3466]: {"severity":"WARN","time":"2026-08-20T06:16:17.301Z","class":"CreatePipelineWorker","correlation_id":"01M0EWXCJSMX4YSNV9GED54BJ5","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"0000000000000000000000000000000000000000","after":"92dfd74e77b6613ee4cddec9d52e931532f92008","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"92dfd74e77b6613ee4cddec9d52e931532f92008","ref":"refs/heads/master"},"retry":0}2147gitlab # [ 424.417641] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-20T06:16:17.312Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"63db4e65092b93a6c8fe8715","created_at":"2026-08-20T06:16:13.902Z","trace_propagation_headers":{"sentry-trace":"181e69fd75be480b9a034892514ec20e-d16109ea072d45b8","baggage":"sentry-trace_id=181e69fd75be480b9a034892514ec20e,sentry-release=Unknown"},"correlation_id":"01M0EWXCJSMX4YSNV9GED54BJ5","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:11d404dedf937b5d548fad2898421e878d3a5230129ad80d5135aa9b62623b4e","size_limiter":"validated","enqueued_at":"2026-08-20T06:16:13.909Z","job_size_bytes":467,"pid":3466,"sidekiq_tid":"m8rm","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-63db4e65092b93a6c8fe8715: done: 1.212705 sec","job_status":"done","queue_duration_s":2.190159,"scheduling_latency_s":2.190181,"gitaly_calls":7,"gitaly_duration_s":0.113834,"redis_calls":51,"redis_duration_s":0.014937,"redis_read_bytes":169,"redis_write_bytes":4166,"redis_cache_calls":4,"redis_cache_duration_s":0.001577,"redis_cache_read_bytes":10,"redis_cache_write_bytes":341,"redis_feature_flag_calls":16,"redis_feature_flag_duration_s":0.006058,"redis_feature_flag_read_bytes":16,"redis_feature_flag_write_bytes":2174,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001639,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":510,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.004381,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001282,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":513,"db_count":36,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":36,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.047,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":32,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.04,"db_ci_duration_s":0.007,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":1.021082,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0005955,"duration_s":1.212705,"completed_at":"2026-08-20T06:16:17.312Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.085895,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2148gitlab # [ 424.510936] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-20T06:16:17.315Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{\"idempotency_key\"=\u003e\"094daf3b-cdbd-4d98-aecb-3a0fb561fd5b\"}"],"class":"WebHookWorker","jid":"a2478df9051134e05b670bc2","created_at":"2026-08-20T06:16:14.060Z","trace_propagation_headers":{"sentry-trace":"181e69fd75be480b9a034892514ec20e-d16109ea072d45b8","baggage":"sentry-trace_id=181e69fd75be480b9a034892514ec20e,sentry-release=Unknown"},"correlation_id":"01M0EWXCJSMX4YSNV9GED54BJ5","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4a7422bf269dd6783e5967d0c7799e50c2d961213897ece67f40e854a9a8509c","size_limiter":"validated","enqueued_at":"2026-08-20T06:16:14.065Z","job_size_bytes":1751,"pid":3466,"sidekiq_tid":"m8rm","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-a2478df9051134e05b670bc2: start","job_status":"start","queue_duration_s":3.249102,"scheduling_latency_s":3.249131}2149gitlab # [ 424.611495] nixbot[3496]: INFO: ::ffff:127.0.0.1:58428 - "POST /webhooks/gitlab HTTP/1.1" 202 Accepted2150gitlab # [ 424.643501] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-20T06:16:17.550Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{:idempotency_key=\u003e\"094daf3b-cdbd-4d98-aecb-3a0fb561fd5b\"}"],"class":"WebHookWorker","jid":"a2478df9051134e05b670bc2","created_at":"2026-08-20T06:16:14.060Z","trace_propagation_headers":{"sentry-trace":"181e69fd75be480b9a034892514ec20e-d16109ea072d45b8","baggage":"sentry-trace_id=181e69fd75be480b9a034892514ec20e,sentry-release=Unknown"},"correlation_id":"01M0EWXCJSMX4YSNV9GED54BJ5","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4a7422bf269dd6783e5967d0c7799e50c2d961213897ece67f40e854a9a8509c","size_limiter":"validated","enqueued_at":"2026-08-20T06:16:14.065Z","job_size_bytes":1751,"pid":3466,"sidekiq_tid":"m8rm","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-a2478df9051134e05b670bc2: done: 0.235137 sec","job_status":"done","queue_duration_s":3.249102,"scheduling_latency_s":3.249131,"redis_calls":19,"redis_duration_s":0.006467,"redis_read_bytes":32,"redis_write_bytes":5367,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001432,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":622,"redis_queues_calls":2,"redis_queues_duration_s":0.000876,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3729,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002797,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":690,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001362,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":326,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"external_http_count":1,"external_http_duration_s":0.05590796000001319,"cpu_s":0.158456,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00056378,"extra.web_hook_worker.response_status":"success","extra.web_hook_worker.http_status":"ok","extra.web_hook_worker.signing_token_present":false,"duration_s":0.235137,"completed_at":"2026-08-20T06:16:17.550Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00472,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2151gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce'2152gitlab # [ 424.717891] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-20T06:16:17.553Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"b7221db3fa217af6ca83ebbb","created_at":"2026-08-20T06:16:14.281Z","trace_propagation_headers":{"sentry-trace":"7429d374967043b8bb266ead30e0bef7-c1653027338c48c5","baggage":"sentry-trace_id=7429d374967043b8bb266ead30e0bef7,sentry-release=Unknown"},"correlation_id":"01M0EWXJ3WG3YKR9JMR4GKTDPV","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","duplicate-of":"8cc4e5497c59615f482d7463","size_limiter":"validated","enqueued_at":"2026-08-20T06:16:14.285Z","job_size_bytes":3,"pid":3466,"sidekiq_tid":"m8rm","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-b7221db3fa217af6ca83ebbb: start","job_status":"start","queue_duration_s":3.268666,"scheduling_latency_s":3.268707}2153gitlab # [ 424.739035] gitaly[891]: time="2026-08-20T06:16:17.609Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0EWXJ3WG3YKR9JMR4GKTDPV diskcache=dc94e813-78c3-4a93-b3d3-adf92b8c137e grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-08-20T12:16:17.593" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:16:17.594" pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2154gitlab # [ 424.750291] gitaly[891]: time="2026-08-20T06:16:17.610Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=290 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=1 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EWXJ3WG3YKR9JMR4GKTDPV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-08-20T12:16:17.593" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:16:17.594" grpc.time_ms=15.28 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2155gitlab # [ 424.765570] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-20T06:16:17.643Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"b7221db3fa217af6ca83ebbb","created_at":"2026-08-20T06:16:14.281Z","trace_propagation_headers":{"sentry-trace":"7429d374967043b8bb266ead30e0bef7-c1653027338c48c5","baggage":"sentry-trace_id=7429d374967043b8bb266ead30e0bef7,sentry-release=Unknown"},"correlation_id":"01M0EWXJ3WG3YKR9JMR4GKTDPV","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","duplicate-of":"8cc4e5497c59615f482d7463","size_limiter":"validated","enqueued_at":"2026-08-20T06:16:14.285Z","job_size_bytes":3,"pid":3466,"sidekiq_tid":"m8rm","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-b7221db3fa217af6ca83ebbb: done: 0.089754 sec","job_status":"done","queue_duration_s":3.268666,"scheduling_latency_s":3.268707,"gitaly_calls":1,"gitaly_duration_s":0.019376,"redis_calls":12,"redis_duration_s":0.009930999999999999,"redis_read_bytes":64,"redis_write_bytes":1136,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002266,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":479,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.003761,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.003904,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":520,"db_count":8,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.014,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.011,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.011,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.014,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.045024,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.05270838,"duration_s":0.089754,"completed_at":"2026-08-20T06:16:17.643Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.018704,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2156gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce', in 0.08 seconds)2157gitlab # [ 424.812656] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-20T06:16:17.646Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"708e0ba0a79cceb05580ff67","created_at":"2026-08-20T06:16:14.512Z","trace_propagation_headers":{"sentry-trace":"7429d374967043b8bb266ead30e0bef7-c1653027338c48c5","baggage":"sentry-trace_id=7429d374967043b8bb266ead30e0bef7,sentry-release=Unknown"},"correlation_id":"01M0EWXJ3WG3YKR9JMR4GKTDPV","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:36ccddab6ded829b86a7b414ccc71a03ee22eac797dc3fd318a5b16e2845e0d5","size_limiter":"validated","enqueued_at":"2026-08-20T06:16:14.520Z","job_size_bytes":467,"pid":3466,"sidekiq_tid":"m8rm","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-708e0ba0a79cceb05580ff67: start","job_status":"start","queue_duration_s":3.125525,"scheduling_latency_s":3.125578}2158gitlab # [ 424.830602] gitaly[891]: time="2026-08-20T06:16:17.690Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EWXJ3WG3YKR9JMR4GKTDPV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T06:16:47.689" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:16:17.689" grpc.time_ms=0.953 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2159gitlab # [ 424.846556] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/20:06:16:17 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 1532160gitlab # [ 424.849255] nixbot[3496]: INFO: ::ffff:127.0.0.1:58436 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce HTTP/1.1" 200 OK2161gitlab # [ 424.851173] gitaly[891]: time="2026-08-20T06:16:17.708Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=6 command.system_time_ms=10 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EWXJ3WG3YKR9JMR4GKTDPV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-08-20T06:16:27.003" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T06:16:17.693" grpc.time_ms=14.723 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2162gitlab # [ 424.864720] gitaly[891]: time="2026-08-20T06:16:17.728Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=578 command.oublock=0 command.real_time_ms=18 command.spawn_token_fork_ms=3 command.system_time_ms=9 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M0EX0BD6R9NQ2AGTVRF6B08M grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=202 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T06:16:17.708" grpc.time_ms=19.871 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc2163gitlab # [ 424.881176] gitaly[891]: time="2026-08-20T06:16:17.757Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EWXJ3WG3YKR9JMR4GKTDPV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-20T06:16:47.755" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:16:17.756" grpc.time_ms=0.985 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2164gitlab # [ 424.895110] gitaly[891]: time="2026-08-20T06:16:17.766Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=195 command.oublock=0 command.real_time_ms=2 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EWXJ3WG3YKR9JMR4GKTDPV error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-08-20T06:16:47.761" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:16:17.761" grpc.time_ms=4.041 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2165gitlab # [ 424.911299] gitaly[891]: time="2026-08-20T06:16:17.809Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M0EWXJ3WG3YKR9JMR4GKTDPV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T06:16:27.107" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T06:16:17.799" grpc.time_ms=9.554 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2166gitlab # [ 424.952456] gitaly[891]: time="2026-08-20T06:16:17.860Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0EX0BJ33RWHNW9TBKCQWH9W grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T06:16:17.849" pid=891 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2167gitlab # [ 424.964106] gitaly[891]: time="2026-08-20T06:16:17.860Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=2 command.system_time_ms=0 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M0EX0BJ33RWHNW9TBKCQWH9W grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T06:16:17.849" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc2168gitlab # [ 424.977426] gitlab-workhorse[817]: time="2026-08-20T06:16:17Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672169gitlab # [ 424.979219] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/20:06:16:17 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 1322170gitlab # [ 424.981242] gitaly[891]: time="2026-08-20T06:16:17.860Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=2 command.system_time_ms=0 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M0EX0BJ33RWHNW9TBKCQWH9W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T06:16:17.849" grpc.time_ms=10.769 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc2171gitlab # [ 425.014295] nixbot[3496]: {"ts": "2026-08-20T06:16:17.921Z", "level": "info", "logger": "nixbot.build_reuse", "msg": "reusing build for tree hash", "build_id": 1, "tree_hash": "a8c90de643fa3b1e78fc9dc27f18f04a936ba912"}2172gitlab # [ 425.090993] gitaly[891]: time="2026-08-20T06:16:17.998Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EX0BRCBJ07HPA8F68V7DAW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T06:16:47.896" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:16:17.997" grpc.time_ms=1.257 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2173gitlab # [ 425.176709] gitaly[891]: time="2026-08-20T06:16:18.084Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=7 command.user_time_ms=7 component=gitaly.StreamServerInterceptor correlation_id=01M0EX0BRCBJ07HPA8F68V7DAW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T06:16:28.045" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T06:16:18.066" grpc.time_ms=17.844 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2174gitlab # [ 425.240976] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/20:06:16:18 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/92dfd74e77b6613ee4cddec9d52e931532f92008 HTTP/1.1" 201 657 "" "python-httpx/0.28.1" 2152175gitlab # [ 425.249913] nixbot[3496]: {"ts": "2026-08-20T06:16:18.150Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/92dfd74e77b6613ee4cddec9d52e931532f92008 \"HTTP/1.1 201 Created\""}2176gitlab # [ 425.310743] gitaly[891]: time="2026-08-20T06:16:18.218Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EX0BZEMDK81QP4P009SJKR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T06:16:48.115" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:16:18.216" grpc.time_ms=1.049 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2177gitlab # [ 425.366353] gitaly[891]: time="2026-08-20T06:16:18.274Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=1 command.system_time_ms=6 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M0EX0BZEMDK81QP4P009SJKR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T06:16:28.239" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T06:16:18.260" grpc.time_ms=13.157 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2178gitlab # [ 425.433799] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/20:06:16:18 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/92dfd74e77b6613ee4cddec9d52e931532f92008 HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 1822179gitlab # [ 425.443079] nixbot[3496]: {"ts": "2026-08-20T06:16:18.342Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/92dfd74e77b6613ee4cddec9d52e931532f92008 \"HTTP/1.1 201 Created\""}2180gitlab # [ 425.496509] gitaly[891]: time="2026-08-20T06:16:18.404Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EX0C5BZEK7JG1FDNNSGGCJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T06:16:48.302" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:16:18.403" grpc.time_ms=0.884 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2181gitlab # [ 425.578548] gitaly[891]: time="2026-08-20T06:16:18.486Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EX0C5BZEK7JG1FDNNSGGCJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T06:16:28.296" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T06:16:18.476" grpc.time_ms=9.602 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2182gitlab # [ 425.603165] gitaly[891]: time="2026-08-20T06:16:18.489Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=19 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=881 command.oublock=0 command.real_time_ms=21 command.spawn_token_fork_ms=1 command.system_time_ms=12 command.user_time_ms=7 component=gitaly.StreamServerInterceptor correlation_id=01M0EWXJ3WG3YKR9JMR4GKTDPV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-08-20T06:16:48.463" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:16:18.463" grpc.time_ms=25.35 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2183gitlab # [ 425.624167] gitaly[891]: time="2026-08-20T06:16:18.504Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=4 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EWXJ3WG3YKR9JMR4GKTDPV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-08-20T06:16:48.492" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:16:18.492" grpc.time_ms=11.657 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2184gitlab # [ 425.640097] sidekiq-cluster[3466]: {"severity":"WARN","time":"2026-08-20T06:16:18.519Z","class":"CreatePipelineWorker","correlation_id":"01M0EWXJ3WG3YKR9JMR4GKTDPV","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"92dfd74e77b6613ee4cddec9d52e931532f92008","after":"1ec92181522c6d831f5b4109cbf4ce466fbfedce","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"1ec92181522c6d831f5b4109cbf4ce466fbfedce","ref":"refs/heads/master"},"retry":0}2185gitlab # [ 425.648096] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-20T06:16:18.525Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"708e0ba0a79cceb05580ff67","created_at":"2026-08-20T06:16:14.512Z","trace_propagation_headers":{"sentry-trace":"7429d374967043b8bb266ead30e0bef7-c1653027338c48c5","baggage":"sentry-trace_id=7429d374967043b8bb266ead30e0bef7,sentry-release=Unknown"},"correlation_id":"01M0EWXJ3WG3YKR9JMR4GKTDPV","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:36ccddab6ded829b86a7b414ccc71a03ee22eac797dc3fd318a5b16e2845e0d5","size_limiter":"validated","enqueued_at":"2026-08-20T06:16:14.520Z","job_size_bytes":467,"pid":3466,"sidekiq_tid":"m8rm","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-708e0ba0a79cceb05580ff67: done: 0.879024 sec","job_status":"done","queue_duration_s":3.125525,"scheduling_latency_s":3.125578,"gitaly_calls":7,"gitaly_duration_s":0.088891,"redis_calls":33,"redis_duration_s":0.01662,"redis_read_bytes":184,"redis_write_bytes":1839,"redis_cache_calls":3,"redis_cache_duration_s":0.003653,"redis_cache_read_bytes":43,"redis_cache_write_bytes":255,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.008051,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":443,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.003688,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001228,"redis_shared_state_read_bytes":17,"redis_shared_state_write_bytes":513,"db_count":27,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":27,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.03,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":24,"db_ci_count":3,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.024,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.752109,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.879024,"completed_at":"2026-08-20T06:16:18.525Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.029653,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2186gitlab # [ 425.699372] nixbot[3496]: INFO: ::ffff:127.0.0.1:58444 - "POST /webhooks/gitlab HTTP/1.1" 202 Accepted2187gitlab # [ 425.701027] nixbot[3496]: {"ts": "2026-08-20T06:16:18.581Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/92dfd74e77b6613ee4cddec9d52e931532f92008 \"HTTP/1.1 201 Created\""}2188gitlab # [ 425.704419] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/20:06:16:18 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/92dfd74e77b6613ee4cddec9d52e931532f92008 HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 2272189gitlab # [ 425.707493] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-20T06:16:18.527Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{\"idempotency_key\"=\u003e\"dd93ad69-69c7-4a1c-97d9-9899df0081ae\"}"],"class":"WebHookWorker","jid":"c5dd2736b947c2719f80c147","created_at":"2026-08-20T06:16:14.556Z","trace_propagation_headers":{"sentry-trace":"7429d374967043b8bb266ead30e0bef7-c1653027338c48c5","baggage":"sentry-trace_id=7429d374967043b8bb266ead30e0bef7,sentry-release=Unknown"},"correlation_id":"01M0EWXJ3WG3YKR9JMR4GKTDPV","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:53ba542ab2952afe91e9b49bcc20bee13a3acc32d26523aeeefb44689b40833e","size_limiter":"validated","enqueued_at":"2026-08-20T06:16:14.561Z","job_size_bytes":1749,"pid":3466,"sidekiq_tid":"m8rm","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-c5dd2736b947c2719f80c147: start","job_status":"start","queue_duration_s":3.965438,"scheduling_latency_s":3.965464}2190gitlab # [ 425.725741] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-20T06:16:18.584Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{:idempotency_key=\u003e\"dd93ad69-69c7-4a1c-97d9-9899df0081ae\"}"],"class":"WebHookWorker","jid":"c5dd2736b947c2719f80c147","created_at":"2026-08-20T06:16:14.556Z","trace_propagation_headers":{"sentry-trace":"7429d374967043b8bb266ead30e0bef7-c1653027338c48c5","baggage":"sentry-trace_id=7429d374967043b8bb266ead30e0bef7,sentry-release=Unknown"},"correlation_id":"01M0EWXJ3WG3YKR9JMR4GKTDPV","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:53ba542ab2952afe91e9b49bcc20bee13a3acc32d26523aeeefb44689b40833e","size_limiter":"validated","enqueued_at":"2026-08-20T06:16:14.561Z","job_size_bytes":1749,"pid":3466,"sidekiq_tid":"m8rm","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-c5dd2736b947c2719f80c147: done: 0.057162 sec","job_status":"done","queue_duration_s":3.965438,"scheduling_latency_s":3.965464,"redis_calls":14,"redis_duration_s":0.004312,"redis_read_bytes":26,"redis_write_bytes":4685,"redis_queues_calls":2,"redis_queues_duration_s":0.000821,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3729,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002396,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":630,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001095,"redis_shared_state_read_bytes":17,"redis_shared_state_write_bytes":326,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"external_http_count":1,"external_http_duration_s":0.011898400000006859,"cpu_s":0.032412,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.web_hook_worker.response_status":"success","extra.web_hook_worker.http_status":"ok","extra.web_hook_worker.signing_token_present":false,"duration_s":0.057162,"completed_at":"2026-08-20T06:16:18.584Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002252,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2191gitlab # [ 425.779998] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-20T06:16:18.589Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"74b3cd1a09de3a2dc0c4329c","created_at":"2026-08-20T06:16:15.193Z","trace_propagation_headers":{"sentry-trace":"57376d0fa0704fef820893a8fc100b28-fdad7b12a6b14b15","baggage":"sentry-trace_id=57376d0fa0704fef820893a8fc100b28,sentry-release=Unknown"},"correlation_id":"01M0EWXKF50DH4483AQ27VZBX0","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-08-20T06:16:15.199Z","job_size_bytes":23,"pid":3466,"sidekiq_tid":"m8rm","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-74b3cd1a09de3a2dc0c4329c: start","job_status":"start","queue_duration_s":3.389265,"scheduling_latency_s":3.389298}2192gitlab # [ 425.796244] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/20:06:16:18 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 682193gitlab # [ 425.798561] gitaly[891]: time="2026-08-20T06:16:18.680Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=579 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=2 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EX0CDMWRVMJ3TY7QR0ZG7R grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=194 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T06:16:18.671" grpc.time_ms=8.837 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc2194gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce'2195gitlab # [ 425.828397] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-20T06:16:18.735Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"74b3cd1a09de3a2dc0c4329c","created_at":"2026-08-20T06:16:15.193Z","trace_propagation_headers":{"sentry-trace":"57376d0fa0704fef820893a8fc100b28-fdad7b12a6b14b15","baggage":"sentry-trace_id=57376d0fa0704fef820893a8fc100b28,sentry-release=Unknown"},"correlation_id":"01M0EWXKF50DH4483AQ27VZBX0","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-08-20T06:16:15.199Z","job_size_bytes":23,"pid":3466,"sidekiq_tid":"m8rm","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-74b3cd1a09de3a2dc0c4329c: done: 0.146211 sec","job_status":"done","queue_duration_s":3.389265,"scheduling_latency_s":3.389298,"redis_calls":10,"redis_duration_s":0.00294,"redis_read_bytes":9,"redis_write_bytes":1029,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000551,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001628,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":534,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000761,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":200,"db_count":15,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.016,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":11,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.007,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.007,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.012,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.114234,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00050856,"duration_s":0.146211,"completed_at":"2026-08-20T06:16:18.735Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.021903,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2196gitlab # [ 425.875575] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-20T06:16:18.737Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"74e6d80c57ba40a4f535584a","created_at":"2026-08-20T06:16:15.400Z","trace_propagation_headers":{"sentry-trace":"57376d0fa0704fef820893a8fc100b28-fdad7b12a6b14b15","baggage":"sentry-trace_id=57376d0fa0704fef820893a8fc100b28,sentry-release=Unknown"},"correlation_id":"01M0EWXKF50DH4483AQ27VZBX0","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-08-20T06:16:15.413Z","job_size_bytes":3,"pid":3466,"sidekiq_tid":"m8rm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-74e6d80c57ba40a4f535584a: start","job_status":"start","queue_duration_s":3.324664,"scheduling_latency_s":3.324688}2197gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce', in 0.08 seconds)2198gitlab # [ 425.893070] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-20T06:16:18.790Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"74e6d80c57ba40a4f535584a","created_at":"2026-08-20T06:16:15.400Z","trace_propagation_headers":{"sentry-trace":"57376d0fa0704fef820893a8fc100b28-fdad7b12a6b14b15","baggage":"sentry-trace_id=57376d0fa0704fef820893a8fc100b28,sentry-release=Unknown"},"correlation_id":"01M0EWXKF50DH4483AQ27VZBX0","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-08-20T06:16:15.413Z","job_size_bytes":3,"pid":3466,"sidekiq_tid":"m8rm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-74e6d80c57ba40a4f535584a: done: 0.052354 sec","job_status":"done","queue_duration_s":3.324664,"scheduling_latency_s":3.324688,"redis_calls":10,"redis_duration_s":0.004311000000000001,"redis_read_bytes":9,"redis_write_bytes":1165,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000372,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001899,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00204,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":234,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.008,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.033781,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0007019,"duration_s":0.052354,"completed_at":"2026-08-20T06:16:18.789Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007961,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2199gitlab # [ 425.943633] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-20T06:16:18.792Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"c3f198f55518137e03594bac","created_at":"2026-08-20T06:16:15.437Z","trace_propagation_headers":{"sentry-trace":"57376d0fa0704fef820893a8fc100b28-fdad7b12a6b14b15","baggage":"sentry-trace_id=57376d0fa0704fef820893a8fc100b28,sentry-release=Unknown"},"correlation_id":"01M0EWXKF50DH4483AQ27VZBX0","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-08-20T06:16:15.453Z","job_size_bytes":3,"pid":3466,"sidekiq_tid":"m8rm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-c3f198f55518137e03594bac: start","job_status":"start","queue_duration_s":3.33975,"scheduling_latency_s":3.339775}2200gitlab # [ 425.961332] nixbot[3496]: INFO: ::ffff:127.0.0.1:58458 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce HTTP/1.1" 200 OK2201gitlab # [ 425.964108] gitlab-workhorse[817]: time="2026-08-20T06:16:18Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672202gitlab # [ 425.966372] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/20:06:16:18 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 1332203gitlab # [ 425.968719] gitaly[891]: time="2026-08-20T06:16:18.817Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0EX0CFWBD60XKK2MV462KKD grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T06:16:18.804" pid=891 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2204gitlab # [ 425.979129] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-20T06:16:18.842Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"c3f198f55518137e03594bac","created_at":"2026-08-20T06:16:15.437Z","trace_propagation_headers":{"sentry-trace":"57376d0fa0704fef820893a8fc100b28-fdad7b12a6b14b15","baggage":"sentry-trace_id=57376d0fa0704fef820893a8fc100b28,sentry-release=Unknown"},"correlation_id":"01M0EWXKF50DH4483AQ27VZBX0","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-08-20T06:16:15.453Z","job_size_bytes":3,"pid":3466,"sidekiq_tid":"m8rm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-c3f198f55518137e03594bac: done: 0.0497 sec","job_status":"done","queue_duration_s":3.33975,"scheduling_latency_s":3.339775,"redis_calls":10,"redis_duration_s":0.0032040000000000003,"redis_read_bytes":9,"redis_write_bytes":1205,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000403,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002337,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000464,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.007,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.032494,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0005,"duration_s":0.0497,"completed_at":"2026-08-20T06:16:18.842Z","load_balancing_strategy":"primary","db_duration_s":0.007269,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2205gitlab # [ 426.023987] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-20T06:16:18.844Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"b2509ee5c2cc3bded4958943","created_at":"2026-08-20T06:16:15.484Z","trace_propagation_headers":{"sentry-trace":"57376d0fa0704fef820893a8fc100b28-fdad7b12a6b14b15","baggage":"sentry-trace_id=57376d0fa0704fef820893a8fc100b28,sentry-release=Unknown"},"correlation_id":"01M0EWXKF50DH4483AQ27VZBX0","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-08-20T06:16:15.496Z","job_size_bytes":3,"pid":3466,"sidekiq_tid":"m8rm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-b2509ee5c2cc3bded4958943: start","job_status":"start","queue_duration_s":3.347063,"scheduling_latency_s":3.347083}2206gitlab # [ 426.039696] gitaly[891]: time="2026-08-20T06:16:18.818Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=1 command.system_time_ms=9 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EX0CFWBD60XKK2MV462KKD grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T06:16:18.804" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc2207gitlab # [ 426.053386] nix-daemon[3712]: accepted connection from pid 4273, user nixbot2208gitlab # [ 426.054369] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-20T06:16:18.891Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"b2509ee5c2cc3bded4958943","created_at":"2026-08-20T06:16:15.484Z","trace_propagation_headers":{"sentry-trace":"57376d0fa0704fef820893a8fc100b28-fdad7b12a6b14b15","baggage":"sentry-trace_id=57376d0fa0704fef820893a8fc100b28,sentry-release=Unknown"},"correlation_id":"01M0EWXKF50DH4483AQ27VZBX0","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-08-20T06:16:15.496Z","job_size_bytes":3,"pid":3466,"sidekiq_tid":"m8rm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-b2509ee5c2cc3bded4958943: done: 0.047728 sec","job_status":"done","queue_duration_s":3.347063,"scheduling_latency_s":3.347083,"redis_calls":13,"redis_duration_s":0.002372,"redis_read_bytes":66,"redis_write_bytes":1182,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000297,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001243,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000513,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000319,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.033323,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00024128,"duration_s":0.047728,"completed_at":"2026-08-20T06:16:18.891Z","load_balancing_strategy":"primary","db_duration_s":0.006484,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2209gitlab # [ 426.101074] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-20T06:16:18.893Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"eade66b2ab06902ec06e2033","created_at":"2026-08-20T06:16:15.498Z","trace_propagation_headers":{"sentry-trace":"57376d0fa0704fef820893a8fc100b28-fdad7b12a6b14b15","baggage":"sentry-trace_id=57376d0fa0704fef820893a8fc100b28,sentry-release=Unknown"},"correlation_id":"01M0EWXKF50DH4483AQ27VZBX0","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-08-20T06:16:15.508Z","job_size_bytes":3,"pid":3466,"sidekiq_tid":"m8rm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-eade66b2ab06902ec06e2033: start","job_status":"start","queue_duration_s":3.384581,"scheduling_latency_s":3.3846}2210gitlab # [ 426.117816] gitaly[891]: time="2026-08-20T06:16:18.818Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=1 command.system_time_ms=9 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EX0CFWBD60XKK2MV462KKD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T06:16:18.804" grpc.time_ms=14.115 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc2211gitlab # [ 426.132534] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/20:06:16:18 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 762212gitlab # [ 426.134530] gitlab-workhorse[817]: time="2026-08-20T06:16:19Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672213gitlab # [ 426.136323] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/20:06:16:19 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 732214gitlab # [ 426.138162] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-20T06:16:18.930Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"eade66b2ab06902ec06e2033","created_at":"2026-08-20T06:16:15.498Z","trace_propagation_headers":{"sentry-trace":"57376d0fa0704fef820893a8fc100b28-fdad7b12a6b14b15","baggage":"sentry-trace_id=57376d0fa0704fef820893a8fc100b28,sentry-release=Unknown"},"correlation_id":"01M0EWXKF50DH4483AQ27VZBX0","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-08-20T06:16:15.508Z","job_size_bytes":3,"pid":3466,"sidekiq_tid":"m8rm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-eade66b2ab06902ec06e2033: done: 0.036874 sec","job_status":"done","queue_duration_s":3.384581,"scheduling_latency_s":3.3846,"redis_calls":10,"redis_duration_s":0.001863,"redis_read_bytes":9,"redis_write_bytes":1159,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000281,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000883,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000699,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02581,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00024232,"duration_s":0.036874,"completed_at":"2026-08-20T06:16:18.930Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004777,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2215gitlab # [ 426.183062] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-20T06:16:18.931Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"592ee6f097bf21e0030e4f49","created_at":"2026-08-20T06:16:15.509Z","trace_propagation_headers":{"sentry-trace":"57376d0fa0704fef820893a8fc100b28-fdad7b12a6b14b15","baggage":"sentry-trace_id=57376d0fa0704fef820893a8fc100b28,sentry-release=Unknown"},"correlation_id":"01M0EWXKF50DH4483AQ27VZBX0","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-08-20T06:16:15.523Z","job_size_bytes":19,"pid":3466,"sidekiq_tid":"m8rm","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-592ee6f097bf21e0030e4f49: start","job_status":"start","queue_duration_s":3.407618,"scheduling_latency_s":3.407636}2216gitlab # [ 426.199660] gitaly[891]: time="2026-08-20T06:16:18.948Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=579 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EX0CNRE1EWMD093QZDC9DY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=186 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T06:16:18.940" grpc.time_ms=7.777 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc2217gitlab # [ 426.213107] gitaly[891]: time="2026-08-20T06:16:19.022Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0EX0CR7NQ2TQSNNJHHVXD2B grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T06:16:19.012" pid=891 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2218gitlab # [ 426.223176] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-20T06:16:18.964Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"592ee6f097bf21e0030e4f49","created_at":"2026-08-20T06:16:15.509Z","trace_propagation_headers":{"sentry-trace":"57376d0fa0704fef820893a8fc100b28-fdad7b12a6b14b15","baggage":"sentry-trace_id=57376d0fa0704fef820893a8fc100b28,sentry-release=Unknown"},"correlation_id":"01M0EWXKF50DH4483AQ27VZBX0","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-08-20T06:16:15.523Z","job_size_bytes":19,"pid":3466,"sidekiq_tid":"m8rm","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-592ee6f097bf21e0030e4f49: done: 0.033258 sec","job_status":"done","queue_duration_s":3.407618,"scheduling_latency_s":3.407636,"redis_calls":11,"redis_duration_s":0.00166,"redis_read_bytes":10,"redis_write_bytes":1121,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000346,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":287,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001017,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":640,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000297,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":194,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022475,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00025042,"duration_s":0.033258,"completed_at":"2026-08-20T06:16:18.964Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0037,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2219gitlab # [ 426.267630] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-20T06:16:18.966Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"fbb144dd6d48a0805989b876","created_at":"2026-08-20T06:16:15.530Z","trace_propagation_headers":{"sentry-trace":"57376d0fa0704fef820893a8fc100b28-fdad7b12a6b14b15","baggage":"sentry-trace_id=57376d0fa0704fef820893a8fc100b28,sentry-release=Unknown"},"correlation_id":"01M0EWXKF50DH4483AQ27VZBX0","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-08-20T06:16:15.540Z","job_size_bytes":66,"pid":3466,"sidekiq_tid":"m8rm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-fbb144dd6d48a0805989b876: start","job_status":"start","queue_duration_s":3.425597,"scheduling_latency_s":3.425615}2220gitlab # [ 426.286335] gitaly[891]: time="2026-08-20T06:16:19.023Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EX0CR7NQ2TQSNNJHHVXD2B grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T06:16:19.012" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc2221gitlab # [ 426.299595] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/20:06:16:19 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 652222gitlab # [ 426.301798] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-20T06:16:19.000Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"fbb144dd6d48a0805989b876","created_at":"2026-08-20T06:16:15.530Z","trace_propagation_headers":{"sentry-trace":"57376d0fa0704fef820893a8fc100b28-fdad7b12a6b14b15","baggage":"sentry-trace_id=57376d0fa0704fef820893a8fc100b28,sentry-release=Unknown"},"correlation_id":"01M0EWXKF50DH4483AQ27VZBX0","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-08-20T06:16:15.540Z","job_size_bytes":66,"pid":3466,"sidekiq_tid":"m8rm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-fbb144dd6d48a0805989b876: done: 0.034761 sec","job_status":"done","queue_duration_s":3.425597,"scheduling_latency_s":3.425615,"redis_calls":10,"redis_duration_s":0.001452,"redis_read_bytes":9,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000334,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":335,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.0008,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000318,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":240,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024127,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00023486,"duration_s":0.034761,"completed_at":"2026-08-20T06:16:19.000Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00491,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2223gitlab # [ 426.347863] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-20T06:16:19.003Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"fd3c716ae496ea24bc71051b","created_at":"2026-08-20T06:16:15.542Z","trace_propagation_headers":{"sentry-trace":"57376d0fa0704fef820893a8fc100b28-fdad7b12a6b14b15","baggage":"sentry-trace_id=57376d0fa0704fef820893a8fc100b28,sentry-release=Unknown"},"correlation_id":"01M0EWXKF50DH4483AQ27VZBX0","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-08-20T06:16:15.549Z","job_size_bytes":3,"pid":3466,"sidekiq_tid":"m8rm","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-fd3c716ae496ea24bc71051b: start","job_status":"start","queue_duration_s":3.453016,"scheduling_latency_s":3.453036}2224gitlab # [ 426.364952] gitaly[891]: time="2026-08-20T06:16:19.023Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EX0CR7NQ2TQSNNJHHVXD2B grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T06:16:19.012" grpc.time_ms=10.9 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc2225gitlab # [ 426.380053] gitlab-workhorse[817]: time="2026-08-20T06:16:19Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2162226gitlab # [ 426.381881] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/20:06:16:19 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 216 "" "git/2.55.0" 932227gitlab # [ 426.383774] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-20T06:16:19.047Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"fd3c716ae496ea24bc71051b","created_at":"2026-08-20T06:16:15.542Z","trace_propagation_headers":{"sentry-trace":"57376d0fa0704fef820893a8fc100b28-fdad7b12a6b14b15","baggage":"sentry-trace_id=57376d0fa0704fef820893a8fc100b28,sentry-release=Unknown"},"correlation_id":"01M0EWXKF50DH4483AQ27VZBX0","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-08-20T06:16:15.549Z","job_size_bytes":3,"pid":3466,"sidekiq_tid":"m8rm","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-fd3c716ae496ea24bc71051b: done: 0.0442 sec","job_status":"done","queue_duration_s":3.453016,"scheduling_latency_s":3.453036,"redis_calls":10,"redis_duration_s":0.0017699999999999999,"redis_read_bytes":9,"redis_write_bytes":973,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000327,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":281,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000982,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":506,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000461,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":186,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.032704,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00033908,"duration_s":0.0442,"completed_at":"2026-08-20T06:16:19.047Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004818,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2228gitlab # [ 426.428745] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-20T06:16:19.048Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"74690d68fa67e3619d17af4f","created_at":"2026-08-20T06:16:15.562Z","trace_propagation_headers":{"sentry-trace":"57376d0fa0704fef820893a8fc100b28-fdad7b12a6b14b15","baggage":"sentry-trace_id=57376d0fa0704fef820893a8fc100b28,sentry-release=Unknown"},"correlation_id":"01M0EWXKF50DH4483AQ27VZBX0","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-08-20T06:16:15.570Z","job_size_bytes":3,"pid":3466,"sidekiq_tid":"m8rm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-74690d68fa67e3619d17af4f: start","job_status":"start","queue_duration_s":3.477778,"scheduling_latency_s":3.477798}2229gitlab # [ 426.445210] gitaly[891]: time="2026-08-20T06:16:19.141Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=579 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=2 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EX0CW5ER9SA88DE4M6ZD18 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=186 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T06:16:19.132" grpc.time_ms=9.673 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc2230gitlab # [ 426.458028] gitaly[891]: time="2026-08-20T06:16:19.238Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0EX0CYA7ZPDM0ZVGRQFQ9BM grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T06:16:19.207" pid=891 remote_ip="2001:db8:1::1" request_sha=22300437632a556c435888000544c7c9bb3428e9 response_bytes=216 span.kind=server system=grpc2231gitlab # [ 426.468387] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-20T06:16:19.094Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"74690d68fa67e3619d17af4f","created_at":"2026-08-20T06:16:15.562Z","trace_propagation_headers":{"sentry-trace":"57376d0fa0704fef820893a8fc100b28-fdad7b12a6b14b15","baggage":"sentry-trace_id=57376d0fa0704fef820893a8fc100b28,sentry-release=Unknown"},"correlation_id":"01M0EWXKF50DH4483AQ27VZBX0","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-08-20T06:16:15.570Z","job_size_bytes":3,"pid":3466,"sidekiq_tid":"m8rm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-74690d68fa67e3619d17af4f: done: 0.046311 sec","job_status":"done","queue_duration_s":3.477778,"scheduling_latency_s":3.477798,"redis_calls":10,"redis_duration_s":0.0074789999999999995,"redis_read_bytes":9,"redis_write_bytes":1023,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000283,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.006854,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000342,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":198,"db_count":7,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025327,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00582314,"duration_s":0.046311,"completed_at":"2026-08-20T06:16:19.094Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0084,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2232gitlab # [ 426.513958] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-20T06:16:19.102Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"301d13f4955905262fc2b718","created_at":"2026-08-20T06:16:15.571Z","trace_propagation_headers":{"sentry-trace":"57376d0fa0704fef820893a8fc100b28-fdad7b12a6b14b15","baggage":"sentry-trace_id=57376d0fa0704fef820893a8fc100b28,sentry-release=Unknown"},"correlation_id":"01M0EWXKF50DH4483AQ27VZBX0","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-20T06:16:15.577Z","job_size_bytes":6,"pid":3466,"sidekiq_tid":"m8rm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-301d13f4955905262fc2b718: start","job_status":"start","queue_duration_s":3.524896,"scheduling_latency_s":3.524926}2233gitlab # [ 426.530118] gitaly[891]: time="2026-08-20T06:16:19.238Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=19 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1101 command.oublock=0 command.real_time_ms=26 command.spawn_token_fork_ms=5 command.system_time_ms=17 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M0EX0CYA7ZPDM0ZVGRQFQ9BM grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T06:16:19.207" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc2234gitlab # [ 426.544170] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-20T06:16:19.139Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"301d13f4955905262fc2b718","created_at":"2026-08-20T06:16:15.571Z","trace_propagation_headers":{"sentry-trace":"57376d0fa0704fef820893a8fc100b28-fdad7b12a6b14b15","baggage":"sentry-trace_id=57376d0fa0704fef820893a8fc100b28,sentry-release=Unknown"},"correlation_id":"01M0EWXKF50DH4483AQ27VZBX0","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-20T06:16:15.577Z","job_size_bytes":6,"pid":3466,"sidekiq_tid":"m8rm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-301d13f4955905262fc2b718: done: 0.036582 sec","job_status":"done","queue_duration_s":3.524896,"scheduling_latency_s":3.524926,"redis_calls":10,"redis_duration_s":0.0051400000000000005,"redis_read_bytes":9,"redis_write_bytes":1127,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.002138,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":321,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001802,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.0012,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":224,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020149,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00031754,"duration_s":0.036582,"completed_at":"2026-08-20T06:16:19.138Z","load_balancing_strategy":"primary","db_duration_s":0.003059,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2235gitlab # [ 426.588672] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-20T06:16:19.142Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"d18444525f3de417f7a27506","created_at":"2026-08-20T06:16:15.578Z","trace_propagation_headers":{"sentry-trace":"57376d0fa0704fef820893a8fc100b28-fdad7b12a6b14b15","baggage":"sentry-trace_id=57376d0fa0704fef820893a8fc100b28,sentry-release=Unknown"},"correlation_id":"01M0EWXKF50DH4483AQ27VZBX0","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-08-20T06:16:15.584Z","job_size_bytes":3,"pid":3466,"sidekiq_tid":"m8rm","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-d18444525f3de417f7a27506: start","job_status":"start","queue_duration_s":3.55754,"scheduling_latency_s":3.557564}2236gitlab # [ 426.604323] gitaly[891]: time="2026-08-20T06:16:19.239Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=19 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1101 command.oublock=0 command.real_time_ms=26 command.spawn_token_fork_ms=5 command.system_time_ms=17 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M0EX0CYA7ZPDM0ZVGRQFQ9BM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T06:16:19.207" grpc.time_ms=31.371 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc2237gitlab # [ 426.619347] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-20T06:16:19.199Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"d18444525f3de417f7a27506","created_at":"2026-08-20T06:16:15.578Z","trace_propagation_headers":{"sentry-trace":"57376d0fa0704fef820893a8fc100b28-fdad7b12a6b14b15","baggage":"sentry-trace_id=57376d0fa0704fef820893a8fc100b28,sentry-release=Unknown"},"correlation_id":"01M0EWXKF50DH4483AQ27VZBX0","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-08-20T06:16:15.584Z","job_size_bytes":3,"pid":3466,"sidekiq_tid":"m8rm","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-d18444525f3de417f7a27506: done: 0.057439 sec","job_status":"done","queue_duration_s":3.55754,"scheduling_latency_s":3.557564,"redis_calls":10,"redis_duration_s":0.005716,"redis_read_bytes":9,"redis_write_bytes":989,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00068,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":285,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00399,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":514,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001046,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":190,"db_count":7,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.013,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02893,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00251142,"duration_s":0.057439,"completed_at":"2026-08-20T06:16:19.199Z","load_balancing_strategy":"primary","db_duration_s":0.016606,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2238gitlab # [ 426.663173] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-20T06:16:19.203Z","retry":25,"queue":"default","version":0,"store":null,"args":["1"],"class":"Ci::TrackFirstPipelineSucceededWorker","jid":"9586a1d9a9aa431dcebcc1a7","created_at":"2026-08-20T06:16:15.593Z","trace_propagation_headers":{"sentry-trace":"57376d0fa0704fef820893a8fc100b28-fdad7b12a6b14b15","baggage":"sentry-trace_id=57376d0fa0704fef820893a8fc100b28,sentry-release=Unknown"},"correlation_id":"01M0EWXKF50DH4483AQ27VZBX0","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c5d2c9faee55896683425d4b50feeb49f6074c2dda34904072dea18e4eda0a9b","size_limiter":"validated","enqueued_at":"2026-08-20T06:16:15.600Z","job_size_bytes":3,"pid":3466,"sidekiq_tid":"m8rm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackFirstPipelineSucceededWorker JID-9586a1d9a9aa431dcebcc1a7: start","job_status":"start","queue_duration_s":3.602826,"scheduling_latency_s":3.602853}2239gitlab # [ 426.680154] gitaly[891]: time="2026-08-20T06:16:19.385Z" level=info msg="finished unary call with code OK" catfile.duration_ms=2 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=2 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EX0D2QK2JF6BANCJFYF7WA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T06:16:49.281" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:16:19.381" grpc.time_ms=3.118 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2240gitlab # [ 426.694002] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-20T06:16:19.272Z","retry":25,"queue":"default","version":0,"store":null,"args":["1"],"class":"Ci::TrackFirstPipelineSucceededWorker","jid":"9586a1d9a9aa431dcebcc1a7","created_at":"2026-08-20T06:16:15.593Z","trace_propagation_headers":{"sentry-trace":"57376d0fa0704fef820893a8fc100b28-fdad7b12a6b14b15","baggage":"sentry-trace_id=57376d0fa0704fef820893a8fc100b28,sentry-release=Unknown"},"correlation_id":"01M0EWXKF50DH4483AQ27VZBX0","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c5d2c9faee55896683425d4b50feeb49f6074c2dda34904072dea18e4eda0a9b","size_limiter":"validated","enqueued_at":"2026-08-20T06:16:15.600Z","job_size_bytes":3,"pid":3466,"sidekiq_tid":"m8rm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackFirstPipelineSucceededWorker JID-9586a1d9a9aa431dcebcc1a7: done: 0.069918 sec","job_status":"done","queue_duration_s":3.602826,"scheduling_latency_s":3.602853,"redis_calls":14,"redis_duration_s":0.003388,"redis_read_bytes":14,"redis_write_bytes":1335,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000335,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":317,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002155,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000898,"redis_shared_state_read_bytes":8,"redis_shared_state_write_bytes":436,"db_count":12,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.049751,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00027558,"duration_s":0.069918,"completed_at":"2026-08-20T06:16:19.272Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.012677,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2241gitlab # [ 426.739825] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-20T06:16:19.274Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"9ebac46ca921e196a469bea0","created_at":"2026-08-20T06:16:15.880Z","trace_propagation_headers":{"sentry-trace":"181e69fd75be480b9a034892514ec20e-cd0d391ffc1b438c","baggage":"sentry-trace_id=181e69fd75be480b9a034892514ec20e,sentry-release=Unknown"},"correlation_id":"01M0EWXCJSMX4YSNV9GED54BJ5","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-08-20T06:16:15.892Z","job_size_bytes":3,"pid":3466,"sidekiq_tid":"m8rm","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-9ebac46ca921e196a469bea0: start","job_status":"start","queue_duration_s":3.381854,"scheduling_latency_s":3.381872}2242gitlab # [ 426.756603] gitaly[891]: time="2026-08-20T06:16:19.418Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=590 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=12 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EX0D2QK2JF6BANCJFYF7WA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-08-20T06:16:49.299" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T06:16:19.399" grpc.time_ms=18.755 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2243gitlab # [ 426.770743] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-20T06:16:19.331Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"9ebac46ca921e196a469bea0","created_at":"2026-08-20T06:16:15.880Z","trace_propagation_headers":{"sentry-trace":"181e69fd75be480b9a034892514ec20e-cd0d391ffc1b438c","baggage":"sentry-trace_id=181e69fd75be480b9a034892514ec20e,sentry-release=Unknown"},"correlation_id":"01M0EWXCJSMX4YSNV9GED54BJ5","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-08-20T06:16:15.892Z","job_size_bytes":3,"pid":3466,"sidekiq_tid":"m8rm","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-9ebac46ca921e196a469bea0: done: 0.057103 sec","job_status":"done","queue_duration_s":3.381854,"scheduling_latency_s":3.381872,"redis_calls":19,"redis_duration_s":0.0030110000000000002,"redis_read_bytes":21,"redis_write_bytes":4290,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000584,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":678,"redis_queues_calls":3,"redis_queues_duration_s":0.000461,"redis_queues_read_bytes":3,"redis_queues_write_bytes":2261,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.001376,"redis_queues_metadata_read_bytes":9,"redis_queues_metadata_write_bytes":1024,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.00059,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":327,"db_count":7,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.004,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.004,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.012,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.035829,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.008361819999999999,"duration_s":0.057103,"completed_at":"2026-08-20T06:16:19.331Z","load_balancing_strategy":"primary","db_duration_s":0.017458,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2244gitlab # [ 426.816872] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-20T06:16:19.332Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","a2478df9051134e05b670bc2"],"class":"WebHooks::LogExecutionWorker","jid":"7e43f5478a4df8674a870d6d","created_at":"2026-08-20T06:16:17.523Z","trace_propagation_headers":{"sentry-trace":"181e69fd75be480b9a034892514ec20e-c1d179f7f32b48b7","baggage":"sentry-trace_id=181e69fd75be480b9a034892514ec20e,sentry-release=Unknown"},"correlation_id":"01M0EWXCJSMX4YSNV9GED54BJ5","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:25483e6980f3a87c81fa94a3da5749ab6fd02106418d95f88946ed6ec964dda7","size_limiter":"validated","enqueued_at":"2026-08-20T06:16:17.533Z","job_size_bytes":2593,"pid":3466,"sidekiq_tid":"m8rm","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-7e43f5478a4df8674a870d6d: start","job_status":"start","queue_duration_s":1.799077,"scheduling_latency_s":1.799101}2245gitlab # [ 426.834430] gitaly[891]: time="2026-08-20T06:16:19.436Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=4 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EX0D2QK2JF6BANCJFYF7WA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T06:16:29.243" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T06:16:19.425" grpc.time_ms=11.763 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2246gitlab # [ 426.848085] nixbot[3496]: {"ts": "2026-08-20T06:16:19.681Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/1ec92181522c6d831f5b4109cbf4ce466fbfedce \"HTTP/1.1 201 Created\""}2247gitlab # [ 426.850782] nixbot[3496]: {"ts": "2026-08-20T06:16:19.693Z", "level": "info", "logger": "nixbot.flake_prefetch", "msg": "prefetching flake inputs", "flake_dir": "/var/lib/nixbot/worktrees/1-1ec92181522c-4"}2248gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce'2249gitlab # [ 426.853124] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-20T06:16:19.380Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","a2478df9051134e05b670bc2"],"class":"WebHooks::LogExecutionWorker","jid":"7e43f5478a4df8674a870d6d","created_at":"2026-08-20T06:16:17.523Z","trace_propagation_headers":{"sentry-trace":"181e69fd75be480b9a034892514ec20e-c1d179f7f32b48b7","baggage":"sentry-trace_id=181e69fd75be480b9a034892514ec20e,sentry-release=Unknown"},"correlation_id":"01M0EWXCJSMX4YSNV9GED54BJ5","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:25483e6980f3a87c81fa94a3da5749ab6fd02106418d95f88946ed6ec964dda7","size_limiter":"validated","enqueued_at":"2026-08-20T06:16:17.533Z","job_size_bytes":2593,"pid":3466,"sidekiq_tid":"m8rm","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-7e43f5478a4df8674a870d6d: done: 0.047525 sec","job_status":"done","queue_duration_s":1.799077,"scheduling_latency_s":1.799101,"redis_calls":10,"redis_duration_s":0.002752,"redis_read_bytes":9,"redis_write_bytes":1045,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000369,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00195,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000433,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":4,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.007,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.007,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.031837,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00029612,"duration_s":0.047525,"completed_at":"2026-08-20T06:16:19.380Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.008381,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2250gitlab # [ 426.898914] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-20T06:16:19.382Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"20d37c0988aed80b64d8f8a3","created_at":"2026-08-20T06:16:18.123Z","trace_propagation_headers":{"sentry-trace":"7329e2132db249a49ce8429fe50bb31f-c5b032d172724179","baggage":"sentry-trace_id=7329e2132db249a49ce8429fe50bb31f,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EX0BRCBJ07HPA8F68V7DAW","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-20T06:16:18.129Z","job_size_bytes":3,"pid":3466,"sidekiq_tid":"m8rm","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-20d37c0988aed80b64d8f8a3: start","job_status":"start","queue_duration_s":1.252937,"scheduling_latency_s":1.252957}2251gitlab # [ 426.913801] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/20:06:16:19 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/1ec92181522c6d831f5b4109cbf4ce466fbfedce HTTP/1.1" 201 631 "" "python-httpx/0.28.1" 3922252gitlab # [ 426.916112] gitaly[891]: time="2026-08-20T06:16:19.468Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0EX0D2QK2JF6BANCJFYF7WA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-08-20T06:16:29.283" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T06:16:19.463" grpc.time_ms=0.835 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2253gitlab # [ 426.925995] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-20T06:16:19.703Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"20d37c0988aed80b64d8f8a3","created_at":"2026-08-20T06:16:18.123Z","trace_propagation_headers":{"sentry-trace":"7329e2132db249a49ce8429fe50bb31f-c5b032d172724179","baggage":"sentry-trace_id=7329e2132db249a49ce8429fe50bb31f,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EX0BRCBJ07HPA8F68V7DAW","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-20T06:16:18.129Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":3466,"job_status":"rescheduled","message":"PipelineProcessWorker JID-20d37c0988aed80b64d8f8a3: rescheduled"}2254gitlab # [ 426.940214] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-20T06:16:19.710Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"20d37c0988aed80b64d8f8a3","created_at":"2026-08-20T06:16:18.123Z","trace_propagation_headers":{"sentry-trace":"7329e2132db249a49ce8429fe50bb31f-c5b032d172724179","baggage":"sentry-trace_id=7329e2132db249a49ce8429fe50bb31f,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EX0BRCBJ07HPA8F68V7DAW","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-20T06:16:18.129Z","job_size_bytes":3,"pid":3466,"sidekiq_tid":"m8rm","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-20d37c0988aed80b64d8f8a3: done: 0.328422 sec","job_status":"done","queue_duration_s":1.252937,"scheduling_latency_s":1.252957,"gitaly_calls":3,"gitaly_duration_s":0.133883,"redis_calls":66,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.015039,"redis_read_bytes":150,"redis_write_bytes":18008,"redis_action_cable_calls":2,"redis_action_cable_duration_s":0.000749,"redis_action_cable_read_bytes":2,"redis_action_cable_write_bytes":407,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.000702,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_queues_calls":22,"redis_queues_duration_s":0.002548,"redis_queues_read_bytes":28,"redis_queues_write_bytes":12307,"redis_queues_metadata_calls":19,"redis_queues_metadata_duration_s":0.003597,"redis_queues_metadata_read_bytes":30,"redis_queues_metadata_write_bytes":3093,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.001141,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000744,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.004809,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":30,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":30,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.041,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":16,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":2,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.013,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.013,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.019,"db_ci_duration_s":0.022,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.14655,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.28423528,"duration_s":0.328422,"completed_at":"2026-08-20T06:16:19.710Z","load_balancing_strategy":"primary","db_duration_s":0.042138,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2255gitlab # [ 426.992238] nix-daemon[3712]: accepted connection from pid 4358, user nixbot2256gitlab # [ 426.993178] nix-daemon[3712]: accepted connection from pid 4366, user nixbot2257gitlab # [ 426.994117] gitaly[891]: time="2026-08-20T06:16:19.486Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=570 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=4 command.system_time_ms=6 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M0EX0D2QK2JF6BANCJFYF7WA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-08-20T06:16:29.292" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T06:16:19.473" grpc.time_ms=12.956 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2258gitlab # [ 427.007585] gitaly[891]: time="2026-08-20T06:16:19.534Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EX0BRCBJ07HPA8F68V7DAW grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3897 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T06:16:19.533" grpc.time_ms=0.668 pid=891 span.kind=server system=grpc2259gitlab # [ 427.017246] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-20T06:16:19.712Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","c5dd2736b947c2719f80c147"],"class":"WebHooks::LogExecutionWorker","jid":"9897bc2bc1ced9fcc41e5c34","created_at":"2026-08-20T06:16:18.567Z","trace_propagation_headers":{"sentry-trace":"7429d374967043b8bb266ead30e0bef7-154dcc8b169f4b29","baggage":"sentry-trace_id=7429d374967043b8bb266ead30e0bef7,sentry-release=Unknown"},"correlation_id":"01M0EWXJ3WG3YKR9JMR4GKTDPV","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:87bb777c19b7170df6dbb0471fc2062c9b975d41b745093936e87b6571e3a3e7","size_limiter":"validated","enqueued_at":"2026-08-20T06:16:18.572Z","job_size_bytes":2592,"pid":3466,"sidekiq_tid":"m8rm","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-9897bc2bc1ced9fcc41e5c34: start","job_status":"start","queue_duration_s":1.140177,"scheduling_latency_s":1.140202}2260gitlab # [ 427.034137] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-20T06:16:19.739Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","c5dd2736b947c2719f80c147"],"class":"WebHooks::LogExecutionWorker","jid":"9897bc2bc1ced9fcc41e5c34","created_at":"2026-08-20T06:16:18.567Z","trace_propagation_headers":{"sentry-trace":"7429d374967043b8bb266ead30e0bef7-154dcc8b169f4b29","baggage":"sentry-trace_id=7429d374967043b8bb266ead30e0bef7,sentry-release=Unknown"},"correlation_id":"01M0EWXJ3WG3YKR9JMR4GKTDPV","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:87bb777c19b7170df6dbb0471fc2062c9b975d41b745093936e87b6571e3a3e7","size_limiter":"validated","enqueued_at":"2026-08-20T06:16:18.572Z","job_size_bytes":2592,"pid":3466,"sidekiq_tid":"m8rm","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-9897bc2bc1ced9fcc41e5c34: done: 0.027297 sec","job_status":"done","queue_duration_s":1.140177,"scheduling_latency_s":1.140202,"redis_calls":7,"redis_duration_s":0.0013930000000000001,"redis_read_bytes":5,"redis_write_bytes":671,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000992,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000401,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":3,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019439,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.027297,"completed_at":"2026-08-20T06:16:19.739Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003418,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2261gitlab # [ 427.077535] nixbot[3496]: {"ts": "2026-08-20T06:16:19.881Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-1ec92181522c-4", "argv0": "bwrap"}2262gitlab # [ 427.079874] gitaly[891]: time="2026-08-20T06:16:19.542Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EX0D2QK2JF6BANCJFYF7WA grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4153 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T06:16:19.542" grpc.time_ms=0.419 pid=891 span.kind=server system=grpc2263gitlab # [ 427.089985] gitaly[891]: time="2026-08-20T06:16:19.567Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EX0D2QK2JF6BANCJFYF7WA grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4155 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T06:16:19.567" grpc.time_ms=0.476 pid=891 span.kind=server system=grpc2264gitlab # [ 427.101370] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-20T06:16:19.741Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"a7f5f4e6ba4238043fc9cc1c","created_at":"2026-08-20T06:16:19.316Z","trace_propagation_headers":{"sentry-trace":"181e69fd75be480b9a034892514ec20e-5f4305ffbfcf4882","baggage":"sentry-trace_id=181e69fd75be480b9a034892514ec20e,sentry-release=Unknown"},"correlation_id":"01M0EWXCJSMX4YSNV9GED54BJ5","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-08-20T06:16:19.322Z","job_size_bytes":3,"pid":3466,"sidekiq_tid":"m8rm","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-a7f5f4e6ba4238043fc9cc1c: start","job_status":"start","queue_duration_s":0.418982,"scheduling_latency_s":0.419005}2265gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce', in 0.23 seconds)2266(finished: subtest: push delivers the webhook, in 94.38 seconds)2267subtest: eval and build post commit statuses2268gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/1ec92181522c6d831f5b4109cbf4ce466fbfedce/statuses2269gitlab # [ 427.119012] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-20T06:16:19.888Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"a7f5f4e6ba4238043fc9cc1c","created_at":"2026-08-20T06:16:19.316Z","trace_propagation_headers":{"sentry-trace":"181e69fd75be480b9a034892514ec20e-5f4305ffbfcf4882","baggage":"sentry-trace_id=181e69fd75be480b9a034892514ec20e,sentry-release=Unknown"},"correlation_id":"01M0EWXCJSMX4YSNV9GED54BJ5","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-08-20T06:16:19.322Z","job_size_bytes":3,"pid":3466,"sidekiq_tid":"m8rm","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-a7f5f4e6ba4238043fc9cc1c: done: 0.146966 sec","job_status":"done","queue_duration_s":0.418982,"scheduling_latency_s":0.419005,"redis_calls":11,"redis_duration_s":0.003145,"redis_read_bytes":10,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000422,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002155,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":672,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000568,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":210,"db_count":12,"db_write_count":3,"db_cached_count":0,"db_txn_count":3,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.021,"db_main_txn_count":3,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.004,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.009,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.021,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.097264,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0004634,"duration_s":0.146966,"completed_at":"2026-08-20T06:16:19.888Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.032858,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2270gitlab # [ 427.164845] nixbot[3496]: INFO: ::ffff:127.0.0.1:58472 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1ec92181522c6d831f5b4109cbf4ce466fbfedce HTTP/1.1" 200 OK2271gitlab # [ 427.166817] gitaly[891]: time="2026-08-20T06:16:19.570Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EX0BRCBJ07HPA8F68V7DAW grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3895 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T06:16:19.570" grpc.time_ms=0.358 pid=891 span.kind=server system=grpc2272gitlab # [ 427.176586] gitaly[891]: time="2026-08-20T06:16:19.574Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0EX0D2QK2JF6BANCJFYF7WA diskcache=ba5ce32b-fb0a-4648-b374-98ac740fe9af grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-20T06:16:29.009" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T06:16:19.490" pid=891 ref=refs/keep-around/1ec92181522c6d831f5b4109cbf4ce466fbfedce remote_ip="2001:db8:1::1" revision=1ec92181522c6d831f5b4109cbf4ce466fbfedce span.kind=server system=grpc username=root2273gitlab # [ 427.188029] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-20T06:16:19.890Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"2ca6478daf32d1f850fdb944","created_at":"2026-08-20T06:16:19.472Z","trace_propagation_headers":{"sentry-trace":"7329e2132db249a49ce8429fe50bb31f-f4a6414c9529470c","baggage":"sentry-trace_id=7329e2132db249a49ce8429fe50bb31f,sentry-release=Unknown"},"correlation_id":"01M0EX0BRCBJ07HPA8F68V7DAW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-08-20T06:16:19.474Z","job_size_bytes":23,"pid":3466,"sidekiq_tid":"m8rm","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-2ca6478daf32d1f850fdb944: start","job_status":"start","queue_duration_s":0.415859,"scheduling_latency_s":0.415889}2274gitlab # [ 427.204430] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-20T06:16:19.950Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"2ca6478daf32d1f850fdb944","created_at":"2026-08-20T06:16:19.472Z","trace_propagation_headers":{"sentry-trace":"7329e2132db249a49ce8429fe50bb31f-f4a6414c9529470c","baggage":"sentry-trace_id=7329e2132db249a49ce8429fe50bb31f,sentry-release=Unknown"},"correlation_id":"01M0EX0BRCBJ07HPA8F68V7DAW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-08-20T06:16:19.474Z","job_size_bytes":23,"pid":3466,"sidekiq_tid":"m8rm","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-2ca6478daf32d1f850fdb944: done: 0.060399 sec","job_status":"done","queue_duration_s":0.415859,"scheduling_latency_s":0.415889,"redis_calls":7,"redis_duration_s":0.0017360000000000001,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001263,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000473,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.045968,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.060399,"completed_at":"2026-08-20T06:16:19.950Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.008917,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2275gitlab # [ 427.248903] gitaly[891]: time="2026-08-20T06:16:19.575Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=72 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5109 command.oublock=8 command.real_time_ms=78 command.spawn_token_fork_ms=1 command.system_time_ms=47 command.user_time_ms=25 component=gitaly.UnaryServerInterceptor correlation_id=01M0EX0D2QK2JF6BANCJFYF7WA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-20T06:16:29.009" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T06:16:19.490" grpc.time_ms=84.603 pid=891 ref=refs/keep-around/1ec92181522c6d831f5b4109cbf4ce466fbfedce remote_ip="2001:db8:1::1" revision=1ec92181522c6d831f5b4109cbf4ce466fbfedce span.kind=server system=grpc username=root2276gitlab # [ 427.264072] nix-daemon[3712]: accepted connection from pid 4379, user nixbot2277gitlab # [ 427.266263] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-20T06:16:19.952Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"41d3b3e35115246432757f6b","created_at":"2026-08-20T06:16:19.580Z","trace_propagation_headers":{"sentry-trace":"65cec15b18ec43659ffc9e9d39c1e0a8-4a59b86a23a442ba","baggage":"sentry-trace_id=65cec15b18ec43659ffc9e9d39c1e0a8,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EX0D2QK2JF6BANCJFYF7WA","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-08-20T06:16:19.585Z","job_size_bytes":65,"pid":3466,"sidekiq_tid":"m8rm","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-41d3b3e35115246432757f6b: start","job_status":"start","queue_duration_s":0.366496,"scheduling_latency_s":0.36652}2278gitlab # [ 427.283075] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-20T06:16:20.002Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"41d3b3e35115246432757f6b","created_at":"2026-08-20T06:16:19.580Z","trace_propagation_headers":{"sentry-trace":"65cec15b18ec43659ffc9e9d39c1e0a8-4a59b86a23a442ba","baggage":"sentry-trace_id=65cec15b18ec43659ffc9e9d39c1e0a8,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EX0D2QK2JF6BANCJFYF7WA","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-08-20T06:16:19.585Z","job_size_bytes":65,"pid":3466,"sidekiq_tid":"m8rm","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-41d3b3e35115246432757f6b: done: 0.050564 sec","job_status":"done","queue_duration_s":0.366496,"scheduling_latency_s":0.36652,"redis_calls":7,"redis_duration_s":0.003608,"redis_read_bytes":5,"redis_write_bytes":731,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.003092,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":503,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000516,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":228,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.015,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.01,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.028559,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.050564,"completed_at":"2026-08-20T06:16:20.002Z","load_balancing_strategy":"primary","db_duration_s":0.014777,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2279gitlab # [ 427.327089] gitaly[891]: time="2026-08-20T06:16:19.578Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EX0D2QK2JF6BANCJFYF7WA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T06:16:49.478" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:16:19.578" grpc.time_ms=0.34 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2280gitlab # [ 427.340515] gitaly[891]: time="2026-08-20T06:16:19.596Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EX0BRCBJ07HPA8F68V7DAW grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3897 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T06:16:19.596" grpc.time_ms=0.345 pid=891 span.kind=server system=grpc2281gitlab # [ 427.350708] nix-daemon[3712]: accepted connection from pid 4396, user nixbot2282gitlab # [ 427.351638] nix-daemon[3712]: accepted connection from pid 4379, user nixbot2283gitlab # [ 427.352667] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-20T06:16:20.005Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"5e5fda9684146893e8a2de72","created_at":"2026-08-20T06:16:19.586Z","trace_propagation_headers":{"sentry-trace":"65cec15b18ec43659ffc9e9d39c1e0a8-4a59b86a23a442ba","baggage":"sentry-trace_id=65cec15b18ec43659ffc9e9d39c1e0a8,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EX0D2QK2JF6BANCJFYF7WA","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-08-20T06:16:19.590Z","job_size_bytes":65,"pid":3466,"sidekiq_tid":"m8rm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-5e5fda9684146893e8a2de72: start","job_status":"start","queue_duration_s":0.414247,"scheduling_latency_s":0.414273}2284gitlab # [ 427.369948] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-20T06:16:20.128Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"5e5fda9684146893e8a2de72","created_at":"2026-08-20T06:16:19.586Z","trace_propagation_headers":{"sentry-trace":"65cec15b18ec43659ffc9e9d39c1e0a8-4a59b86a23a442ba","baggage":"sentry-trace_id=65cec15b18ec43659ffc9e9d39c1e0a8,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EX0D2QK2JF6BANCJFYF7WA","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-08-20T06:16:19.590Z","job_size_bytes":65,"pid":3466,"sidekiq_tid":"m8rm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-5e5fda9684146893e8a2de72: done: 0.123235 sec","job_status":"done","queue_duration_s":0.414247,"scheduling_latency_s":0.414273,"redis_calls":10,"redis_duration_s":0.0041990000000000005,"redis_read_bytes":14,"redis_write_bytes":857,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001786,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":494,"redis_shared_state_calls":5,"redis_shared_state_duration_s":0.002413,"redis_shared_state_read_bytes":10,"redis_shared_state_write_bytes":363,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.044,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.037,"db_ci_duration_s":0.007,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.070457,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.123235,"completed_at":"2026-08-20T06:16:20.128Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.04496,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2285gitlab # [ 427.414519] gitaly[891]: time="2026-08-20T06:16:19.606Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0EX0BRCBJ07HPA8F68V7DAW diskcache=a47eee58-b9f4-4758-b608-aa03807f8948 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-20T06:16:49.481" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-20T06:16:19.482" pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2286gitlab # [ 427.424562] gitaly[891]: time="2026-08-20T06:16:19.607Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=112 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7114 command.oublock=0 command.real_time_ms=119 command.spawn_token_fork_ms=1 command.system_time_ms=72 command.user_time_ms=40 component=gitaly.UnaryServerInterceptor correlation_id=01M0EX0BRCBJ07HPA8F68V7DAW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-20T06:16:49.481" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T06:16:19.482" grpc.time_ms=124.228 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2287gitlab # [ 427.438689] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-20T06:16:20.129Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"fdac106df9afe271d2a9d91d","created_at":"2026-08-20T06:16:19.612Z","trace_propagation_headers":{"sentry-trace":"7329e2132db249a49ce8429fe50bb31f-f4a6414c9529470c","baggage":"sentry-trace_id=7329e2132db249a49ce8429fe50bb31f,sentry-release=Unknown"},"correlation_id":"01M0EX0BRCBJ07HPA8F68V7DAW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-08-20T06:16:19.614Z","job_size_bytes":3,"pid":3466,"sidekiq_tid":"m8rm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-fdac106df9afe271d2a9d91d: start","job_status":"start","queue_duration_s":0.515215,"scheduling_latency_s":0.515237}2288gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/1ec92181522c6d831f5b4109cbf4ce466fbfedce/statuses, in 0.34 seconds)2289gitlab # [ 427.457469] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-20T06:16:20.167Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"fdac106df9afe271d2a9d91d","created_at":"2026-08-20T06:16:19.612Z","trace_propagation_headers":{"sentry-trace":"7329e2132db249a49ce8429fe50bb31f-f4a6414c9529470c","baggage":"sentry-trace_id=7329e2132db249a49ce8429fe50bb31f,sentry-release=Unknown"},"correlation_id":"01M0EX0BRCBJ07HPA8F68V7DAW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-08-20T06:16:19.614Z","job_size_bytes":3,"pid":3466,"sidekiq_tid":"m8rm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-fdac106df9afe271d2a9d91d: done: 0.037989 sec","job_status":"done","queue_duration_s":0.515215,"scheduling_latency_s":0.515237,"redis_calls":7,"redis_duration_s":0.001639,"redis_read_bytes":5,"redis_write_bytes":746,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001172,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000467,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":234,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.008,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02472,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.037989,"completed_at":"2026-08-20T06:16:20.167Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.008217,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2290gitlab # [ 427.500217] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/20:06:16:20 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/1ec92181522c6d831f5b4109cbf4ce466fbfedce/statuses HTTP/1.1" 200 633 "" "curl/8.21.0" 2482291gitlab # [ 427.503056] gitaly[891]: time="2026-08-20T06:16:19.663Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EX0BRCBJ07HPA8F68V7DAW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-20T06:16:49.662" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:16:19.662" grpc.time_ms=0.77 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2292gitlab # [ 427.519357] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-20T06:16:20.172Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"43c0851bd6b4144b4489f70f","created_at":"2026-08-20T06:16:19.621Z","trace_propagation_headers":{"sentry-trace":"7329e2132db249a49ce8429fe50bb31f-f4a6414c9529470c","baggage":"sentry-trace_id=7329e2132db249a49ce8429fe50bb31f,sentry-release=Unknown"},"correlation_id":"01M0EX0BRCBJ07HPA8F68V7DAW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-08-20T06:16:19.624Z","job_size_bytes":3,"pid":3466,"sidekiq_tid":"m8rm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-43c0851bd6b4144b4489f70f: start","job_status":"start","queue_duration_s":0.547341,"scheduling_latency_s":0.547365}2293gitlab # [ 427.535442] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-20T06:16:20.212Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"43c0851bd6b4144b4489f70f","created_at":"2026-08-20T06:16:19.621Z","trace_propagation_headers":{"sentry-trace":"7329e2132db249a49ce8429fe50bb31f-f4a6414c9529470c","baggage":"sentry-trace_id=7329e2132db249a49ce8429fe50bb31f,sentry-release=Unknown"},"correlation_id":"01M0EX0BRCBJ07HPA8F68V7DAW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-08-20T06:16:19.624Z","job_size_bytes":3,"pid":3466,"sidekiq_tid":"m8rm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-43c0851bd6b4144b4489f70f: done: 0.040372 sec","job_status":"done","queue_duration_s":0.547341,"scheduling_latency_s":0.547365,"redis_calls":7,"redis_duration_s":0.005175,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00163,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.003545,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.007,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023992,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.040372,"completed_at":"2026-08-20T06:16:20.212Z","load_balancing_strategy":"primary","db_duration_s":0.006771,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2294gitlab # [ 427.578795] gitaly[891]: time="2026-08-20T06:16:19.695Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EX0BRCBJ07HPA8F68V7DAW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T06:16:49.694" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:16:19.695" grpc.time_ms=0.514 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2295gitlab # [ 427.591609] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-20T06:16:20.214Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"3e0a2da472dc9ddd19a3fb44","created_at":"2026-08-20T06:16:19.633Z","trace_propagation_headers":{"sentry-trace":"7329e2132db249a49ce8429fe50bb31f-f4a6414c9529470c","baggage":"sentry-trace_id=7329e2132db249a49ce8429fe50bb31f,sentry-release=Unknown"},"correlation_id":"01M0EX0BRCBJ07HPA8F68V7DAW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-08-20T06:16:19.635Z","job_size_bytes":3,"pid":3466,"sidekiq_tid":"m8rm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-3e0a2da472dc9ddd19a3fb44: start","job_status":"start","queue_duration_s":0.578871,"scheduling_latency_s":0.578893}2296gitlab # [ 427.607750] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-20T06:16:20.254Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"3e0a2da472dc9ddd19a3fb44","created_at":"2026-08-20T06:16:19.633Z","trace_propagation_headers":{"sentry-trace":"7329e2132db249a49ce8429fe50bb31f-f4a6414c9529470c","baggage":"sentry-trace_id=7329e2132db249a49ce8429fe50bb31f,sentry-release=Unknown"},"correlation_id":"01M0EX0BRCBJ07HPA8F68V7DAW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-08-20T06:16:19.635Z","job_size_bytes":3,"pid":3466,"sidekiq_tid":"m8rm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-3e0a2da472dc9ddd19a3fb44: done: 0.040723 sec","job_status":"done","queue_duration_s":0.578871,"scheduling_latency_s":0.578893,"redis_calls":10,"redis_duration_s":0.003702,"redis_read_bytes":62,"redis_write_bytes":808,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001543,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000437,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001722,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024854,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.040723,"completed_at":"2026-08-20T06:16:20.254Z","load_balancing_strategy":"primary","db_duration_s":0.006796,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2297gitlab # [ 427.651843] gitaly[891]: time="2026-08-20T06:16:20.199Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EX0DW005A1DGDMGGJC1W1F grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T06:16:50.097" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:16:20.197" grpc.time_ms=0.772 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2298gitlab # [ 427.665261] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-20T06:16:20.256Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"c41a658eb47ab75bde151be7","created_at":"2026-08-20T06:16:19.635Z","trace_propagation_headers":{"sentry-trace":"7329e2132db249a49ce8429fe50bb31f-f4a6414c9529470c","baggage":"sentry-trace_id=7329e2132db249a49ce8429fe50bb31f,sentry-release=Unknown"},"correlation_id":"01M0EX0BRCBJ07HPA8F68V7DAW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-08-20T06:16:19.637Z","job_size_bytes":3,"pid":3466,"sidekiq_tid":"m8rm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-c41a658eb47ab75bde151be7: start","job_status":"start","queue_duration_s":0.618522,"scheduling_latency_s":0.61854}2299gitlab # [ 427.684688] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-20T06:16:20.286Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"c41a658eb47ab75bde151be7","created_at":"2026-08-20T06:16:19.635Z","trace_propagation_headers":{"sentry-trace":"7329e2132db249a49ce8429fe50bb31f-f4a6414c9529470c","baggage":"sentry-trace_id=7329e2132db249a49ce8429fe50bb31f,sentry-release=Unknown"},"correlation_id":"01M0EX0BRCBJ07HPA8F68V7DAW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-08-20T06:16:19.637Z","job_size_bytes":3,"pid":3466,"sidekiq_tid":"m8rm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-c41a658eb47ab75bde151be7: done: 0.029798 sec","job_status":"done","queue_duration_s":0.618522,"scheduling_latency_s":0.61854,"redis_calls":7,"redis_duration_s":0.0022890000000000002,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001827,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000462,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019049,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.029798,"completed_at":"2026-08-20T06:16:20.286Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006011,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2300gitlab # [ 427.732125] gitaly[891]: time="2026-08-20T06:16:20.494Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EX0D2QK2JF6BANCJFYF7WA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-20T06:16:50.492" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:16:20.492" grpc.time_ms=1.402 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2301gitlab # [ 427.744706] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-20T06:16:20.287Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"9260527e8a2fe3e0e9b9e82b","created_at":"2026-08-20T06:16:19.638Z","trace_propagation_headers":{"sentry-trace":"7329e2132db249a49ce8429fe50bb31f-f4a6414c9529470c","baggage":"sentry-trace_id=7329e2132db249a49ce8429fe50bb31f,sentry-release=Unknown"},"correlation_id":"01M0EX0BRCBJ07HPA8F68V7DAW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-08-20T06:16:19.640Z","job_size_bytes":19,"pid":3466,"sidekiq_tid":"m8rm","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-9260527e8a2fe3e0e9b9e82b: start","job_status":"start","queue_duration_s":0.646737,"scheduling_latency_s":0.646754}2302gitlab # [ 427.760864] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-20T06:16:20.312Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"9260527e8a2fe3e0e9b9e82b","created_at":"2026-08-20T06:16:19.638Z","trace_propagation_headers":{"sentry-trace":"7329e2132db249a49ce8429fe50bb31f-f4a6414c9529470c","baggage":"sentry-trace_id=7329e2132db249a49ce8429fe50bb31f,sentry-release=Unknown"},"correlation_id":"01M0EX0BRCBJ07HPA8F68V7DAW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-08-20T06:16:19.640Z","job_size_bytes":19,"pid":3466,"sidekiq_tid":"m8rm","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-9260527e8a2fe3e0e9b9e82b: done: 0.024698 sec","job_status":"done","queue_duration_s":0.646737,"scheduling_latency_s":0.646754,"redis_calls":8,"redis_duration_s":0.001891,"redis_read_bytes":6,"redis_write_bytes":764,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001471,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":570,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00042,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":194,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016869,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.024698,"completed_at":"2026-08-20T06:16:20.312Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003123,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2303gitlab # [ 427.803171] gitaly[891]: time="2026-08-20T06:16:20.538Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EX0D2QK2JF6BANCJFYF7WA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T06:16:50.536" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:16:20.536" grpc.time_ms=1.166 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2304gitlab # [ 427.815768] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-20T06:16:20.313Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"835ac1c22817879ecc00027f","created_at":"2026-08-20T06:16:19.641Z","trace_propagation_headers":{"sentry-trace":"7329e2132db249a49ce8429fe50bb31f-f4a6414c9529470c","baggage":"sentry-trace_id=7329e2132db249a49ce8429fe50bb31f,sentry-release=Unknown"},"correlation_id":"01M0EX0BRCBJ07HPA8F68V7DAW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-08-20T06:16:19.643Z","job_size_bytes":66,"pid":3466,"sidekiq_tid":"m8rm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-835ac1c22817879ecc00027f: start","job_status":"start","queue_duration_s":0.669755,"scheduling_latency_s":0.669772}2305gitlab # [ 427.833322] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-20T06:16:20.336Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"835ac1c22817879ecc00027f","created_at":"2026-08-20T06:16:19.641Z","trace_propagation_headers":{"sentry-trace":"7329e2132db249a49ce8429fe50bb31f-f4a6414c9529470c","baggage":"sentry-trace_id=7329e2132db249a49ce8429fe50bb31f,sentry-release=Unknown"},"correlation_id":"01M0EX0BRCBJ07HPA8F68V7DAW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-08-20T06:16:19.643Z","job_size_bytes":66,"pid":3466,"sidekiq_tid":"m8rm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-835ac1c22817879ecc00027f: done: 0.022683 sec","job_status":"done","queue_duration_s":0.669755,"scheduling_latency_s":0.669772,"redis_calls":7,"redis_duration_s":0.001733,"redis_read_bytes":5,"redis_write_bytes":761,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001271,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000462,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":240,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015968,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.022683,"completed_at":"2026-08-20T06:16:20.336Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002139,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2306gitlab # [ 427.877015] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-20T06:16:20.338Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"097609196eee88293997fc18","created_at":"2026-08-20T06:16:19.644Z","trace_propagation_headers":{"sentry-trace":"7329e2132db249a49ce8429fe50bb31f-f4a6414c9529470c","baggage":"sentry-trace_id=7329e2132db249a49ce8429fe50bb31f,sentry-release=Unknown"},"correlation_id":"01M0EX0BRCBJ07HPA8F68V7DAW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-08-20T06:16:19.646Z","job_size_bytes":3,"pid":3466,"sidekiq_tid":"m8rm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-097609196eee88293997fc18: start","job_status":"start","queue_duration_s":0.691691,"scheduling_latency_s":0.691709}2307gitlab # [ 427.893378] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-20T06:16:20.364Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"097609196eee88293997fc18","created_at":"2026-08-20T06:16:19.644Z","trace_propagation_headers":{"sentry-trace":"7329e2132db249a49ce8429fe50bb31f-f4a6414c9529470c","baggage":"sentry-trace_id=7329e2132db249a49ce8429fe50bb31f,sentry-release=Unknown"},"correlation_id":"01M0EX0BRCBJ07HPA8F68V7DAW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-08-20T06:16:19.646Z","job_size_bytes":3,"pid":3466,"sidekiq_tid":"m8rm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-097609196eee88293997fc18: done: 0.026175 sec","job_status":"done","queue_duration_s":0.691691,"scheduling_latency_s":0.691709,"redis_calls":7,"redis_duration_s":0.00188,"redis_read_bytes":5,"redis_write_bytes":656,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001349,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":458,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000531,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":198,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018065,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.026175,"completed_at":"2026-08-20T06:16:20.364Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003811,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2308gitlab # [ 427.936955] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-20T06:16:20.365Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"c07a4dfb236d909c28bd9910","created_at":"2026-08-20T06:16:19.646Z","trace_propagation_headers":{"sentry-trace":"7329e2132db249a49ce8429fe50bb31f-f4a6414c9529470c","baggage":"sentry-trace_id=7329e2132db249a49ce8429fe50bb31f,sentry-release=Unknown"},"correlation_id":"01M0EX0BRCBJ07HPA8F68V7DAW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-20T06:16:19.648Z","job_size_bytes":6,"pid":3466,"sidekiq_tid":"m8rm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-c07a4dfb236d909c28bd9910: start","job_status":"start","queue_duration_s":0.717101,"scheduling_latency_s":0.717119}2309gitlab # [ 427.952974] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-20T06:16:20.380Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"c07a4dfb236d909c28bd9910","created_at":"2026-08-20T06:16:19.646Z","trace_propagation_headers":{"sentry-trace":"7329e2132db249a49ce8429fe50bb31f-f4a6414c9529470c","baggage":"sentry-trace_id=7329e2132db249a49ce8429fe50bb31f,sentry-release=Unknown"},"correlation_id":"01M0EX0BRCBJ07HPA8F68V7DAW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-20T06:16:19.648Z","job_size_bytes":6,"pid":3466,"sidekiq_tid":"m8rm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-c07a4dfb236d909c28bd9910: done: 0.015024 sec","job_status":"done","queue_duration_s":0.717101,"scheduling_latency_s":0.717119,"redis_calls":7,"redis_duration_s":0.0018709999999999998,"redis_read_bytes":5,"redis_write_bytes":721,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001349,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":497,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000522,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":224,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009595,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015024,"completed_at":"2026-08-20T06:16:20.380Z","load_balancing_strategy":"primary","db_duration_s":0.000303,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2310gitlab # [ 427.995699] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-20T06:16:20.382Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"b65ebb862f102f7af2ee2919","created_at":"2026-08-20T06:16:19.649Z","trace_propagation_headers":{"sentry-trace":"7329e2132db249a49ce8429fe50bb31f-f4a6414c9529470c","baggage":"sentry-trace_id=7329e2132db249a49ce8429fe50bb31f,sentry-release=Unknown"},"correlation_id":"01M0EX0BRCBJ07HPA8F68V7DAW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-08-20T06:16:19.651Z","job_size_bytes":3,"pid":3466,"sidekiq_tid":"m8rm","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-b65ebb862f102f7af2ee2919: start","job_status":"start","queue_duration_s":0.73087,"scheduling_latency_s":0.730887}2311gitlab # [ 428.011396] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-20T06:16:20.408Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"b65ebb862f102f7af2ee2919","created_at":"2026-08-20T06:16:19.649Z","trace_propagation_headers":{"sentry-trace":"7329e2132db249a49ce8429fe50bb31f-f4a6414c9529470c","baggage":"sentry-trace_id=7329e2132db249a49ce8429fe50bb31f,sentry-release=Unknown"},"correlation_id":"01M0EX0BRCBJ07HPA8F68V7DAW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-08-20T06:16:19.651Z","job_size_bytes":3,"pid":3466,"sidekiq_tid":"m8rm","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-b65ebb862f102f7af2ee2919: done: 0.026542 sec","job_status":"done","queue_duration_s":0.73087,"scheduling_latency_s":0.730887,"redis_calls":7,"redis_duration_s":0.0015730000000000002,"redis_read_bytes":5,"redis_write_bytes":636,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001126,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":446,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000447,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016846,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.026542,"completed_at":"2026-08-20T06:16:20.408Z","load_balancing_strategy":"primary","db_duration_s":0.005609,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2312gitlab # [ 428.053548] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-20T06:16:20.410Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"9e3e05e8c952673813b3f44a","created_at":"2026-08-20T06:16:19.655Z","trace_propagation_headers":{"sentry-trace":"65cec15b18ec43659ffc9e9d39c1e0a8-4a59b86a23a442ba","baggage":"sentry-trace_id=65cec15b18ec43659ffc9e9d39c1e0a8,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EX0D2QK2JF6BANCJFYF7WA","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-20T06:16:19.658Z","job_size_bytes":3,"pid":3466,"sidekiq_tid":"m8rm","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-9e3e05e8c952673813b3f44a: start","job_status":"start","queue_duration_s":0.752151,"scheduling_latency_s":0.75217}2313gitlab # [ 428.069740] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-20T06:16:20.550Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"9e3e05e8c952673813b3f44a","created_at":"2026-08-20T06:16:19.655Z","trace_propagation_headers":{"sentry-trace":"65cec15b18ec43659ffc9e9d39c1e0a8-4a59b86a23a442ba","baggage":"sentry-trace_id=65cec15b18ec43659ffc9e9d39c1e0a8,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EX0D2QK2JF6BANCJFYF7WA","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-20T06:16:19.658Z","job_size_bytes":3,"pid":3466,"sidekiq_tid":"m8rm","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-9e3e05e8c952673813b3f44a: done: 0.140288 sec","job_status":"done","queue_duration_s":0.752151,"scheduling_latency_s":0.75217,"gitaly_calls":2,"gitaly_duration_s":0.008165,"redis_calls":34,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.007856,"redis_read_bytes":79,"redis_write_bytes":5122,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.001278,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":10,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.001266,"redis_cache_read_bytes":19,"redis_cache_write_bytes":892,"redis_queues_calls":2,"redis_queues_duration_s":0.000343,"redis_queues_read_bytes":2,"redis_queues_write_bytes":1133,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001689,"redis_queues_metadata_read_bytes":7,"redis_queues_metadata_write_bytes":772,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.00034,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":2,"redis_repository_cache_duration_s":0.000632,"redis_repository_cache_read_bytes":39,"redis_repository_cache_write_bytes":83,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00103,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":551,"db_count":27,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":27,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.036,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":13,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.003,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.007,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.02,"db_ci_duration_s":0.016,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.093505,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.10690864,"duration_s":0.140288,"completed_at":"2026-08-20T06:16:20.550Z","load_balancing_strategy":"primary","db_duration_s":0.038804,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2314gitlab # [ 428.122141] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-20T06:16:20.551Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"ec6a948e0e7e44f0c55869e9","created_at":"2026-08-20T06:16:19.704Z","trace_propagation_headers":{"sentry-trace":"7329e2132db249a49ce8429fe50bb31f-f4a6414c9529470c","baggage":"sentry-trace_id=7329e2132db249a49ce8429fe50bb31f,sentry-release=Unknown"},"correlation_id":"01M0EX0BRCBJ07HPA8F68V7DAW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-20T06:16:19.705Z","job_size_bytes":3,"pid":3466,"sidekiq_tid":"m8rm","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-ec6a948e0e7e44f0c55869e9: start","job_status":"start","queue_duration_s":0.846074,"scheduling_latency_s":0.846091}2315gitlab # [ 428.138033] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-20T06:16:20.581Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"ec6a948e0e7e44f0c55869e9","created_at":"2026-08-20T06:16:19.704Z","trace_propagation_headers":{"sentry-trace":"7329e2132db249a49ce8429fe50bb31f-f4a6414c9529470c","baggage":"sentry-trace_id=7329e2132db249a49ce8429fe50bb31f,sentry-release=Unknown"},"correlation_id":"01M0EX0BRCBJ07HPA8F68V7DAW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-20T06:16:19.705Z","job_size_bytes":3,"pid":3466,"sidekiq_tid":"m8rm","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-ec6a948e0e7e44f0c55869e9: done: 0.029404 sec","job_status":"done","queue_duration_s":0.846074,"scheduling_latency_s":0.846091,"redis_calls":8,"redis_duration_s":0.002435,"redis_read_bytes":6,"redis_write_bytes":754,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001961,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":564,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000474,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018316,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.029404,"completed_at":"2026-08-20T06:16:20.581Z","load_balancing_strategy":"primary","db_duration_s":0.006397,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2316gitlab # [ 428.180265] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-20T06:16:20.582Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"abc0cf9417659da86c1bcb93","created_at":"2026-08-20T06:16:20.474Z","trace_propagation_headers":{"sentry-trace":"65cec15b18ec43659ffc9e9d39c1e0a8-e35c1f65fdc44877","baggage":"sentry-trace_id=65cec15b18ec43659ffc9e9d39c1e0a8,sentry-release=Unknown"},"correlation_id":"01M0EX0D2QK2JF6BANCJFYF7WA","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-08-20T06:16:20.476Z","job_size_bytes":3,"pid":3466,"sidekiq_tid":"m8rm","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-abc0cf9417659da86c1bcb93: start","job_status":"start","queue_duration_s":0.106041,"scheduling_latency_s":0.10606}2317gitlab # [ 428.196317] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-20T06:16:20.622Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"abc0cf9417659da86c1bcb93","created_at":"2026-08-20T06:16:20.474Z","trace_propagation_headers":{"sentry-trace":"65cec15b18ec43659ffc9e9d39c1e0a8-e35c1f65fdc44877","baggage":"sentry-trace_id=65cec15b18ec43659ffc9e9d39c1e0a8,sentry-release=Unknown"},"correlation_id":"01M0EX0D2QK2JF6BANCJFYF7WA","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-08-20T06:16:20.476Z","job_size_bytes":3,"pid":3466,"sidekiq_tid":"m8rm","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-abc0cf9417659da86c1bcb93: done: 0.039356 sec","job_status":"done","queue_duration_s":0.106041,"scheduling_latency_s":0.10606,"redis_calls":7,"redis_duration_s":0.002065,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001419,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000646,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025119,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.039356,"completed_at":"2026-08-20T06:16:20.622Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007966,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2318gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/1ec92181522c6d831f5b4109cbf4ce466fbfedce/statuses2319gitlab # [ 428.669230] gitaly[891]: time="2026-08-20T06:16:21.576Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EX0F6P4KX66RW5VWC80HPH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T06:16:51.473" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:16:21.574" grpc.time_ms=1.219 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2320gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/1ec92181522c6d831f5b4109cbf4ce466fbfedce/statuses, in 0.27 seconds)2321gitlab # [ 428.740299] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/20:06:16:21 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/1ec92181522c6d831f5b4109cbf4ce466fbfedce/statuses HTTP/1.1" 200 633 "" "curl/8.21.0" 1842322gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/1ec92181522c6d831f5b4109cbf4ce466fbfedce/statuses2323gitlab # [ 429.930320] gitaly[891]: time="2026-08-20T06:16:22.836Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EX0GDET2NMGBCFBBFJBJ0C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T06:16:52.734" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:16:22.835" grpc.time_ms=1.372 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2324gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/1ec92181522c6d831f5b4109cbf4ce466fbfedce/statuses, in 0.24 seconds)2325gitlab # [ 429.984424] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/20:06:16:22 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/1ec92181522c6d831f5b4109cbf4ce466fbfedce/statuses HTTP/1.1" 200 633 "" "curl/8.21.0" 1882326gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/1ec92181522c6d831f5b4109cbf4ce466fbfedce/statuses2327gitlab # [ 431.131995] gitaly[891]: time="2026-08-20T06:16:24.038Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EX0HMAEAWW6SXS67VPW31W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T06:16:54.036" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:16:24.037" grpc.time_ms=1.23 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2328gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/1ec92181522c6d831f5b4109cbf4ce466fbfedce/statuses, in 0.20 seconds)2329gitlab # [ 431.185725] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/20:06:16:24 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/1ec92181522c6d831f5b4109cbf4ce466fbfedce/statuses HTTP/1.1" 200 633 "" "curl/8.21.0" 1442330gitlab # [ 431.415497] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-20T06:16:24.321Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"30d45baaff5f4fc0a6bc8410","created_at":"2026-08-20T06:16:24.292Z","trace_propagation_headers":{"sentry-trace":"d5261b01a8af47e39d76ea3dc3e08ef9-444f99cda55f476b","baggage":"sentry-trace_id=d5261b01a8af47e39d76ea3dc3e08ef9,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d47dda4328403513c888431d37393fed","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-20T06:16:24.318Z","job_size_bytes":2,"pid":3466,"sidekiq_tid":"m8rm","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-30d45baaff5f4fc0a6bc8410: start","job_status":"start","queue_duration_s":0.00331,"scheduling_latency_s":0.003372}2331gitlab # [ 431.557737] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-20T06:16:24.464Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"30d45baaff5f4fc0a6bc8410","created_at":"2026-08-20T06:16:24.292Z","trace_propagation_headers":{"sentry-trace":"d5261b01a8af47e39d76ea3dc3e08ef9-444f99cda55f476b","baggage":"sentry-trace_id=d5261b01a8af47e39d76ea3dc3e08ef9,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d47dda4328403513c888431d37393fed","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-20T06:16:24.318Z","job_size_bytes":2,"pid":3466,"sidekiq_tid":"m8rm","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-30d45baaff5f4fc0a6bc8410: done: 0.143162 sec","job_status":"done","queue_duration_s":0.00331,"scheduling_latency_s":0.003372,"redis_calls":9,"redis_duration_s":0.018739,"redis_read_bytes":7,"redis_write_bytes":1026,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.002439,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":315,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.013056,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":491,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.003244,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":220,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.032,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.032,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.043052,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.143162,"completed_at":"2026-08-20T06:16:24.464Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.033784,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2332gitlab # [ 431.660375] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-20T06:16:24.470Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"fc9542af90e69a5c69e913ac","created_at":"2026-08-20T06:16:24.333Z","trace_propagation_headers":{"sentry-trace":"d5261b01a8af47e39d76ea3dc3e08ef9-444f99cda55f476b","baggage":"sentry-trace_id=d5261b01a8af47e39d76ea3dc3e08ef9,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"cdd4ce20fa845753ff8acb4c049b0d69","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-20T06:16:24.346Z","job_size_bytes":2,"pid":3466,"sidekiq_tid":"m8rm","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-fc9542af90e69a5c69e913ac: start","job_status":"start","queue_duration_s":0.123659,"scheduling_latency_s":0.123712}2333gitlab # [ 431.716687] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-20T06:16:24.623Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"fc9542af90e69a5c69e913ac","created_at":"2026-08-20T06:16:24.333Z","trace_propagation_headers":{"sentry-trace":"d5261b01a8af47e39d76ea3dc3e08ef9-444f99cda55f476b","baggage":"sentry-trace_id=d5261b01a8af47e39d76ea3dc3e08ef9,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"cdd4ce20fa845753ff8acb4c049b0d69","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-20T06:16:24.346Z","job_size_bytes":2,"pid":3466,"sidekiq_tid":"m8rm","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-fc9542af90e69a5c69e913ac: done: 0.153464 sec","job_status":"done","queue_duration_s":0.123659,"scheduling_latency_s":0.123712,"redis_calls":9,"redis_duration_s":0.01824,"redis_read_bytes":7,"redis_write_bytes":1068,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.004767,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00972,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.003753,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.055829,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.153464,"completed_at":"2026-08-20T06:16:24.623Z","load_balancing_strategy":"primary","db_duration_s":0.022779,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2334gitlab # [ 431.808052] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-20T06:16:24.634Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":["1"],"class":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker","jid":"ddfe885074156f7f3a827dac","created_at":"2026-08-20T06:16:24.352Z","trace_propagation_headers":{"sentry-trace":"d5261b01a8af47e39d76ea3dc3e08ef9-444f99cda55f476b","baggage":"sentry-trace_id=d5261b01a8af47e39d76ea3dc3e08ef9,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"fleet_visibility","correlation_id":"7f4a50822a49063d16c2371710c2bdeb","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f3066c5baf1b66987ee2154bc897f8592e7a97485c950408f900b17a65777f1b","size_limiter":"validated","enqueued_at":"2026-08-20T06:16:24.379Z","job_size_bytes":3,"pid":3466,"sidekiq_tid":"m8rm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker JID-ddfe885074156f7f3a827dac: start","job_status":"start","queue_duration_s":0.254625,"scheduling_latency_s":0.254667}2335gitlab # [ 431.832567] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-20T06:16:24.739Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":["1"],"class":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker","jid":"ddfe885074156f7f3a827dac","created_at":"2026-08-20T06:16:24.352Z","trace_propagation_headers":{"sentry-trace":"d5261b01a8af47e39d76ea3dc3e08ef9-444f99cda55f476b","baggage":"sentry-trace_id=d5261b01a8af47e39d76ea3dc3e08ef9,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"fleet_visibility","correlation_id":"7f4a50822a49063d16c2371710c2bdeb","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f3066c5baf1b66987ee2154bc897f8592e7a97485c950408f900b17a65777f1b","size_limiter":"validated","enqueued_at":"2026-08-20T06:16:24.379Z","job_size_bytes":3,"pid":3466,"sidekiq_tid":"m8rm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker JID-ddfe885074156f7f3a827dac: done: 0.105 sec","job_status":"done","queue_duration_s":0.254625,"scheduling_latency_s":0.254667,"redis_calls":10,"redis_duration_s":0.020933,"redis_read_bytes":9,"redis_write_bytes":1203,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.002819,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.012059,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.006055,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.016,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.016,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.03119,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00342294,"duration_s":0.105,"completed_at":"2026-08-20T06:16:24.739Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.016044,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2336gitlab # [ 431.899469] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-20T06:16:24.772Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"56b8d36666fda8025d971cdb","created_at":"2026-08-20T06:16:24.428Z","trace_propagation_headers":{"sentry-trace":"d5261b01a8af47e39d76ea3dc3e08ef9-444f99cda55f476b","baggage":"sentry-trace_id=d5261b01a8af47e39d76ea3dc3e08ef9,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"acd75f04d213bb3de498c3b10a798f71","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-20T06:16:24.492Z","job_size_bytes":2,"pid":3466,"sidekiq_tid":"m8rm","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-56b8d36666fda8025d971cdb: start","job_status":"start","queue_duration_s":0.280027,"scheduling_latency_s":0.280077}2337gitlab # [ 431.930893] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-20T06:16:24.838Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0}2338gitlab # [ 431.974927] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-20T06:16:24.881Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"56b8d36666fda8025d971cdb","created_at":"2026-08-20T06:16:24.428Z","trace_propagation_headers":{"sentry-trace":"d5261b01a8af47e39d76ea3dc3e08ef9-444f99cda55f476b","baggage":"sentry-trace_id=d5261b01a8af47e39d76ea3dc3e08ef9,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"acd75f04d213bb3de498c3b10a798f71","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-20T06:16:24.492Z","job_size_bytes":2,"pid":3466,"sidekiq_tid":"m8rm","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-56b8d36666fda8025d971cdb: done: 0.108835 sec","job_status":"done","queue_duration_s":0.280027,"scheduling_latency_s":0.280077,"redis_calls":9,"redis_duration_s":0.014466,"redis_read_bytes":7,"redis_write_bytes":1178,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.004461,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.008377,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":557,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001628,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":264,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.014,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.014,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.031292,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.108835,"completed_at":"2026-08-20T06:16:24.881Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.014395,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2339gitlab # [ 432.081511] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-20T06:16:24.890Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"9340b5ebb04b08536fe779c9","created_at":"2026-08-20T06:16:24.529Z","trace_propagation_headers":{"sentry-trace":"d5261b01a8af47e39d76ea3dc3e08ef9-444f99cda55f476b","baggage":"sentry-trace_id=d5261b01a8af47e39d76ea3dc3e08ef9,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b7009660c25b655a74e18c1278578b28","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-20T06:16:24.556Z","job_size_bytes":2,"pid":3466,"sidekiq_tid":"m8rm","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-9340b5ebb04b08536fe779c9: start","job_status":"start","queue_duration_s":0.333471,"scheduling_latency_s":0.333519}2340gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/1ec92181522c6d831f5b4109cbf4ce466fbfedce/statuses2341gitlab # [ 432.177816] gitaly[891]: time="2026-08-20T06:16:25.084Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EX0JMB9N1E6VQBNM8NE8DK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T06:16:55.082" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:16:25.083" grpc.time_ms=1.302 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2342gitlab # [ 432.242884] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-20T06:16:25.150Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0}2343gitlab # [ 432.269671] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-20T06:16:25.176Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"9340b5ebb04b08536fe779c9","created_at":"2026-08-20T06:16:24.529Z","trace_propagation_headers":{"sentry-trace":"d5261b01a8af47e39d76ea3dc3e08ef9-444f99cda55f476b","baggage":"sentry-trace_id=d5261b01a8af47e39d76ea3dc3e08ef9,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b7009660c25b655a74e18c1278578b28","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-20T06:16:24.556Z","job_size_bytes":2,"pid":3466,"sidekiq_tid":"m8rm","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-9340b5ebb04b08536fe779c9: done: 0.286678 sec","job_status":"done","queue_duration_s":0.333471,"scheduling_latency_s":0.333519,"redis_calls":9,"redis_duration_s":0.008412,"redis_read_bytes":7,"redis_write_bytes":1105,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.002263,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.003036,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":524,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.003113,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":242,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.016,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.016,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021086,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.286678,"completed_at":"2026-08-20T06:16:25.176Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.015834,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2344gitlab # [ 432.327227] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-20T06:16:25.192Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"1a67c932d0774474b6a89deb","created_at":"2026-08-20T06:16:24.606Z","trace_propagation_headers":{"sentry-trace":"d5261b01a8af47e39d76ea3dc3e08ef9-444f99cda55f476b","baggage":"sentry-trace_id=d5261b01a8af47e39d76ea3dc3e08ef9,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"116f762285db1770db72b9c57e131f79","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-20T06:16:24.631Z","job_size_bytes":2,"pid":3466,"sidekiq_tid":"m8rm","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-1a67c932d0774474b6a89deb: start","job_status":"start","queue_duration_s":0.560561,"scheduling_latency_s":0.560595}2345gitlab # [ 432.344320] gitaly[891]: time="2026-08-20T06:16:25.252Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EX0JSWRT7HFPB3PS9MQ5HN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T06:16:55.239" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:16:25.240" grpc.time_ms=0.848 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2346gitlab # [ 432.362562] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/20:06:16:25 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/1ec92181522c6d831f5b4109cbf4ce466fbfedce/statuses HTTP/1.1" 200 633 "" "curl/8.21.0" 1192347gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/1ec92181522c6d831f5b4109cbf4ce466fbfedce/statuses, in 0.18 seconds)2348gitlab # [ 432.431824] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-20T06:16:25.338Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"1a67c932d0774474b6a89deb","created_at":"2026-08-20T06:16:24.606Z","trace_propagation_headers":{"sentry-trace":"d5261b01a8af47e39d76ea3dc3e08ef9-444f99cda55f476b","baggage":"sentry-trace_id=d5261b01a8af47e39d76ea3dc3e08ef9,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"116f762285db1770db72b9c57e131f79","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-20T06:16:24.631Z","job_size_bytes":2,"pid":3466,"sidekiq_tid":"m8rm","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-1a67c932d0774474b6a89deb: done: 0.146692 sec","job_status":"done","queue_duration_s":0.560561,"scheduling_latency_s":0.560595,"redis_calls":9,"redis_duration_s":0.038882,"redis_read_bytes":7,"redis_write_bytes":1183,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000605,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.007026,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.031251,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.028,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.028,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.027061,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.146692,"completed_at":"2026-08-20T06:16:25.338Z","load_balancing_strategy":"primary","db_duration_s":0.064218,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2349gitlab # [ 432.488387] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-20T06:16:25.340Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"6f2e912c75b5d3a09305787a","created_at":"2026-08-20T06:16:24.647Z","trace_propagation_headers":{"sentry-trace":"d5261b01a8af47e39d76ea3dc3e08ef9-444f99cda55f476b","baggage":"sentry-trace_id=d5261b01a8af47e39d76ea3dc3e08ef9,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e6cd2a45d6b996defe9b9acd3515f32e","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-08-20T06:16:24.667Z","job_size_bytes":2,"pid":3466,"sidekiq_tid":"m8rm","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-6f2e912c75b5d3a09305787a: start","job_status":"start","queue_duration_s":0.6731,"scheduling_latency_s":0.673127}2350gitlab # [ 432.529938] gitaly[891]: time="2026-08-20T06:16:25.437Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EX0JMB9N1E6VQBNM8NE8DK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T06:16:35.006" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T06:16:25.427" grpc.time_ms=10.274 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2351gitlab # [ 432.548384] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-20T06:16:25.440Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"6f2e912c75b5d3a09305787a","created_at":"2026-08-20T06:16:24.647Z","trace_propagation_headers":{"sentry-trace":"d5261b01a8af47e39d76ea3dc3e08ef9-444f99cda55f476b","baggage":"sentry-trace_id=d5261b01a8af47e39d76ea3dc3e08ef9,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e6cd2a45d6b996defe9b9acd3515f32e","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-08-20T06:16:24.667Z","job_size_bytes":2,"pid":3466,"sidekiq_tid":"m8rm","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-6f2e912c75b5d3a09305787a: done: 0.099177 sec","job_status":"done","queue_duration_s":0.6731,"scheduling_latency_s":0.673127,"redis_calls":11,"redis_duration_s":0.027552,"redis_read_bytes":9,"redis_write_bytes":1464,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001379,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.005768,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":536,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.020405,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":591,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.02,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.02,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026477,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00201836,"exclusive_lock_hold_duration_s":0.02696836,"duration_s":0.099177,"completed_at":"2026-08-20T06:16:25.439Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.025436,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2352gitlab # [ 432.595538] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-20T06:16:25.453Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"8f7ec57fe1aa117becd673a9","created_at":"2026-08-20T06:16:24.702Z","trace_propagation_headers":{"sentry-trace":"d5261b01a8af47e39d76ea3dc3e08ef9-444f99cda55f476b","baggage":"sentry-trace_id=d5261b01a8af47e39d76ea3dc3e08ef9,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0ef3b2b6d100d203daa2895046eaf061","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-20T06:16:24.732Z","job_size_bytes":2,"pid":3466,"sidekiq_tid":"m8rm","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-8f7ec57fe1aa117becd673a9: start","job_status":"start","queue_duration_s":0.720835,"scheduling_latency_s":0.720883}2353gitlab # [ 432.646297] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-20T06:16:25.553Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"8f7ec57fe1aa117becd673a9","created_at":"2026-08-20T06:16:24.702Z","trace_propagation_headers":{"sentry-trace":"d5261b01a8af47e39d76ea3dc3e08ef9-444f99cda55f476b","baggage":"sentry-trace_id=d5261b01a8af47e39d76ea3dc3e08ef9,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0ef3b2b6d100d203daa2895046eaf061","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-20T06:16:24.732Z","job_size_bytes":2,"pid":3466,"sidekiq_tid":"m8rm","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-8f7ec57fe1aa117becd673a9: done: 0.09994 sec","job_status":"done","queue_duration_s":0.720835,"scheduling_latency_s":0.720883,"redis_calls":11,"redis_duration_s":0.012483000000000001,"redis_read_bytes":9,"redis_write_bytes":1399,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.002255,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.006348,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00388,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":560,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.039032,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.0009855,"exclusive_lock_hold_duration_s":0.03010318,"duration_s":0.09994,"completed_at":"2026-08-20T06:16:25.553Z","load_balancing_strategy":"primary","db_duration_s":0.028644,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2354gitlab # [ 432.706097] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-20T06:16:25.555Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"1101f00dbad74c1ea349e81f","created_at":"2026-08-20T06:16:24.763Z","trace_propagation_headers":{"sentry-trace":"d5261b01a8af47e39d76ea3dc3e08ef9-444f99cda55f476b","baggage":"sentry-trace_id=d5261b01a8af47e39d76ea3dc3e08ef9,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6ffa7a8edbfc16585d3ec7c725af2a64","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-08-20T06:16:24.779Z","job_size_bytes":2,"pid":3466,"sidekiq_tid":"m8rm","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-1101f00dbad74c1ea349e81f: start","job_status":"start","queue_duration_s":0.77585,"scheduling_latency_s":0.775882}2355gitlab # [ 432.719705] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-20T06:16:25.592Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"1101f00dbad74c1ea349e81f","created_at":"2026-08-20T06:16:24.763Z","trace_propagation_headers":{"sentry-trace":"d5261b01a8af47e39d76ea3dc3e08ef9-444f99cda55f476b","baggage":"sentry-trace_id=d5261b01a8af47e39d76ea3dc3e08ef9,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6ffa7a8edbfc16585d3ec7c725af2a64","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-08-20T06:16:24.779Z","job_size_bytes":2,"pid":3466,"sidekiq_tid":"m8rm","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-1101f00dbad74c1ea349e81f: done: 0.037128 sec","job_status":"done","queue_duration_s":0.77585,"scheduling_latency_s":0.775882,"redis_calls":11,"redis_duration_s":0.002971,"redis_read_bytes":8,"redis_write_bytes":1094,"redis_cache_calls":2,"redis_cache_duration_s":0.000456,"redis_cache_read_bytes":1,"redis_cache_write_bytes":93,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000548,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001479,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":482,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000488,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":214,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022559,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.037128,"completed_at":"2026-08-20T06:16:25.592Z","load_balancing_strategy":"primary","db_duration_s":0.001609,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2356gitlab # [ 432.762718] nixbot[3496]: {"ts": "2026-08-20T06:16:25.568Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/1ec92181522c6d831f5b4109cbf4ce466fbfedce \"HTTP/1.1 201 Created\""}2357gitlab # [ 432.766118] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/20:06:16:25 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/1ec92181522c6d831f5b4109cbf4ce466fbfedce HTTP/1.1" 201 669 "" "python-httpx/0.28.1" 5952358gitlab # [ 432.768688] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-20T06:16:25.594Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"fda82f24f226ce25257b1556","created_at":"2026-08-20T06:16:24.808Z","trace_propagation_headers":{"sentry-trace":"d5261b01a8af47e39d76ea3dc3e08ef9-444f99cda55f476b","baggage":"sentry-trace_id=d5261b01a8af47e39d76ea3dc3e08ef9,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a00cd95382e613af63f583182d6fd482","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-20T06:16:24.845Z","job_size_bytes":2,"pid":3466,"sidekiq_tid":"m8rm","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-fda82f24f226ce25257b1556: start","job_status":"start","queue_duration_s":0.749419,"scheduling_latency_s":0.749447}2359gitlab # [ 432.783379] gitaly[891]: time="2026-08-20T06:16:25.661Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EX0K75QEZPJYR4MXNFQCVS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T06:16:55.354" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:16:25.660" grpc.time_ms=1.033 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2360gitlab # [ 432.796965] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-20T06:16:25.687Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"fda82f24f226ce25257b1556","created_at":"2026-08-20T06:16:24.808Z","trace_propagation_headers":{"sentry-trace":"d5261b01a8af47e39d76ea3dc3e08ef9-444f99cda55f476b","baggage":"sentry-trace_id=d5261b01a8af47e39d76ea3dc3e08ef9,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a00cd95382e613af63f583182d6fd482","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-20T06:16:24.845Z","job_size_bytes":2,"pid":3466,"sidekiq_tid":"m8rm","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-fda82f24f226ce25257b1556: done: 0.09258 sec","job_status":"done","queue_duration_s":0.749419,"scheduling_latency_s":0.749447,"redis_calls":11,"redis_duration_s":0.0025700000000000002,"redis_read_bytes":9,"redis_write_bytes":1518,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000418,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":349,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001132,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00102,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":615,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.026,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.026,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.054135,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00090778,"exclusive_lock_hold_duration_s":0.04888424,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.09258,"completed_at":"2026-08-20T06:16:25.687Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.027402,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2361gitlab # [ 432.843384] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-20T06:16:25.689Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"859615437a8fdd08ae2b3096","created_at":"2026-08-20T06:16:24.872Z","trace_propagation_headers":{"sentry-trace":"d5261b01a8af47e39d76ea3dc3e08ef9-444f99cda55f476b","baggage":"sentry-trace_id=d5261b01a8af47e39d76ea3dc3e08ef9,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"839307179b76ee5ab6909c448ae7d3c1","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-20T06:16:24.888Z","job_size_bytes":2,"pid":3466,"sidekiq_tid":"m8rm","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-859615437a8fdd08ae2b3096: start","job_status":"start","queue_duration_s":0.801317,"scheduling_latency_s":0.801342}2362gitlab # [ 432.857722] gitaly[891]: time="2026-08-20T06:16:25.722Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=19 command.spawn_token_fork_ms=1 command.system_time_ms=9 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M0EX0K75QEZPJYR4MXNFQCVS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T06:16:35.281" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T06:16:25.701" grpc.time_ms=20.591 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2363gitlab # [ 432.916128] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/20:06:16:25 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/1ec92181522c6d831f5b4109cbf4ce466fbfedce HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 2482364gitlab # [ 432.919210] nixbot[3496]: {"ts": "2026-08-20T06:16:25.823Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/1ec92181522c6d831f5b4109cbf4ce466fbfedce \"HTTP/1.1 201 Created\""}2365gitlab # [ 433.025827] gitaly[891]: time="2026-08-20T06:16:25.933Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EX0KFHQETB0F02E7QQ93B4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T06:16:55.031" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:16:25.932" grpc.time_ms=1.069 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2366gitlab # [ 433.081665] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-20T06:16:25.988Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"859615437a8fdd08ae2b3096","created_at":"2026-08-20T06:16:24.872Z","trace_propagation_headers":{"sentry-trace":"d5261b01a8af47e39d76ea3dc3e08ef9-444f99cda55f476b","baggage":"sentry-trace_id=d5261b01a8af47e39d76ea3dc3e08ef9,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"839307179b76ee5ab6909c448ae7d3c1","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-20T06:16:24.888Z","job_size_bytes":2,"pid":3466,"sidekiq_tid":"m8rm","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-859615437a8fdd08ae2b3096: done: 0.29959 sec","job_status":"done","queue_duration_s":0.801317,"scheduling_latency_s":0.801342,"redis_calls":13,"redis_duration_s":0.003242,"redis_read_bytes":11,"redis_write_bytes":1567,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.00076,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":580,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001282,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":476,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.0012,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":511,"db_count":131,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":131,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.05,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":131,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":84,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.05,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.223129,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00077458,"exclusive_lock_hold_duration_s":0.2679815,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"main","turbo_mode":false},"duration_s":0.29959,"completed_at":"2026-08-20T06:16:25.988Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.08115,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2367gitlab # [ 433.180205] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-20T06:16:25.990Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"4b0cf2ecd8d2e4fe7c82b5fd","created_at":"2026-08-20T06:16:24.906Z","trace_propagation_headers":{"sentry-trace":"d5261b01a8af47e39d76ea3dc3e08ef9-444f99cda55f476b","baggage":"sentry-trace_id=d5261b01a8af47e39d76ea3dc3e08ef9,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"982445dc2b2d88a1ed94689abc5dd63f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-20T06:16:24.915Z","job_size_bytes":2,"pid":3466,"sidekiq_tid":"m8rm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-4b0cf2ecd8d2e4fe7c82b5fd: start","job_status":"start","queue_duration_s":1.074982,"scheduling_latency_s":1.075001}2368gitlab # [ 433.203453] nixbot[3496]: {"ts": "2026-08-20T06:16:26.070Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/1ec92181522c6d831f5b4109cbf4ce466fbfedce \"HTTP/1.1 201 Created\""}2369gitlab # [ 433.208063] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/20:06:16:26 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/1ec92181522c6d831f5b4109cbf4ce466fbfedce HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 2262370gitlab # [ 433.212240] gitaly[891]: time="2026-08-20T06:16:26.005Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=5 command.system_time_ms=5 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M0EX0KFHQETB0F02E7QQ93B4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T06:16:35.010" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T06:16:25.991" grpc.time_ms=13.634 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2371gitlab # [ 433.230055] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-20T06:16:26.120Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"4b0cf2ecd8d2e4fe7c82b5fd","created_at":"2026-08-20T06:16:24.906Z","trace_propagation_headers":{"sentry-trace":"d5261b01a8af47e39d76ea3dc3e08ef9-444f99cda55f476b","baggage":"sentry-trace_id=d5261b01a8af47e39d76ea3dc3e08ef9,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"982445dc2b2d88a1ed94689abc5dd63f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-20T06:16:24.915Z","job_size_bytes":2,"pid":3466,"sidekiq_tid":"m8rm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-4b0cf2ecd8d2e4fe7c82b5fd: done: 0.130393 sec","job_status":"done","queue_duration_s":1.074982,"scheduling_latency_s":1.075001,"redis_calls":70,"redis_duration_s":0.022241999999999998,"redis_read_bytes":118,"redis_write_bytes":42580,"redis_feature_flag_calls":10,"redis_feature_flag_duration_s":0.001651,"redis_feature_flag_read_bytes":10,"redis_feature_flag_write_bytes":1471,"redis_queues_calls":2,"redis_queues_duration_s":0.001169,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37485,"redis_queues_metadata_calls":55,"redis_queues_metadata_duration_s":0.018889,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3324,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000533,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":300,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.105779,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.130393,"completed_at":"2026-08-20T06:16:26.120Z","load_balancing_strategy":"primary","db_duration_s":0.003955,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2372gitlab # [ 433.277018] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-20T06:16:26.122Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"1c7f89ed22a2c12139024a03","created_at":"2026-08-20T06:16:25.103Z","trace_propagation_headers":{"sentry-trace":"d5261b01a8af47e39d76ea3dc3e08ef9-444f99cda55f476b","baggage":"sentry-trace_id=d5261b01a8af47e39d76ea3dc3e08ef9,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f96196e9b66fb987dc608c23bac176d5","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-20T06:16:25.119Z","job_size_bytes":2,"pid":3466,"sidekiq_tid":"m8rm","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-1c7f89ed22a2c12139024a03: start","job_status":"start","queue_duration_s":1.002773,"scheduling_latency_s":1.002793}2373gitlab # [ 433.291764] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-20T06:16:26.133Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0}2374gitlab # [ 433.295228] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-20T06:16:26.140Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"1c7f89ed22a2c12139024a03","created_at":"2026-08-20T06:16:25.103Z","trace_propagation_headers":{"sentry-trace":"d5261b01a8af47e39d76ea3dc3e08ef9-444f99cda55f476b","baggage":"sentry-trace_id=d5261b01a8af47e39d76ea3dc3e08ef9,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f96196e9b66fb987dc608c23bac176d5","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-20T06:16:25.119Z","job_size_bytes":2,"pid":3466,"sidekiq_tid":"m8rm","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-1c7f89ed22a2c12139024a03: done: 0.01845 sec","job_status":"done","queue_duration_s":1.002773,"scheduling_latency_s":1.002793,"redis_calls":9,"redis_duration_s":0.001644,"redis_read_bytes":7,"redis_write_bytes":1112,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000363,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000919,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000362,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010978,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01845,"completed_at":"2026-08-20T06:16:26.140Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000667,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2375gitlab # [ 433.337943] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-20T06:16:26.142Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"506a507fa53150f9d285a23f","created_at":"2026-08-20T06:16:25.136Z","trace_propagation_headers":{"sentry-trace":"d5261b01a8af47e39d76ea3dc3e08ef9-444f99cda55f476b","baggage":"sentry-trace_id=d5261b01a8af47e39d76ea3dc3e08ef9,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f573a8d8a4d7e11529fadabb4b170cf6","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-20T06:16:25.174Z","job_size_bytes":2,"pid":3466,"sidekiq_tid":"m8rm","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-506a507fa53150f9d285a23f: start","job_status":"start","queue_duration_s":0.967972,"scheduling_latency_s":0.967993}2376gitlab # [ 433.353018] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-20T06:16:26.156Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0}2377gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/1ec92181522c6d831f5b4109cbf4ce466fbfedce/statuses2378gitlab # [ 433.356445] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-20T06:16:26.165Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"506a507fa53150f9d285a23f","created_at":"2026-08-20T06:16:25.136Z","trace_propagation_headers":{"sentry-trace":"d5261b01a8af47e39d76ea3dc3e08ef9-444f99cda55f476b","baggage":"sentry-trace_id=d5261b01a8af47e39d76ea3dc3e08ef9,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f573a8d8a4d7e11529fadabb4b170cf6","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-20T06:16:25.174Z","job_size_bytes":2,"pid":3466,"sidekiq_tid":"m8rm","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-506a507fa53150f9d285a23f: done: 0.023199 sec","job_status":"done","queue_duration_s":0.967972,"scheduling_latency_s":0.967993,"redis_calls":9,"redis_duration_s":0.0029259999999999998,"redis_read_bytes":7,"redis_write_bytes":1185,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001022,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":359,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001372,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000532,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013266,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.023199,"completed_at":"2026-08-20T06:16:26.165Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000538,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2379gitlab # [ 433.400873] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-20T06:16:26.167Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"011f5965501d1180ec475dbd","created_at":"2026-08-20T06:16:25.191Z","trace_propagation_headers":{"sentry-trace":"d5261b01a8af47e39d76ea3dc3e08ef9-444f99cda55f476b","baggage":"sentry-trace_id=d5261b01a8af47e39d76ea3dc3e08ef9,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"67886066a0a7defc656c199b2285d374","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-20T06:16:25.208Z","job_size_bytes":2,"pid":3466,"sidekiq_tid":"m8rm","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-011f5965501d1180ec475dbd: start","job_status":"start","queue_duration_s":0.958749,"scheduling_latency_s":0.958768}2380gitlab # [ 433.415830] nix-daemon[3712]: accepted connection from pid 4447, user nixbot2381gitlab # [ 433.417110] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-20T06:16:26.191Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"011f5965501d1180ec475dbd","created_at":"2026-08-20T06:16:25.191Z","trace_propagation_headers":{"sentry-trace":"d5261b01a8af47e39d76ea3dc3e08ef9-444f99cda55f476b","baggage":"sentry-trace_id=d5261b01a8af47e39d76ea3dc3e08ef9,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"67886066a0a7defc656c199b2285d374","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-20T06:16:25.208Z","job_size_bytes":2,"pid":3466,"sidekiq_tid":"m8rm","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-011f5965501d1180ec475dbd: done: 0.024731 sec","job_status":"done","queue_duration_s":0.958749,"scheduling_latency_s":0.958768,"redis_calls":9,"redis_duration_s":0.002238,"redis_read_bytes":7,"redis_write_bytes":984,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000517,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001196,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":473,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000525,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":208,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014419,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.024731,"completed_at":"2026-08-20T06:16:26.191Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002756,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2382gitlab # [ 433.469296] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-20T06:16:26.193Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleDeleteObjectsCronWorker","jid":"e93138da1c6a03c38ae696c7","created_at":"2026-08-20T06:16:25.239Z","trace_propagation_headers":{"sentry-trace":"d5261b01a8af47e39d76ea3dc3e08ef9-444f99cda55f476b","baggage":"sentry-trace_id=d5261b01a8af47e39d76ea3dc3e08ef9,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"bbfae5eea0cbbe4a55aeda458da7f7e3","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8251d4193fad694e50c4958d17fdca56b6fb205fa6961a4b1ccb7cd497bc09c1","size_limiter":"validated","enqueued_at":"2026-08-20T06:16:25.246Z","job_size_bytes":2,"pid":3466,"sidekiq_tid":"m8rm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleDeleteObjectsCronWorker JID-e93138da1c6a03c38ae696c7: start","job_status":"start","queue_duration_s":0.946592,"scheduling_latency_s":0.946612}2383gitlab # [ 433.485103] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-20T06:16:26.333Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleDeleteObjectsCronWorker","jid":"e93138da1c6a03c38ae696c7","created_at":"2026-08-20T06:16:25.239Z","trace_propagation_headers":{"sentry-trace":"d5261b01a8af47e39d76ea3dc3e08ef9-444f99cda55f476b","baggage":"sentry-trace_id=d5261b01a8af47e39d76ea3dc3e08ef9,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"bbfae5eea0cbbe4a55aeda458da7f7e3","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8251d4193fad694e50c4958d17fdca56b6fb205fa6961a4b1ccb7cd497bc09c1","size_limiter":"validated","enqueued_at":"2026-08-20T06:16:25.246Z","job_size_bytes":2,"pid":3466,"sidekiq_tid":"m8rm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleDeleteObjectsCronWorker JID-e93138da1c6a03c38ae696c7: done: 0.14011 sec","job_status":"done","queue_duration_s":0.946592,"scheduling_latency_s":0.946612,"redis_calls":65,"redis_duration_s":0.023049,"redis_read_bytes":115,"redis_write_bytes":41332,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000944,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":656,"redis_queues_calls":2,"redis_queues_duration_s":0.00337,"redis_queues_read_bytes":4,"redis_queues_write_bytes":37035,"redis_queues_metadata_calls":56,"redis_queues_metadata_duration_s":0.017765,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3374,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.00097,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":267,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.109238,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00080642,"duration_s":0.14011,"completed_at":"2026-08-20T06:16:26.333Z","load_balancing_strategy":"primary","db_duration_s":0.000906,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2384gitlab # [ 433.529842] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-20T06:16:26.335Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"eb46183451ea49a2050f5a2a","created_at":"2026-08-20T06:16:25.252Z","trace_propagation_headers":{"sentry-trace":"d5261b01a8af47e39d76ea3dc3e08ef9-444f99cda55f476b","baggage":"sentry-trace_id=d5261b01a8af47e39d76ea3dc3e08ef9,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3087c8b4e4c52bac62b10f5b13fe41a8","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-20T06:16:25.265Z","job_size_bytes":2,"pid":3466,"sidekiq_tid":"m8rm","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-eb46183451ea49a2050f5a2a: start","job_status":"start","queue_duration_s":1.07012,"scheduling_latency_s":1.070157}2385gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/1ec92181522c6d831f5b4109cbf4ce466fbfedce/statuses, in 0.18 seconds)2386gitlab # [ 433.543547] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-20T06:16:26.356Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0}2387(finished: subtest: eval and build post commit statuses, in 6.42 seconds)2388(finished: run the VM test script, in 502.67 seconds)2389gitlab # [ 433.547239] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/20:06:16:26 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 1012390gitlab # [ 433.549391] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/20:06:16:26 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/1ec92181522c6d831f5b4109cbf4ce466fbfedce/statuses HTTP/1.1" 200 1328 "" "curl/8.21.0" 1072391gitlab # [ 433.552032] gitaly[891]: time="2026-08-20T06:16:26.379Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=579 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=3 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EX0KXJJTHQY7TTN17FYVP3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=194 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T06:16:26.368" grpc.time_ms=10.645 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc2392test script finished in 502.73s2393cleanup2394kill QemuMachine (pid 46)2395gitlab # [ 433.567160] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-20T06:16:26.367Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"eb46183451ea49a2050f5a2a","created_at":"2026-08-20T06:16:25.252Z","trace_propagation_headers":{"sentry-trace":"d5261b01a8af47e39d76ea3dc3e08ef9-444f99cda55f476b","baggage":"sentry-trace_id=d5261b01a8af47e39d76ea3dc3e08ef9,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3087c8b4e4c52bac62b10f5b13fe41a8","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-20T06:16:25.265Z","job_size_bytes":2,"pid":3466,"sidekiq_tid":"m8rm","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-eb46183451ea49a2050f5a2a: done: 0.031797 sec","job_status":"done","queue_duration_s":1.07012,"scheduling_latency_s":1.070157,"redis_calls":9,"redis_duration_s":0.002169,"redis_read_bytes":7,"redis_write_bytes":1159,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00043,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":353,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001291,"rqemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/41m77i1296n33p6liin8ynr6wh3h6b7m-python3-3.14.6/bin/python3.14)2396gitlab # e2397(finished: cleanup, in 1.38 seconds)2398additionally exposed symbols:2399 gitlab,2400 vlan1,2401 start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh2402[]2403[{'id': 1, 'url': 'http://buildbot:8010/webhooks/gitlab', 'name': None, 'description': None, 'created_at': '2026-08-20T06:14:45.555Z', 'push_events': True, 'tag_push_events': False, 'merge_requests_events': True, 'repository_update_events': False, 'enable_ssl_verification': True, 'alert_status': 'executable', 'disabled_until': None, 'push_events_branch_filter': None, 'branch_filter_strategy': 'wildcard', 'custom_webhook_template': None, 'token_present': True, 'signing_token_present': False, 'project_id': 1, 'issues_events': False, 'confidential_issues_events': False, 'note_events': False, 'confidential_note_events': None, 'pipeline_events': False, 'wiki_page_events': False, 'deployment_events': False, 'feature_flag_events': False, 'job_events': False, 'releases_events': False, 'milestone_events': False, 'emoji_events': False, 'resource_access_token_events': False, 'resource_deploy_token_events': False, 'vulnerability_events': False}]2404[]2405[]2406[]2407[]2408[]2409[]2410[]2411[]2412[]2413[]2414[]2415[]2416[]2417[]2418[]2419[]2420[]2421[]2422[]2423[]2424[]2425[]2426[]2427[]2428[]2429[]2430[]2431[]2432[]2433[]2434[]2435[]2436[]2437[]2438[]2439[]2440[]2441[]2442[]2443[]2444[]2445[]2446[]2447[]2448[]2449[]2450[]2451[]2452[]2453[]2454[]2455[]2456[]2457[]2458[]2459[]2460[]2461[]2462[]2463[]2464[]2465[]2466[]2467[]2468[]2469[]2470[]2471[]2472[]2473[]2474[]2475[]2476[]2477[]2478[]2479[]2480[]2481[]2482[]2483[]2484[]2485[]2486[]2487[]2488[]2489[]2490[]2491[]2492[{'id': 2, 'project_id': 1, 'number': 2, 'tree_hash': 'cefc112e8680bb0f9569544b9656644ac3312d93', 'commit_sha': '1ec92181522c6d831f5b4109cbf4ce466fbfedce', 'branch': 'master', 'pr_number': None, 'pr_author': None, 'status': 'evaluating', 'eval_warnings': None, 'error': None, 'created_at': '2026-08-20T06:16:19.273403Z', 'started_at': '2026-08-20T06:16:19.685986Z', 'finished_at': None}]2493[{'id': 5, 'sha': '1ec92181522c6d831f5b4109cbf4ce466fbfedce', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluating flake', 'created_at': '2026-08-20T06:16:19.647Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2494[{'id': 5, 'sha': '1ec92181522c6d831f5b4109cbf4ce466fbfedce', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluating flake', 'created_at': '2026-08-20T06:16:19.647Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2495[{'id': 5, 'sha': '1ec92181522c6d831f5b4109cbf4ce466fbfedce', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluating flake', 'created_at': '2026-08-20T06:16:19.647Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2496[{'id': 5, 'sha': '1ec92181522c6d831f5b4109cbf4ce466fbfedce', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluating flake', 'created_at': '2026-08-20T06:16:19.647Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2497[{'id': 5, 'sha': '1ec92181522c6d831f5b4109cbf4ce466fbfedce', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluating flake', 'created_at': '2026-08-20T06:16:19.647Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2498[{'id': 5, 'sha': '1ec92181522c6d831f5b4109cbf4ce466fbfedce', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluation succeeded (1 warning)', 'created_at': '2026-08-20T06:16:19.647Z', 'started_at': None, 'finished_at': '2026-08-20T06:16:25.499Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}, {'id': 6, 'sha': '1ec92181522c6d831f5b4109cbf4ce466fbfedce', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-build', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': '0 attributes built', 'created_at': '2026-08-20T06:16:25.781Z', 'started_at': None, 'finished_at': '2026-08-20T06:16:26.034Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]