vm-test-run-nixbot-gitlab
checks.aarch64-linux.nixbot-gitlab
· build #238
· raw
1tribuchet: building on eliza2Machine state will be reset. To keep it, pass --keep-machine-state3start all VLans4(finished: start all VLans, in 0.00 seconds)5Test will time out and terminate in 3600 seconds6run the VM test script7start all VMs8gitlab: starting vm9gitlab: QEMU running (pid 46)10gitlab # Disk image does not exist, creating the virtualisation disk image...11gitlab # Formatting '/build/vm-state-gitlab/tmp.rZeHY6EFxO', fmt=raw size=107374182412gitlab # mke2fs 1.47.4 (6-Mar-2025)13(finished: start all VMs, in 67.81 seconds)14gitlab # Discarding device blocks: 0/262144 done15gitlab: waiting for unit setup-gitlab.service16gitlab # Creating filesystem with 262144 4k blocks and 65536 inodes17gitlab: waiting for the VM to finish booting18gitlab # Filesystem UUID: 41ce0185-ab09-4ebe-bee9-0467739af6be19gitlab # Superblock backups stored on blocks:20gitlab # 32768, 98304, 163840, 22937621gitlab # 22gitlab # Allocating group tables: 0/8 done23gitlab # Writing inode tables: 0/8 done24gitlab # Creating journal (8192 blocks): done25gitlab # Writing superblocks and filesystem accounting information: 0/8 done26gitlab # 27gitlab # Virtualisation disk image created.28gitlab # Creating Nix store image...29gitlab # Created Nix store image.30gitlab # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40]31gitlab # [ 0.000000] Linux version 6.18.43 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Thu Aug 6 17:27:09 UTC 202632gitlab # [ 0.000000] KASLR enabled33gitlab # [ 0.000000] random: crng init done34gitlab # [ 0.000000] Machine model: linux,dummy-virt35gitlab # [ 0.000000] efi: UEFI not found.36gitlab # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT37gitlab # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x00000001bfffffff]38gitlab # [ 0.000000] NODE_DATA(0) allocated [mem 0x1bfdeb740-0x1bfdeeebf]39gitlab # [ 0.000000] Zone ranges:40gitlab # [ 0.000000] DMA [mem 0x0000000040000000-0x00000000ffffffff]41gitlab # [ 0.000000] DMA32 empty42gitlab # [ 0.000000] Normal [mem 0x0000000100000000-0x00000001bfffffff]43gitlab # [ 0.000000] Device empty44gitlab # [ 0.000000] Movable zone start for each node45gitlab # [ 0.000000] Early memory node ranges46gitlab # [ 0.000000] node 0: [mem 0x0000000040000000-0x00000001bfffffff]47gitlab # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x00000001bfffffff]48gitlab # [ 0.000000] cma: Reserved 32 MiB at 0x00000000fe00000049gitlab # [ 0.000000] psci: probing for conduit method from DT.50gitlab # [ 0.000000] psci: PSCIv1.3 detected in firmware.51gitlab # [ 0.000000] psci: Using standard PSCI v0.2 function IDs52gitlab # [ 0.000000] psci: Trusted OS migration not required53gitlab # [ 0.000000] psci: SMC Calling Convention v1.154gitlab # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003)55gitlab # [ 0.000000] percpu: Embedded 76 pages/cpu s186712 r8192 d116392 u31129656gitlab # [ 0.000000] Detected PIPT I-cache on CPU057gitlab # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm)58gitlab # [ 0.000000] CPU features: detected: GICv3 CPU interface59gitlab # [ 0.000000] CPU features: detected: Spectre-v460gitlab # [ 0.000000] CPU features: detected: Spectre-BHB61gitlab # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_3862gitlab # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_2363gitlab # [ 0.000000] alternatives: applying boot alternatives64gitlab # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/x2vfw7ng6pyd8y0klwck84z5ipagn2vl-nixos-system-gitlab-test/init regInfo=/nix/store/5xn02l42wxfxl83xgigglla5n4rn8zyy-closure-info/registration console=ttyAMA0,115200n8 console=tty065gitlab # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/5xn02l42wxfxl83xgigglla5n4rn8zyy-closure-info/registration", will be passed to user space.66gitlab # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes67gitlab # [ 0.000000] Dentry cache hash table entries: 1048576 (order: 11, 8388608 bytes, linear)68gitlab # [ 0.000000] Inode-cache hash table entries: 524288 (order: 10, 4194304 bytes, linear)69gitlab # [ 0.000000] software IO TLB: area num 4.70gitlab # [ 0.000000] software IO TLB: mapped [mem 0x00000000fa000000-0x00000000fe000000] (64MB)71gitlab # [ 0.000000] Fallback order for Node 0: 072gitlab # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 157286473gitlab # [ 0.000000] Policy zone: Normal74gitlab # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off75gitlab # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=176gitlab # [ 0.000000] allocated 12582912 bytes of page_ext77gitlab # [ 0.000000] ftrace: allocating 74867 entries in 294 pages78gitlab # [ 0.000000] ftrace: allocated 294 pages with 4 groups79gitlab # [ 0.000000] rcu: Hierarchical RCU implementation.80gitlab # [ 0.000000] rcu: RCU event tracing is enabled.81gitlab # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=4.82gitlab # [ 0.000000] Trampoline variant of Tasks RCU enabled.83gitlab # [ 0.000000] Rude variant of Tasks RCU enabled.84gitlab # [ 0.000000] Tracing variant of Tasks RCU enabled.85gitlab # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.86gitlab # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=487gitlab # [ 0.000000] RCU Tasks: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.88gitlab # [ 0.000000] RCU Tasks Rude: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.89gitlab # [ 0.000000] RCU Tasks Trace: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.90gitlab # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 091gitlab # [ 0.000000] GICv3: 256 SPIs implemented92gitlab # [ 0.000000] GICv3: 0 Extended SPIs implemented93gitlab # [ 0.000000] Root IRQ handler: gic_handle_irq94gitlab # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI95gitlab # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=096gitlab # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a000097gitlab # [ 0.000000] ITS [mem 0x08080000-0x0809ffff]98gitlab # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @100f10000 (indirect, esz 8, psz 64K, shr 1)99gitlab # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @100f20000 (flat, esz 8, psz 64K, shr 1)100gitlab # [ 0.000000] GICv3: using LPI property table @0x0000000100f30000101gitlab # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000100f40000102gitlab # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.103gitlab # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns104gitlab # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt).105gitlab # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns106gitlab # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns107gitlab # [ 0.000027] arm-pv: using stolen time PV108gitlab # [ 0.000379] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)109gitlab # [ 0.000518] Console: colour dummy device 80x25110gitlab # [ 0.000525] printk: legacy console [tty0] enabled111gitlab # [ 0.000857] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000)112gitlab # [ 0.000864] pid_max: default: 32768 minimum: 301113gitlab # [ 0.000942] LSM: initializing lsm=capability,landlock,yama,bpf,ima114gitlab # [ 0.001072] landlock: Up and running.115gitlab # [ 0.001076] Yama: becoming mindful.116gitlab # [ 0.001495] LSM support for eBPF active117gitlab # [ 0.001687] Mount-cache hash table entries: 16384 (order: 5, 131072 bytes, linear)118gitlab # [ 0.001789] Mountpoint-cache hash table entries: 16384 (order: 5, 131072 bytes, linear)119gitlab # [ 0.002932] cacheinfo: Unable to detect cache hierarchy for CPU 0120gitlab # [ 0.003606] rcu: Hierarchical SRCU implementation.121gitlab # [ 0.003610] rcu: Max phase no-delay instances is 1000.122gitlab # [ 0.003759] Timer migration: 1 hierarchy levels; 8 children per group; 1 crossnode level123gitlab # [ 0.004756] fsl-mc MSI: its@8080000 domain created124gitlab # [ 0.004849] EFI services will not be available.125gitlab # [ 0.005010] smp: Bringing up secondary CPUs ...126gitlab # [ 0.005658] Detected PIPT I-cache on CPU1127gitlab # [ 0.005755] GICv3: CPU1: found redistributor 1 region 0:0x00000000080c0000128gitlab # [ 0.005877] GICv3: CPU1: using allocated LPI pending table @0x0000000100f50000129gitlab # [ 0.006000] CPU1: Booted secondary processor 0x0000000001 [0xc00fac40]130gitlab # [ 0.007061] Detected PIPT I-cache on CPU2131gitlab # [ 0.007167] GICv3: CPU2: found redistributor 2 region 0:0x00000000080e0000132gitlab # [ 0.007289] GICv3: CPU2: using allocated LPI pending table @0x0000000100f60000133gitlab # [ 0.007412] CPU2: Booted secondary processor 0x0000000002 [0xc00fac40]134gitlab # [ 0.008472] Detected PIPT I-cache on CPU3135gitlab # [ 0.008584] GICv3: CPU3: found redistributor 3 region 0:0x0000000008100000136gitlab # [ 0.008715] GICv3: CPU3: using allocated LPI pending table @0x0000000100f70000137gitlab # [ 0.008837] CPU3: Booted secondary processor 0x0000000003 [0xc00fac40]138gitlab # [ 0.009357] smp: Brought up 1 node, 4 CPUs139gitlab # [ 0.009384] SMP: Total of 4 processors activated.140gitlab # [ 0.009386] CPU: All CPU(s) started at EL1141gitlab # [ 0.009394] CPU features: detected: Branch Target Identification142gitlab # [ 0.009398] CPU features: detected: ARMv8.4 Translation Table Level143gitlab # [ 0.009401] CPU features: detected: Instruction cache invalidation not required for I/D coherence144gitlab # [ 0.009404] CPU features: detected: Data cache clean to the PoU not required for I/D coherence145gitlab # [ 0.009407] CPU features: detected: Common not Private translations146gitlab # [ 0.009410] CPU features: detected: CRC32 instructions147gitlab # [ 0.009413] CPU features: detected: Data cache clean to Point of Deep Persistence148gitlab # [ 0.009416] CPU features: detected: Data cache clean to Point of Persistence149gitlab # [ 0.009419] CPU features: detected: Data independent timing control (DIT)150gitlab # [ 0.009422] CPU features: detected: E0PD151gitlab # [ 0.009424] CPU features: detected: Enhanced Counter Virtualization152gitlab # [ 0.009427] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF)153gitlab # [ 0.009431] CPU features: detected: Enhanced Virtualization Traps154gitlab # [ 0.009434] CPU features: detected: Fine Grained Traps155gitlab # [ 0.009437] CPU features: detected: Generic authentication (architected QARMA5 algorithm)156gitlab # [ 0.009441] CPU features: detected: RCpc load-acquire (LDAPR)157gitlab # [ 0.009443] CPU features: detected: LSE atomic instructions158gitlab # [ 0.009446] CPU features: detected: Privileged Access Never159gitlab # [ 0.009449] CPU features: detected: PMUv3160gitlab # [ 0.009451] CPU features: detected: RAS Extension Support161gitlab # [ 0.009454] CPU features: detected: RASv1p1 Extension Support162gitlab # [ 0.009457] CPU features: detected: Random Number Generator163gitlab # [ 0.009459] CPU features: detected: Speculation barrier (SB)164gitlab # [ 0.009462] CPU features: detected: Stage-2 Force Write-Back165gitlab # [ 0.009464] CPU features: detected: TLB range maintenance instructions166gitlab # [ 0.009468] CPU features: detected: Speculative Store Bypassing Safe (SSBS)167gitlab # [ 0.009597] alternatives: applying system-wide alternatives168gitlab # [ 0.012444] CPU features: detected: BBM Level 2 without TLB conflict abort169gitlab # [ 0.012701] Memory: 5963820K/6291456K available (24448K kernel code, 7090K rwdata, 26340K rodata, 4736K init, 1106K bss, 272908K reserved, 32768K cma-reserved)170gitlab # [ 0.014148] devtmpfs: initialized171gitlab # [ 0.018236] posixtimers hash table entries: 2048 (order: 3, 32768 bytes, linear)172gitlab # [ 0.018308] futex hash table entries: 1024 (65536 bytes on 1 NUMA nodes, total 64 KiB, linear).173gitlab # [ 0.018482] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL174gitlab # [ 0.018486] 0 pages in range for non-PLT usage175gitlab # [ 0.018487] 508288 pages in range for PLT usage176gitlab # [ 0.018605] pinctrl core: initialized pinctrl subsystem177gitlab # [ 0.019411] DMI not present or invalid.178gitlab # [ 0.022854] NET: Registered PF_NETLINK/PF_ROUTE protocol family179gitlab # [ 0.025302] DMA: preallocated 1024 KiB GFP_KERNEL pool for atomic allocations180gitlab # [ 0.025575] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations181gitlab # [ 0.027441] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations182gitlab # [ 0.027461] audit: initializing netlink subsys (disabled)183gitlab # [ 0.027770] audit: type=2000 audit(0.024:1): state=initialized audit_enabled=0 res=1184gitlab # [ 0.028237] thermal_sys: Registered thermal governor 'fair_share'185gitlab # [ 0.028240] thermal_sys: Registered thermal governor 'bang_bang'186gitlab # [ 0.028244] thermal_sys: Registered thermal governor 'step_wise'187gitlab # [ 0.028247] thermal_sys: Registered thermal governor 'user_space'188gitlab # [ 0.028249] thermal_sys: Registered thermal governor 'power_allocator'189gitlab # [ 0.028328] cpuidle: using governor ladder190gitlab # [ 0.028389] cpuidle: using governor menu191gitlab # [ 0.028606] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers.192gitlab # [ 0.028819] ASID allocator initialised with 65536 entries193gitlab # [ 0.029983] Serial: AMBA PL011 UART driver194gitlab # [ 0.035209] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1195gitlab # [ 0.035520] printk: console [ttyAMA0] enabled196gitlab # [ 0.047418] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages197gitlab # [ 0.047441] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page198gitlab # [ 0.047451] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages199gitlab # [ 0.047459] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page200gitlab # [ 0.047467] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages201gitlab # [ 0.047475] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page202gitlab # [ 0.047483] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages203gitlab # [ 0.047491] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page204gitlab # [ 0.059589] fbcon: Taking over console205gitlab # [ 0.059601] ACPI: Interpreter disabled.206gitlab # [ 0.060633] iommu: Default domain type: Translated207gitlab # [ 0.060649] iommu: DMA domain TLB invalidation policy: strict mode208gitlab # [ 0.074832] SCSI subsystem initialized209gitlab # [ 0.075237] usbcore: registered new interface driver usbfs210gitlab # [ 0.075263] usbcore: registered new interface driver hub211gitlab # [ 0.075282] usbcore: registered new device driver usb212gitlab # [ 0.075563] pps_core: LinuxPPS API ver. 1 registered213gitlab # [ 0.075567] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>214gitlab # [ 0.075577] PTP clock support registered215gitlab # [ 0.075618] EDAC MC: Ver: 3.0.0216gitlab # [ 0.076105] scmi_core: SCMI protocol bus registered217gitlab # [ 0.077089] FPGA manager framework218gitlab # [ 0.077918] vgaarb: loaded219gitlab # [ 0.078895] clocksource: Switched to clocksource arch_sys_counter220gitlab # [ 0.094955] VFS: Disk quotas dquot_6.6.0221gitlab # [ 0.095021] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)222gitlab # [ 0.095864] netfs: FS-Cache loaded223gitlab # [ 0.096138] pnp: PnP ACPI: disabled224gitlab # [ 0.107180] NET: Registered PF_INET protocol family225gitlab # [ 0.109526] IP idents hash table entries: 131072 (order: 8, 1048576 bytes, linear)226gitlab # [ 0.169983] tcp_listen_portaddr_hash hash table entries: 4096 (order: 4, 65536 bytes, linear)227gitlab # [ 0.170050] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)228gitlab # [ 0.170109] TCP established hash table entries: 65536 (order: 7, 524288 bytes, linear)229gitlab # [ 0.170511] TCP bind hash table entries: 65536 (order: 9, 2097152 bytes, linear)230gitlab # [ 0.171464] TCP: Hash tables configured (established 65536 bind 65536)231gitlab # [ 0.171606] MPTCP token hash table entries: 8192 (order: 6, 196608 bytes, linear)232gitlab # [ 0.171679] UDP hash table entries: 4096 (order: 6, 262144 bytes, linear)233gitlab # [ 0.171855] UDP-Lite hash table entries: 4096 (order: 6, 262144 bytes, linear)234gitlab # [ 0.172114] NET: Registered PF_UNIX/PF_LOCAL protocol family235gitlab # [ 0.172163] NET: Registered PF_XDP protocol family236gitlab # [ 0.172185] PCI: CLS 0 bytes, default 64237gitlab # [ 0.172514] Trying to unpack rootfs image as initramfs...238gitlab # [ 0.183608] kvm [1]: HYP mode not available239gitlab # [ 0.253072] Initialise system trusted keyrings240gitlab # [ 0.253438] workingset: timestamp_bits=42 max_order=21 bucket_order=0241gitlab # [ 0.254291] squashfs: version 4.0 (2009/01/31) Phillip Lougher242gitlab # [ 0.254433] 9p: Installing v9fs 9p2000 file system support243gitlab # [ 0.270112] Key type asymmetric registered244gitlab # [ 0.270131] Asymmetric key parser 'x509' registered245gitlab # [ 0.270206] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242)246gitlab # [ 0.270468] io scheduler mq-deadline registered247gitlab # [ 0.270485] io scheduler kyber registered248gitlab # [ 0.281948] pl061_gpio 9030000.pl061: PL061 GPIO chip registered249gitlab # [ 0.287087] ledtrig-cpu: registered to indicate activity on CPUs250gitlab # [ 0.288062] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges:251gitlab # [ 0.288096] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000252gitlab # [ 0.288124] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000253gitlab # [ 0.288140] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000254gitlab # [ 0.288185] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits255gitlab # [ 0.288232] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff]256gitlab # [ 0.288414] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00257gitlab # [ 0.288453] pci_bus 0000:00: root bus resource [bus 00-ff]258gitlab # [ 0.288466] pci_bus 0000:00: root bus resource [io 0x0000-0xffff]259gitlab # [ 0.288475] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff]260gitlab # [ 0.288484] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff]261gitlab # [ 0.288718] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint262gitlab # [ 0.290034] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint263gitlab # [ 0.290670] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f]264gitlab # [ 0.290703] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff]265gitlab # [ 0.290778] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]266gitlab # [ 0.290812] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref]267gitlab # [ 0.292261] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint268gitlab # [ 0.292890] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f]269gitlab # [ 0.292922] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff]270gitlab # [ 0.293004] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]271gitlab # [ 0.294529] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint272gitlab # [ 0.295168] pci 0000:00:03.0: BAR 0 [io 0x0000-0x001f]273gitlab # [ 0.295202] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff]274gitlab # [ 0.295279] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]275gitlab # [ 0.296708] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint276gitlab # [ 0.297330] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f]277gitlab # [ 0.297365] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff]278gitlab # [ 0.297460] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]279gitlab # [ 0.298982] pci 0000:00:05.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint280gitlab # [ 0.299537] pci 0000:00:05.0: BAR 0 [io 0x0000-0x007f]281gitlab # [ 0.299571] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff]282gitlab # [ 0.299645] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]283gitlab # [ 0.301161] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint284gitlab # [ 0.301784] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f]285gitlab # [ 0.301817] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff]286gitlab # [ 0.301900] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]287gitlab # [ 0.303351] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint288gitlab # [ 0.303879] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f]289gitlab # [ 0.303911] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff]290gitlab # [ 0.303984] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]291gitlab # [ 0.304017] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref]292gitlab # [ 0.305500] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint293gitlab # [ 0.306208] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff]294gitlab # [ 0.306288] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]295gitlab # [ 0.307974] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint296gitlab # [ 0.308669] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff]297gitlab # [ 0.308760] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]298gitlab # [ 0.310101] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint299gitlab # [ 0.310754] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff]300gitlab # [ 0.311592] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint301gitlab # [ 0.312361] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f]302gitlab # [ 0.312398] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff]303gitlab # [ 0.312476] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]304gitlab # [ 0.314034] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint305gitlab # [ 0.314717] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f]306gitlab # [ 0.314752] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff]307gitlab # [ 0.314843] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]308gitlab # [ 0.316685] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned309gitlab # [ 0.316704] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned310gitlab # [ 0.316715] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned311gitlab # [ 0.316854] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned312gitlab # [ 0.317018] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned313gitlab # [ 0.317170] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned314gitlab # [ 0.317324] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned315gitlab # [ 0.317472] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned316gitlab # [ 0.317623] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned317gitlab # [ 0.317783] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned318gitlab # [ 0.317925] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned319gitlab # [ 0.318069] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned320gitlab # [ 0.318257] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned321gitlab # [ 0.318390] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned322gitlab # [ 0.318443] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned323gitlab # [ 0.318495] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned324gitlab # [ 0.318548] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned325gitlab # [ 0.318603] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned326gitlab # [ 0.318656] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned327gitlab # [ 0.318709] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned328gitlab # [ 0.318763] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned329gitlab # [ 0.318832] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned330gitlab # [ 0.318940] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned331gitlab # [ 0.319008] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned332gitlab # [ 0.319075] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned333gitlab # [ 0.319128] pci 0000:00:05.0: BAR 0 [io 0x1000-0x107f]: assigned334gitlab # [ 0.319192] pci 0000:00:06.0: BAR 0 [io 0x1080-0x10ff]: assigned335gitlab # [ 0.319244] pci 0000:00:0b.0: BAR 0 [io 0x1100-0x113f]: assigned336gitlab # [ 0.319296] pci 0000:00:01.0: BAR 0 [io 0x1140-0x115f]: assigned337gitlab # [ 0.319350] pci 0000:00:02.0: BAR 0 [io 0x1160-0x117f]: assigned338gitlab # [ 0.319403] pci 0000:00:03.0: BAR 0 [io 0x1180-0x119f]: assigned339gitlab # [ 0.319468] pci 0000:00:04.0: BAR 0 [io 0x11a0-0x11bf]: assigned340gitlab # [ 0.319521] pci 0000:00:07.0: BAR 0 [io 0x11c0-0x11df]: assigned341gitlab # [ 0.319576] pci 0000:00:0c.0: BAR 0 [io 0x11e0-0x11ff]: assigned342gitlab # [ 0.319650] pci_bus 0000:00: resource 4 [io 0x0000-0xffff]343gitlab # [ 0.319665] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff]344gitlab # [ 0.319674] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff]345gitlab # [ 0.323831] pci 0000:00:0a.0: enabling device (0000 -> 0002)346gitlab # [ 0.356956] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003)347gitlab # [ 0.362130] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003)348gitlab # [ 0.367072] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003)349gitlab # [ 0.373168] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003)350gitlab # [ 0.378121] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003)351gitlab # [ 0.383565] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003)352gitlab # [ 0.389275] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003)353gitlab # [ 0.394270] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002)354gitlab # [ 0.400645] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002)355gitlab # [ 0.405153] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003)356gitlab # [ 0.411583] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003)357gitlab # [ 0.424667] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled358gitlab # [ 0.428780] msm_serial: driver initialized359gitlab # [ 0.429078] SuperH (H)SCI(F) driver initialized360gitlab # [ 0.429186] STM32 USART driver initialized361gitlab # [ 0.467874] loop: module loaded362gitlab # [ 0.468254] virtio_blk virtio4: 4/0/0 default/read/poll queues363gitlab # [ 0.471798] virtio_blk virtio4: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)364gitlab # [ 0.475165] virtio_blk virtio5: 4/0/0 default/read/poll queues365gitlab # [ 0.478944] virtio_blk virtio5: [vdb] 12227504 512-byte logical blocks (6.26 GB/5.83 GiB)366gitlab # [ 0.484947] megasas: 07.734.00.00-rc1367gitlab # [ 0.486271] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff]368gitlab # [ 0.491433] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000369gitlab # [ 0.491458] Intel/Sharp Extended Query Table at 0x0031370gitlab # [ 0.494564] Using buffer write method371gitlab # [ 0.494612] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff]372gitlab # [ 0.498830] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000373gitlab # [ 0.498854] Intel/Sharp Extended Query Table at 0x0031374gitlab # [ 0.501701] Using buffer write method375gitlab # [ 0.501731] Concatenating MTD devices:376gitlab # [ 0.501736] (0): "0.flash"377gitlab # [ 0.501741] (1): "0.flash"378gitlab # [ 0.501745] into device "0.flash"379gitlab # [ 0.702337] Freeing initrd memory: 27184K380gitlab # [ 0.717328] tun: Universal TUN/TAP device driver, 1.6381gitlab # [ 0.722059] thunder_xcv, ver 1.0382gitlab # [ 0.722127] thunder_bgx, ver 1.0383gitlab # [ 0.722172] nicpf, ver 1.0384gitlab # [ 0.723059] e1000: Intel(R) PRO/1000 Network Driver385gitlab # [ 0.723065] e1000: Copyright (c) 1999-2006 Intel Corporation.386gitlab # [ 0.723099] e1000e: Intel(R) PRO/1000 Network Driver387gitlab # [ 0.723107] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.388gitlab # [ 0.723145] igb: Intel(R) Gigabit Ethernet Network Driver389gitlab # [ 0.723150] igb: Copyright (c) 2007-2014 Intel Corporation.390gitlab # [ 0.723189] igbvf: Intel(R) Gigabit Virtual Function Network Driver391gitlab # [ 0.723195] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.392gitlab # [ 0.723411] sky2: driver version 1.30393gitlab # [ 0.725833] usbcore: registered new interface driver usb-storage394gitlab # [ 0.725974] usbcore: registered new interface driver usbserial_generic395gitlab # [ 0.725995] usbserial: USB Serial support registered for generic396gitlab # [ 0.726644] ehci-pci 0000:00:0a.0: EHCI Host Controller397gitlab # [ 0.726725] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 1398gitlab # [ 0.726859] hv_vmbus: registering driver hyperv_keyboard399gitlab # [ 0.727347] ehci-pci 0000:00:0a.0: irq 15, io mem 0x10089000400gitlab # [ 0.728258] rtc-pl031 9010000.pl031: registered as rtc0401gitlab # [ 0.728294] rtc-pl031 9010000.pl031: setting system clock to 2026-08-17T07:18:11 UTC (1786951091)402gitlab # [ 0.728741] i2c_dev: i2c /dev entries driver403gitlab # [ 0.732736] sdhci: Secure Digital Host Controller Interface driver404gitlab # [ 0.732743] sdhci: Copyright(c) Pierre Ossman405gitlab # [ 0.733120] Synopsys Designware Multimedia Card Interface Driver406gitlab # [ 0.733666] sdhci-pltfm: SDHCI platform and OF driver helper407gitlab # [ 0.736015] hid: raw HID events driver (C) Jiri Kosina408gitlab # [ 0.736461] usbcore: registered new interface driver usbhid409gitlab # [ 0.736467] usbhid: USB HID core driver410gitlab # [ 0.743057] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.00411gitlab # [ 0.744656] hub 1-0:1.0: USB hub found412gitlab # [ 0.744768] hub 1-0:1.0: 6 ports detected413gitlab # [ 0.757046] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available414gitlab # [ 0.759616] drop_monitor: Initializing network drop monitor service415gitlab # [ 0.759772] NET: Registered PF_INET6 protocol family416gitlab # [ 0.761299] Segment Routing with IPv6417gitlab # [ 0.761327] In-situ OAM (IOAM) with IPv6418gitlab # [ 0.761450] NET: Registered PF_PACKET protocol family419gitlab # [ 0.761959] 9pnet: Installing 9P2000 support420gitlab # [ 0.765363] Key type dns_resolver registered421gitlab # [ 0.778132] registered taskstats version 1422gitlab # [ 0.778519] Loading compiled-in X.509 certificates423gitlab # [ 0.792631] Demotion targets for Node 0: null424gitlab # [ 0.792778] Key type .fscrypt registered425gitlab # [ 0.792784] Key type fscrypt-provisioning registered426gitlab # [ 0.792959] ima: No TPM chip found, activating TPM-bypass!427gitlab # [ 0.792980] ima: Allocated hash algorithm: sha1428gitlab # [ 0.793014] ima: No architecture policies found429gitlab # [ 0.793907] input: gpio-keys as /devices/platform/gpio-keys/input/input0430gitlab # [ 0.817482] clk: Disabling unused clocks431gitlab # [ 0.817509] PM: genpd: Disabling unused power domains432gitlab # [ 0.822056] Freeing unused kernel memory: 4736K433gitlab # [ 0.822289] Run /init as init process434gitlab # [ 0.857905] systemd[1]: Successfully made /usr/ read-only.435gitlab # [ 0.991004] usb 1-1: new high-speed USB device number 2 using ehci-pci436gitlab # [ 1.148149] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input1437gitlab # [ 1.192335] systemd[1]: systemd 261.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)438gitlab # [ 1.192406] systemd[1]: Detected virtualization qemu.439gitlab # [ 1.192481] systemd[1]: Detected architecture arm64.440gitlab # [ 1.192500] systemd[1]: Running in initrd.441gitlab # [ 1.193369] systemd[1]: Initializing machine ID from random generator.442gitlab # [ 1.193722] systemd[1]: Hostname set to <gitlab>.443gitlab # [ 1.267666] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input0444gitlab # [ 1.386985] usb 1-2: new high-speed USB device number 3 using ehci-pci445gitlab # [ 1.446472] systemd[1]: bpf-restrict-fs: LSM BPF program attached446gitlab # [ 1.543135] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input2447gitlab # [ 1.543563] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input0448gitlab # [ 1.548945] systemd[1]: Queued start job for default target Initrd Default Target.449gitlab # [ 1.571757] systemd[1]: Created slice Slice /system/modprobe.450gitlab # [ 1.572151] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.451gitlab # [ 1.572205] systemd[1]: Expecting device /dev/disk/by-label/nix-store...452gitlab # [ 1.572226] systemd[1]: Expecting device /dev/disk/by-label/nixos...453gitlab # [ 1.572263] systemd[1]: Reached target Path Units.454gitlab # [ 1.572290] systemd[1]: Reached target Slice Units.455gitlab # [ 1.572318] systemd[1]: Reached target Swaps.456gitlab # [ 1.572346] systemd[1]: Reached target Timer Units.457gitlab # [ 1.572653] systemd[1]: Listening on D-Bus System Message Bus Socket.458gitlab # [ 1.572926] systemd[1]: Listening on Journal Socket (/dev/log).459gitlab # [ 1.573180] systemd[1]: Listening on Journal Sockets.460gitlab # [ 1.573485] systemd[1]: Listening on udev Control Socket.461gitlab # [ 1.573632] systemd[1]: Listening on udev Kernel Socket.462gitlab # [ 1.573666] systemd[1]: Reached target Socket Units.463gitlab # [ 1.576324] systemd[1]: Starting Create List of Static Device Nodes...464gitlab # [ 1.579122] systemd[1]: Starting Load Kernel Module 9pnet_virtio...465gitlab # [ 1.579239] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs466gitlab # [ 1.582082] systemd[1]: Mounting Kernel Configuration File System...467gitlab # [ 1.605375] systemd[1]: Starting Journal Service...468gitlab # [ 1.615119] systemd[1]: Starting Load Kernel Modules...469gitlab # [ 1.615308] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os470gitlab # [ 1.618834] systemd[1]: Starting Coldplug All udev Devices...471gitlab # [ 1.635585] systemd[1]: Finished Create List of Static Device Nodes.472gitlab # [ 1.637974] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.473gitlab # [ 1.638997] systemd[1]: Finished Load Kernel Module 9pnet_virtio.474gitlab # [ 1.639851] systemd[1]: Mounted Kernel Configuration File System.475gitlab # [ 1.644338] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...476gitlab # [ 1.678055] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.477gitlab # [ 1.678685] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.478gitlab # [ 1.681730] systemd[1]: Starting Create Static Device Nodes in /dev...479gitlab # [ 1.687612] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev480gitlab # [ 1.692435] [drm] pci: virtio-gpu-pci detected at 0000:00:08.0481gitlab # [ 1.692690] [drm] features: -virgl +edid -resource_blob -host_visible482gitlab # [ 1.692705] [drm] features: -context_init483gitlab # [ 1.693900] [drm] number of scanouts: 1484gitlab # [ 1.693930] [drm] number of cap sets: 0485gitlab # [ 1.699057] systemd-journald[96]: Collecting audit messages is disabled.486gitlab # [ 1.700095] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic487gitlab # [ 1.700119] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 0488gitlab # [ 1.707593] Console: switching to colour frame buffer device 160x50489gitlab # [ 1.716289] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device490gitlab # [ 1.722704] systemd[1]: Finished Create Static Device Nodes in /dev.491gitlab # [ 1.725213] systemd[1]: Reached target Preparation for Local File Systems.492gitlab # [ 1.727147] systemd[1]: Reached target Local File Systems.493gitlab # [ 1.732325] systemd[1]: Starting Rule-based Manager for Device Events and Files...494gitlab # [ 1.740267] systemd[1]: Finished Load Kernel Modules.495gitlab # [ 1.747357] systemd[1]: Starting Apply Kernel Variables...496gitlab # [ 1.779328] systemd[1]: Finished Apply Kernel Variables.497gitlab # [ 1.787057] systemd[1]: Started Journal Service.498gitlab # [ 1.784229] systemd-modules-load[97]: Using 4 probe threads499gitlab # [ 1.787412] systemd-modules-load[97]: Module 'virtio_balloon' is built in500gitlab # [ 1.788702] systemd-modules-load[97]: Module 'virtio_console' is built in501gitlab # [ 1.790146] systemd-modules-load[97]: Module 'virtio_rng' is built in502gitlab # [ 1.791304] systemd-modules-load[97]: Inserted module 'dm_mod'503gitlab # [ 1.792394] systemd-modules-load[97]: Inserted module 'virtio_gpu'504gitlab # [ 1.793451] systemd[1]: Starting Create System Files and Directories...505gitlab # [ 1.805065] systemd-udevd[107]: Using default interface naming scheme 'v261'.506gitlab # [ 1.824423] systemd[1]: Finished Create System Files and Directories.507gitlab # [ 1.827346] systemd[1]: Started Rule-based Manager for Device Events and Files.508gitlab # [ 1.846877] systemd[1]: Starting Virtual Console Setup...509gitlab # [ 1.906174] systemd-vconsole-setup[130]: Configuration of first virtual console was skipped, ignoring remaining ones.510gitlab # [ 1.912111] systemd[1]: Finished Virtual Console Setup.511gitlab # [ 2.241808] systemd[1]: Finished Coldplug All udev Devices.512gitlab # [ 2.244457] systemd[1]: Reached target System Initialization.513gitlab # [ 2.246977] systemd[1]: Reached target Basic System.514gitlab # [ 2.445341] (udev-worker)[126]: Network interface NamePolicy= disabled on kernel command line.515gitlab # [ 2.449179] (udev-worker)[125]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.516gitlab # [ 2.454540] (udev-worker)[125]: Network interface NamePolicy= disabled on kernel command line.517gitlab # [ 2.458987] systemd[1]: Found device /dev/disk/by-label/nixos.518gitlab # [ 2.460816] systemd[1]: Reached target Initrd Root Device.519gitlab # [ 2.462670] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...520gitlab # [ 2.484193] systemd[1]: Found device /dev/disk/by-label/nix-store.521gitlab # [ 2.514846] systemd-fsck[152]: nixos: clean, 12/65536 files, 13019/262144 blocks522gitlab # [ 2.522954] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.523gitlab # [ 2.619206] systemd[1]: Mounting /sysroot...524gitlab # [ 2.652645] EXT4-fs (vda): mounted filesystem 41ce0185-ab09-4ebe-bee9-0467739af6be r/w with ordered data mode. Quota mode: none.525gitlab # [ 2.654226] systemd[1]: Mounted /sysroot.526gitlab # [ 2.655054] systemd[1]: Reached target Initrd Root File System.527gitlab # [ 2.657339] systemd[1]: Starting Mountpoints Configured in the Real Root...528gitlab # [ 2.679594] systemd-sysroot-fstab-check[160]: /sysroot should be mounted in the initrd, will request daemon-reload.529gitlab # [ 2.682223] systemd[1]: Reload requested from client PID 160 ('systemd-sysroot') (unit initrd-parse-etc.service)...530gitlab # [ 2.683890] systemd[1]: Reloading...531gitlab # [ 2.798454] systemd[1]: Reloading finished in 109 ms.532gitlab # [ 2.845040] systemd-sysroot-fstab-check[160]: Requesting initrd-fs.target/start/replace...533gitlab # [ 2.847484] systemd-sysroot-fstab-check[160]: Requesting swap.target/start/replace...534gitlab # [ 2.849161] systemd[1]: Starting Load Kernel Module 9pnet_virtio...535gitlab # [ 2.852504] systemd[1]: initrd-parse-etc.service: Deactivated successfully.536gitlab # [ 2.870045] systemd[1]: Finished Mountpoints Configured in the Real Root.537gitlab # [ 2.871654] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies.538gitlab # [ 2.876031] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.539gitlab # [ 2.877758] systemd[1]: Finished Load Kernel Module 9pnet_virtio.540gitlab # [ 3.017186] (udev-worker)[127]: mtd0ro: Failed to find and pin callout binary "/nix/store/x3ma60wd3w0db1m4dr1xln72q96lnm3b-systemd-261.1/lib/udev/mtd_probe": No such file or directory541gitlab # [ 3.020879] (udev-worker)[127]: mtd0ro: /nix/store/x3ma60wd3w0db1m4dr1xln72q96lnm3b-systemd-261.1/lib/udev/rules.d/75-probe_mtd.rules:5 IMPORT{program}="mtd_probe $devnode": Failed to execute "mtd_probe /dev/mtd0ro", ignoring: No such file or directory542gitlab # [ 3.027010] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.543gitlab # [ 3.028165] systemd[1]: Stopped Virtual Console Setup.544gitlab # [ 3.029011] systemd[1]: Stopping Virtual Console Setup...545gitlab # [ 3.029880] systemd[1]: Starting Virtual Console Setup...546gitlab # [ 3.076228] systemd-vconsole-setup[182]: Configuration of first virtual console was skipped, ignoring remaining ones.547gitlab # [ 3.078877] systemd[1]: Finished Virtual Console Setup.548gitlab # [ 3.624921] systemd[1]: Mounting /sysroot/nix/.ro-store...549gitlab # [ 3.628529] systemd[1]: Mounting /sysroot/nix/.rw-store...550gitlab # [ 3.632328] systemd[1]: Mounting /sysroot/run...551gitlab # [ 3.656319] systemd[1]: Mounting /sysroot/tmp/shared...552gitlab # [ 3.668929] systemd[1]: Mounting /sysroot/tmp/xchg...553gitlab # [ 3.678189] systemd[1]: Mounted /sysroot/nix/.rw-store.554gitlab # [ 3.680785] systemd[1]: Mounted /sysroot/run.555gitlab # [ 3.688527] systemd[1]: Starting rw-sysroot-nix-store.service...556gitlab # [ 3.696414] erofs (device vdb): mounted with root inode @ nid 128.557gitlab # [ 3.704199] systemd[1]: Mounted /sysroot/nix/.ro-store.558gitlab # [ 3.712708] systemd[1]: Mounted /sysroot/tmp/shared.559gitlab # [ 3.715005] systemd[1]: Mounted /sysroot/tmp/xchg.560gitlab # [ 3.717401] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.561gitlab # [ 3.720504] systemd[1]: Finished rw-sysroot-nix-store.service.562gitlab # [ 4.623310] systemd[1]: Mounting /sysroot/nix/store...563gitlab # [ 4.694108] systemd[1]: Mounted /sysroot/nix/store.564gitlab # [ 4.696546] systemd[1]: Reached target Initrd File Systems.565gitlab # [ 4.698958] systemd[1]: Starting Find NixOS closure...566gitlab # [ 4.702267] systemd[1]: Starting Create Volatile Files and Directories in the Real Root...567gitlab # [ 4.744755] systemd[1]: Finished Create Volatile Files and Directories in the Real Root.568gitlab # [ 4.748507] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully.569gitlab # [ 4.765476] systemd[1]: Finished Find NixOS closure.570gitlab # [ 4.767819] systemd[1]: Reached target Initrd Default Target.571gitlab # [ 4.770524] systemd[1]: Starting Cleaning Up and Shutting Down Daemons...572gitlab # [ 4.819060] systemd[1]: Stopped target Initrd Default Target.573gitlab # [ 4.821760] systemd[1]: Stopped target Basic System.574gitlab # [ 4.823919] systemd[1]: Stopped target Initrd Root Device.575gitlab # [ 4.826370] systemd[1]: Stopped target Path Units.576gitlab # [ 4.828562] systemd[1]: systemd-ask-password-console.path: Deactivated successfully.577gitlab # [ 4.831802] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch.578gitlab # [ 4.835326] systemd[1]: Stopped target Slice Units.579gitlab # [ 4.837613] systemd[1]: Stopped target Socket Units.580gitlab # [ 4.842146] systemd[1]: Stopped target System Initialization.581gitlab # [ 4.847490] systemd[1]: Stopped target Swaps.582gitlab # [ 4.852753] systemd[1]: Stopped target Timer Units.583gitlab # [ 4.857565] systemd[1]: dbus.socket: Deactivated successfully.584gitlab # [ 4.863287] systemd[1]: Closed D-Bus System Message Bus Socket.585gitlab # [ 4.868946] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully.586gitlab # [ 4.872850] systemd[1]: Stopped Find NixOS closure.587gitlab # [ 4.875287] systemd[1]: Starting Load Kernel Module 9pnet_virtio...588gitlab # [ 4.878533] systemd[1]: Starting rw-sysroot-nix-store.service...589gitlab # [ 4.881285] systemd[1]: systemd-sysctl.service: Deactivated successfully.590gitlab # [ 4.884444] systemd[1]: Stopped Apply Kernel Variables.591gitlab # [ 4.886936] systemd[1]: systemd-modules-load.service: Deactivated successfully.592gitlab # [ 4.890280] systemd[1]: Stopped Load Kernel Modules.593gitlab # [ 4.892645] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully.594gitlab # [ 4.895889] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root.595gitlab # [ 4.899099] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully.596gitlab # [ 4.901934] systemd[1]: Stopped Create System Files and Directories.597gitlab # [ 4.904207] systemd[1]: Stopped target Local File Systems.598gitlab # [ 4.906131] systemd[1]: Stopped target Preparation for Local File Systems.599gitlab # [ 4.908338] systemd[1]: systemd-udev-trigger.service: Deactivated successfully.600gitlab # [ 4.910575] systemd[1]: Stopped Coldplug All udev Devices.601gitlab # [ 4.912291] systemd[1]: Stopping Rule-based Manager for Device Events and Files...602gitlab # [ 4.914462] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.603gitlab # [ 4.916595] systemd[1]: Stopped Virtual Console Setup.604gitlab # [ 4.918118] systemd[1]: initrd-cleanup.service: Deactivated successfully.605gitlab # [ 4.919946] systemd[1]: Finished Cleaning Up and Shutting Down Daemons.606gitlab # [ 4.922007] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.607gitlab # [ 4.923882] systemd[1]: Finished rw-sysroot-nix-store.service.608gitlab # [ 4.925546] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.609gitlab # [ 4.927343] systemd[1]: Finished Load Kernel Module 9pnet_virtio.610gitlab # [ 4.928919] systemd[1]: systemd-udevd.service: Deactivated successfully.611gitlab # [ 4.930501] systemd[1]: Stopped Rule-based Manager for Device Events and Files.612gitlab # [ 4.932164] systemd[1]: systemd-udevd.service: Consumed 2.291s CPU time over 3.160s wall clock time, 31.5M memory peak.613gitlab # [ 4.934476] systemd[1]: systemd-udevd-control.socket: Deactivated successfully.614gitlab # [ 4.936087] systemd[1]: Closed udev Control Socket.615gitlab # [ 4.937213] systemd[1]: Starting Cleanup udev Database...616gitlab # [ 4.938395] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully.617gitlab # [ 4.939965] systemd[1]: Stopped Create Static Device Nodes in /dev.618gitlab # [ 4.941279] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully.619gitlab # [ 4.942917] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully.620gitlab # [ 4.944360] systemd[1]: kmod-static-nodes.service: Deactivated successfully.621gitlab # [ 4.945742] systemd[1]: Stopped Create List of Static Device Nodes.622gitlab # [ 4.996093] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully.623gitlab # [ 4.999272] systemd[1]: Finished Cleanup udev Database.624gitlab # [ 5.001674] systemd[1]: Reached target Switch Root.625gitlab # [ 5.003882] systemd[1]: Starting NixOS Activation...626gitlab # [ 5.179634] initrd-nixos-activation-start[222]: booting system configuration /nix/store/x2vfw7ng6pyd8y0klwck84z5ipagn2vl-nixos-system-gitlab-test627gitlab # [ 5.241486] initrd-nixos-activation-start[222]: running activation script...628gitlab # [ 5.573119] initrd-nixos-activation-start[245]: setting up /etc...629gitlab # [ 5.751331] systemd[1]: initrd-nixos-activation.service: Deactivated successfully.630gitlab # [ 5.754986] systemd[1]: Finished NixOS Activation.631gitlab # [ 5.757282] systemd[1]: Starting Switch Root...632gitlab # [ 5.807837] systemd[1]: Switching root.633gitlab # [ 5.955717] systemd-journald[96]: Received SIGTERM from PID 1 (systemd).634gitlab # [ 6.592419] systemd[1]: systemd 261.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)635gitlab # [ 6.592579] systemd[1]: Detected virtualization qemu.636gitlab # [ 6.592667] systemd[1]: Detected architecture arm64.637gitlab # [ 6.592859] systemd[1]: Detected first boot.638gitlab # [ 6.594303] systemd[1]: Initializing machine ID from random generator.639gitlab # [ 6.834765] systemd[1]: bpf-restrict-fs: LSM BPF program attached640gitlab # [ 6.946492] systemd[1]: Applying preset policy.641gitlab # [ 7.122383] systemd[1]: Populated /etc with preset unit settings.642gitlab # [ 7.281874] systemd[1]: initrd-switch-root.service: Deactivated successfully.643gitlab # [ 7.282279] systemd[1]: Stopped initrd-switch-root.service.644gitlab # [ 7.284513] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1.645gitlab # [ 7.289278] systemd[1]: Created slice Slice /system/getty.646gitlab # [ 7.295628] systemd[1]: Created slice GitLab DevOps Platform Slice.647gitlab # [ 7.299054] systemd[1]: Created slice User and Session Slice.648gitlab # [ 7.299569] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.649gitlab # [ 7.300331] systemd[1]: Started Forward Password Requests to Wall Directory Watch.650gitlab # [ 7.301010] systemd[1]: Expecting device /dev/hvc0...651gitlab # [ 7.301732] systemd[1]: Expecting device /dev/ttyAMA0...652gitlab # [ 7.302501] systemd[1]: Reached target Local Encrypted Volumes.653gitlab # [ 7.307137] systemd[1]: Stopped target initrd-fs.target.654gitlab # [ 7.308037] systemd[1]: Stopped target initrd-root-fs.target.655gitlab # [ 7.308745] systemd[1]: Stopped target initrd-switch-root.target.656gitlab # [ 7.309474] systemd[1]: Reached target Virtual Machines and Containers.657gitlab # [ 7.310177] systemd[1]: Reached target Path Units.658gitlab # [ 7.310845] systemd[1]: Reached target Remote File Systems.659gitlab # [ 7.311738] systemd[1]: Reached target Slice Units.660gitlab # [ 7.312825] systemd[1]: Reached target Swaps.661gitlab # [ 7.316785] systemd[1]: Listening on Query the User Interactively for a Password.662gitlab # [ 7.321014] systemd[1]: Listening on Process Core Dump Socket.663gitlab # [ 7.324161] systemd[1]: Listening on Credential Encryption/Decryption.664gitlab # [ 7.327941] systemd[1]: Listening on Factory Reset Management.665gitlab # [ 7.329417] systemd[1]: Listening on Hostname Service Socket.666gitlab # [ 7.339627] systemd[1]: Starting Journal Log Access Socket...667gitlab # [ 7.341577] systemd[1]: Listening on Journal Audit Socket.668gitlab # [ 7.343445] systemd[1]: Listening on Console Output Muting Service Socket.669gitlab # [ 7.343973] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket.670gitlab # [ 7.344296] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os671gitlab # [ 7.344582] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki672gitlab # [ 7.346652] systemd[1]: Listening on Disk Repartitioning Service Socket.673gitlab # [ 7.347155] systemd[1]: Listening on udev Control Socket.674gitlab # [ 7.347875] systemd[1]: Listening on udev Varlink Socket.675gitlab # [ 7.353750] systemd[1]: Mounting Huge Pages File System...676gitlab # [ 7.360786] systemd[1]: Mounting POSIX Message Queue File System...677gitlab # [ 7.370106] systemd[1]: Mounting Kernel Debug File System...678gitlab # [ 7.380831] systemd[1]: Mounting Kernel Trace File System...679gitlab # [ 7.395345] systemd[1]: Starting Create List of Static Device Nodes...680gitlab # [ 7.399339] systemd[1]: Starting Load Kernel Module 9pnet_virtio...681gitlab # [ 7.399686] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs682gitlab # [ 7.406414] systemd[1]: Mounting Kernel Configuration File System...683gitlab # [ 7.406832] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm684gitlab # [ 7.407545] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore685gitlab # [ 7.420069] systemd[1]: Starting Load Kernel Module fuse...686gitlab # [ 7.420660] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67687gitlab # [ 7.433038] systemd[1]: Starting Journal Service...688gitlab # [ 7.439760] systemd[1]: Starting Load Kernel Modules...689gitlab # [ 7.447078] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer...690gitlab # [ 7.447147] fuse: init (API version 7.45)691gitlab # [ 7.454263] systemd[1]: Starting Remount Root and Kernel File Systems...692gitlab # [ 7.457449] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os693gitlab # [ 7.465279] systemd[1]: Starting Coldplug All udev Devices...694gitlab # [ 7.476568] systemd[1]: Listening on Journal Log Access Socket.695gitlab # [ 7.479890] systemd[1]: Mounted Huge Pages File System.696gitlab # [ 7.482244] systemd[1]: Mounted POSIX Message Queue File System.697gitlab # [ 7.485414] systemd[1]: Mounted Kernel Debug File System.698gitlab # [ 7.487868] systemd[1]: Mounted Kernel Trace File System.699gitlab # [ 7.491877] systemd[1]: Finished Create List of Static Device Nodes.700gitlab # [ 7.494185] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.701gitlab # [ 7.495235] systemd[1]: Finished Load Kernel Module 9pnet_virtio.702gitlab # [ 7.495996] systemd[1]: Mounted Kernel Configuration File System.703gitlab # [ 7.496137] systemd-journald[316]: Collecting audit messages is enabled.704gitlab # [ 7.496896] systemd[1]: modprobe@fuse.service: Deactivated successfully.705gitlab # [ 7.497763] systemd[1]: Finished Load Kernel Module fuse.706gitlab # [ 7.498241] EXT4-fs (vda): re-mounted 41ce0185-ab09-4ebe-bee9-0467739af6be.707gitlab # [ 7.499150] systemd[1]: Finished Load Kernel Modules.708gitlab # [ 7.508524] systemd[1]: Mounting FUSE Control File System...709gitlab # [ 7.529388] systemd[1]: Starting Firewall...710gitlab # [ 7.528651] systemd[1]: Queued start job for default target Multi-User System.711gitlab # [ 7.536569] systemd[1]: Unnecessary job was removed for /dev/vdb.712gitlab # [ 7.538540] systemd[1]: systemd-journald.service: Deactivated successfully.713gitlab # [ 7.543138] systemd[1]: Starting Apply Kernel Variables...714gitlab # [ 7.540732] systemd-modules-load[317]: Using 3 probe threads715gitlab # [ 7.543056] systemd-modules-load[317]: Module 'atkbd' is built in716gitlab # [ 7.545759] systemd-modules-load[317]: Module 'loop' is built in[ 7.549127] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...717gitlab # 718gitlab # [ 7.549824] systemd-modules-load[317]: Inserted module 'tls'719gitlab # [ 7.554060] systemd[1]: Started Journal Service.720gitlab # [ 7.552070] systemd-oomd[318]: No swap; memory pressure usage will be degraded721gitlab # [ 7.556054] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer.722gitlab # [ 7.557922] systemd[1]: Finished Remount Root and Kernel File Systems.723gitlab # [ 7.559722] systemd[1]: Mounted FUSE Control File System.724gitlab # [ 7.569076] systemd[1]: Listening on Disk Image Download Service Socket.725gitlab # [ 7.576561] systemd[1]: Starting Flush Journal to Persistent Storage...726gitlab # [ 7.578300] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore727gitlab # [ 7.584617] systemd[1]: Starting Load/Save OS Random Seed...728gitlab # [ 7.586358] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os729gitlab # [ 7.595406] systemd-journald[316]: Received client request to flush runtime journal.730gitlab # [ 7.622995] systemd[1]: Finished Apply Kernel Variables.731gitlab # [ 7.625489] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.732gitlab # [ 7.627897] systemd[1]: Starting Create Static Device Nodes in /dev...733gitlab # [ 7.629150] systemd[1]: Finished Load/Save OS Random Seed.734gitlab # [ 7.630110] systemd[1]: Reached target First Boot Complete.735gitlab # [ 7.631157] systemd[1]: Finished Flush Journal to Persistent Storage.736gitlab # [ 7.632211] systemd[1]: Finished Create Static Device Nodes in /dev.737gitlab # [ 7.634072] systemd[1]: Reached target Preparation for Local File Systems.738gitlab # [ 7.635577] systemd[1]: Starting Rule-based Manager for Device Events and Files...739gitlab # [ 7.709141] systemd-udevd[364]: Using default interface naming scheme 'v261'.740gitlab # [ 7.750895] systemd[1]: Started Rule-based Manager for Device Events and Files.741gitlab # [ 7.952134] systemd[1]: Finished Firewall.742gitlab # [ 8.109211] systemd[1]: Finished Coldplug All udev Devices.743gitlab # [ 8.188138] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs744gitlab # [ 8.252161] systemd[1]: Condition check resulted in /dev/hvc0 being skipped.745gitlab # [ 8.280412] systemd[1]: Condition check resulted in /dev/ttyAMA0 being skipped.746gitlab # [ 8.284368] systemd[1]: Mounting /run/wrappers...747gitlab # [ 8.312271] (udev-worker)[411]: Network interface NamePolicy= disabled on kernel command line.748gitlab # [ 8.333430] (udev-worker)[418]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.749gitlab # [ 8.337750] (udev-worker)[418]: Network interface NamePolicy= disabled on kernel command line.750gitlab # [ 8.340275] systemd[1]: Mounted /run/wrappers.751gitlab # [ 8.352156] systemd[1]: Reached target Local File Systems.752gitlab # [ 8.353657] systemd[1]: Listening on Boot Loader Control Service Socket.753gitlab # [ 8.357362] systemd[1]: Starting register-nix-paths.service...754gitlab # [ 8.361588] systemd[1]: Starting Create SUID/SGID Wrappers...755gitlab # [ 8.363459] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met.756gitlab # [ 8.378450] systemd[1]: Starting Save Transient machine-id to Disk...757gitlab # [ 8.380305] systemd[1]: Starting Create System Files and Directories...758gitlab # [ 8.395959] systemd[1]: Condition check resulted in Virtio network device being skipped.759gitlab # [ 8.400351] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore760gitlab # [ 8.406185] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met.761gitlab # [ 8.408695] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67762gitlab # [ 8.414340] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore763gitlab # [ 8.416627] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os764gitlab # [ 8.418358] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os765gitlab # [ 8.419910] systemd[1]: etc-machine\x2did.mount: Deactivated successfully.766gitlab # [ 8.423377] systemd[1]: Finished Save Transient machine-id to Disk.767gitlab # [ 8.436179] systemd[1]: Finished Create System Files and Directories.768gitlab # [ 8.438314] systemd[1]: Starting Rebuild Journal Catalog...769gitlab # [ 8.446009] mousedev: PS/2 mouse device common for all mice770gitlab # [ 8.445326] systemd[1]: Starting Record System Boot/Shutdown in UTMP...771gitlab # [ 8.470564] systemd[1]: Finished Record System Boot/Shutdown in UTMP.772gitlab # [ 8.492929] systemd[1]: Finished Rebuild Journal Catalog.773gitlab # [ 8.497951] systemd[1]: Starting Update is Completed...774gitlab # [ 8.524888] systemd[1]: Finished Update is Completed.775gitlab # [ 8.564494] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully.776gitlab # [ 8.565723] systemd[1]: Finished Create SUID/SGID Wrappers.777gitlab # [ 8.566733] systemd[1]: suid-sgid-wrappers.service: Consumed 137ms CPU time over 202ms wall clock time, 6.5M memory peak, 1.9M read from disk.778gitlab # [ 8.828310] systemd[1]: Finished register-nix-paths.service.779gitlab # [ 8.830126] systemd[1]: Reached target System Initialization.780gitlab # [ 8.831514] systemd[1]: Started Discard unused filesystem blocks once a week.781gitlab # [ 8.832901] systemd[1]: Started logrotate.timer.782gitlab # [ 8.834137] systemd[1]: Started Daily Cleanup of Temporary Directories.783gitlab # [ 8.835204] systemd[1]: Reached target Timer Units.784gitlab # [ 8.836524] systemd[1]: Listening on D-Bus System Message Bus Socket.785gitlab # [ 8.837525] systemd[1]: Listening on Nix Daemon Socket.786gitlab # [ 8.841221] systemd[1]: Starting nixbot CI service socket...787gitlab # [ 8.842189] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket.788gitlab # [ 8.845487] systemd[1]: Starting D-Bus System Message Bus...789gitlab # [ 8.846964] systemd[1]: Listening on nixbot CI service socket.790gitlab # [ 8.847861] systemd[1]: Reached target Socket Units.791gitlab # [ 8.881424] input: QEMU Virtio Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:09.0/virtio8/input/input3792gitlab # [ 8.883073] dbus-broker-launch[559]: Looking up NSS user entry for 'systemd-timesync'...793gitlab # [ 8.884444] dbus-broker-launch[559]: NSS returned no entry for 'systemd-timesync'794gitlab # [ 8.885470] dbus-broker-launch[559]: Invalid user-name in /nix/store/9zcyylhndlnizbwn48627991zr1jxg4p-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync"795gitlab # [ 8.891162] systemd[1]: Started D-Bus System Message Bus.796gitlab # [ 8.907802] dbus-broker-launch[559]: Ready797gitlab # [ 8.911089] systemd[1]: Reached target Basic System.798gitlab # [ 8.912291] systemd[1]: Started backdoor.service.799gitlab # [ 8.916326] systemd[1]: Starting gitlab-config.service...800gitlab # [ 8.932100] systemd[1]: Starting Import lastlog data into lastlog2 database...801gitlab # [ 8.939963] systemd[1]: Starting Logrotate configuration check...802gitlab # [ 8.950309] systemd[1]: Starting Name Service Cache Daemon (nsncd)...803gitlab # [ 8.955777] systemd[1]: Starting Post-Boot Actions...804gitlab # [ 8.957171] logrotate[566]: warning: logrotate in debug mode does nothing except printing debug messages! Consider using verbose mode (-v) instead if this is not what you want.805gitlab # [ 8.959297] logrotate[566]: reading config file /nix/store/22afkmbkaxyx50bj9lbkkpmz7pd69hsf-logrotate.conf806gitlab # connecting to host...807gitlab # [ 8.962977] logrotate[566]: note: 'monthly' overrides previously specified 'weekly'808gitlab # [ 8.964288] logrotate[566]: Reading state from file: /var/lib/logrotate.status809gitlab # [ 8.965248] logrotate[566]: state file /var/lib/logrotate.status does not exist810gitlab # [ 8.968728] logrotate[566]: Allocating hash table for state file, size 64 entries811gitlab # [ 8.969743] logrotate[566]: Handling 4 logs812gitlab # [ 8.970369] logrotate[566]: rotating pattern: "/var/log/btmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed813gitlab # [ 8.973127] logrotate[566]: considering log /var/log/btmp814gitlab # [ 8.973902] logrotate[566]: Creating new state815gitlab # [ 8.975469] logrotate[566]: Now: 2026-08-17 07:18816gitlab # [ 8.979537] logrotate[566]: Last rotated at 2026-08-17 07:00817gitlab: Guest shell says: b'Spawning backdoor root shell...\n'818gitlab # [ 8.980512] logrotate[566]: log does not need rotating (log has already been rotated)819gitlab # [ 8.981554] logrotate[566]: rotating pattern: "/var/log/wtmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed820gitlab # [ 8.983712] logrotate[566]: considering log /var/log/wtmp821gitlab: connected to guest root shell822gitlab # [ 8.987067] logrotate[566]: Creating new state823gitlab: (connecting took 9.43 seconds)824gitlab # [ 8.987661] logrotate[566]: Now: 2026-08-17 07:18825gitlab: (finished: waiting for the VM to finish booting, in 9.43 seconds)826gitlab # [ 8.988369] logrotate[566]: Last rotated at 2026-08-17 07:00827gitlab # [ 8.989099] logrotate[566]: log does not need rotating (log has already been rotated)828gitlab # [ 8.990091] logrotate[566]: rotating pattern: "/var/gitlab/state/log/*.log" after 1 days empty log files are not rotated, (30 rotations), old logs are removed829gitlab # [ 8.991836] logrotate[566]: switching euid from 0 to 165 and egid from 0 to 165 (pid 566)830gitlab # [ 8.996418] logrotate[566]: considering log /var/gitlab/state/log/*.log831gitlab # [ 8.999549] logrotate[566]: log /var/gitlab/state/log/*.log does not exist -- skipping832gitlab # [ 9.002852] logrotate[566]: Creating new state833gitlab # [ 9.003561] logrotate[566]: switching euid from 165 to 0 and egid from 165 to 0 (pid 566)834gitlab # [ 9.004771] logrotate[566]: rotating pattern: "/var/log/nginx/*.log" weekly empty log files are not rotated, (26 rotations), old logs are removed835gitlab # [ 9.006511] logrotate[566]: switching euid from 0 to 60 and egid from 0 to 60 (pid 566)836gitlab # [ 9.007585] logrotate[566]: considering log /var/log/nginx/*.log837gitlab # [ 9.009356] logrotate[566]: log /var/log/nginx/*.log does not exist -- skipping838gitlab # [ 9.010364] logrotate[566]: Creating new state839gitlab # [ 9.010992] logrotate[566]: not running postrotate script, since no logs were rotated840gitlab # [ 9.013845] logrotate[566]: switching euid from 60 to 0 and egid from 60 to 0 (pid 566)841gitlab # [ 9.014946] systemd[1]: Started Reset console on configuration changes.842gitlab # [ 9.016390] nsncd[570]: Aug 17 07:18:19.765 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"843gitlab # [ 9.019378] systemd[1]: Starting resolvconf update...844gitlab # [ 9.021380] systemd[1]: Finished Logrotate configuration check.845gitlab # [ 9.022746] systemd[1]: Started Name Service Cache Daemon (nsncd).846gitlab # [ 9.024275] systemd[1]: Finished Post-Boot Actions.847gitlab # [ 9.025186] systemd[1]: Finished Import lastlog data into lastlog2 database.848gitlab # [ 9.027111] systemd[1]: Reached target Host and Network Name Lookups.849gitlab # [ 9.028365] systemd[1]: Reached target User and Group Name Lookups.850gitlab # [ 9.029219] systemd[1]: Starting User Login Management...851gitlab # [ 9.064857] systemd[1]: Stopped target Host and Network Name Lookups.852gitlab # [ 9.067171] systemd[1]: Stopping Host and Network Name Lookups...853gitlab # [ 9.069420] systemd[1]: Stopped target User and Group Name Lookups.854gitlab # [ 9.070430] systemd[1]: Stopping User and Group Name Lookups...855gitlab # [ 9.071258] systemd[1]: Stopping Name Service Cache Daemon (nsncd)...856gitlab # [ 9.073223] systemd[1]: Starting Virtual Console Setup...857gitlab # [ 9.074573] systemd[1]: nscd.service: Deactivated successfully.858gitlab # [ 9.075886] systemd[1]: Stopped Name Service Cache Daemon (nsncd).859gitlab # [ 9.078380] systemd[1]: nscd.service: Consumed 25ms CPU time over 127ms wall clock time, 7.4M memory peak, 5.8M read from disk.860gitlab # [ 9.103538] systemd[1]: Starting Name Service Cache Daemon (nsncd)...861gitlab # [ 9.107855] systemd-logind[608]: New seat seat0.862gitlab # [ 9.113805] systemd-logind[608]: Watching system buttons on /dev/input/event1 (QEMU QEMU USB Keyboard)863gitlab # [ 9.118125] systemd-logind[608]: Watching system buttons on /dev/input/event0 (gpio-keys)864gitlab # [ 9.119668] systemd[1]: Started User Login Management.865gitlab # [ 9.124373] systemd[1]: Starting linger-users.service...866gitlab # [ 9.125368] systemd[1]: Finished resolvconf update.867gitlab # [ 9.126088] systemd[1]: Reached target Preparation for Network.868gitlab # [ 9.127221] nsncd[664]: Aug 17 07:18:19.900 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"869gitlab # [ 9.134491] systemd[1]: Starting DHCP Client...870gitlab # [ 9.142548] systemd[1]: Starting Address configuration of eth1...871gitlab # [ 9.147949] systemd[1]: Starting Extra networking commands....872gitlab # [ 9.153105] systemd[1]: Started Name Service Cache Daemon (nsncd).873gitlab # [ 9.154080] systemd[1]: linger-users.service: Deactivated successfully.874gitlab # [ 9.162183] systemd-vconsole-setup[654]: Configuration of first virtual console was skipped, ignoring remaining ones.875gitlab # [ 9.164601] systemd[1]: Finished linger-users.service.876gitlab # [ 9.167938] systemd[1]: Finished Virtual Console Setup.877gitlab # [ 9.173060] systemd-logind[608]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard)878gitlab # [ 9.174438] systemd[1]: Reached target Host and Network Name Lookups.879gitlab # [ 9.175337] systemd[1]: Reached target User and Group Name Lookups.880gitlab # [ 9.176307] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.881gitlab # [ 9.177397] systemd[1]: Stopped Virtual Console Setup.882gitlab # [ 9.178190] systemd[1]: systemd-vconsole-setup.service: Consumed 34ms CPU time over 101ms wall clock time, 3.2M memory peak, 1.1M read from disk.883gitlab # [ 9.181519] systemd[1]: Stopping Virtual Console Setup...884gitlab # [ 9.182377] systemd[1]: Starting Virtual Console Setup...885gitlab # [ 9.191843] network-addresses-eth1-start[688]: adding address 192.168.1.1/24... done886gitlab # [ 9.199076] network-addresses-eth1-start[688]: adding address 2001:db8:1::1/64... done887gitlab # [ 9.207812] systemd-vconsole-setup[695]: Configuration of first virtual console was skipped, ignoring remaining ones.888gitlab # [ 9.210388] systemd[1]: Finished Address configuration of eth1.889gitlab # [ 9.211596] systemd[1]: Finished Virtual Console Setup.890gitlab # [ 9.255919] systemd[1]: Finished Extra networking commands..891gitlab # [ 9.256949] systemd[1]: Reached target Network.892gitlab # [ 9.259377] systemd[1]: Starting gitlab-workhorse.service...893gitlab # [ 9.262277] systemd[1]: Starting Nginx Web Server...894gitlab # [ 9.265118] systemd[1]: Starting PostgreSQL Server...895gitlab # [ 9.271090] systemd[1]: Starting Redis Server - redis-gitlab...896gitlab # [ 9.274195] dhcpcd[717]: dhcpcd-10.3.2 starting897gitlab # [ 9.276235] dhcpcd[763]: dev: loaded udev898gitlab # [ 9.276913] systemd[1]: Starting Permit User Sessions...899gitlab # [ 9.290675] 8021q: 802.1Q VLAN Support v1.8900gitlab # [ 9.291210] 8021q: adding VLAN 0 to HW filter on device eth1901gitlab # [ 9.309797] systemd[1]: Finished Permit User Sessions.902gitlab # [ 9.312256] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.903gitlab # [ 9.315736] systemd[1]: Started Getty on tty1.904gitlab # [ 9.317878] systemd[1]: Reached target Login Prompts.905gitlab # [ 9.334508] cfg80211: Loading compiled-in X.509 certificates for regulatory database906gitlab # [ 9.344600] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7'907gitlab # [ 9.345108] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600'908gitlab # [ 9.346885] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2909gitlab # [ 9.348857] cfg80211: failed to load regulatory.db910gitlab # [ 9.391933] 8021q: adding VLAN 0 to HW filter on device eth0911gitlab # [ 9.389698] dhcpcd[763]: eth0: waiting for carrier912gitlab # [ 9.394428] dhcpcd[763]: eth0: carrier acquired913gitlab # [ 9.400703] dhcpcd[763]: DUID 00:01:00:01:32:15:72:3c:52:54:00:12:34:56914gitlab # [ 9.401838] dhcpcd[763]: eth0: IAID 00:12:34:56915gitlab # [ 9.402502] dhcpcd[763]: eth0: adding address fe80::5054:ff:fe12:3456916gitlab # [ 9.429501] nginx-pre-start[789]: nginx: the configuration file /nix/store/ybdwy2xmslvjmdkxgrrhy1x5rwh45z0q-nginx.conf syntax is ok917gitlab # [ 9.431455] nginx-pre-start[789]: nginx: configuration file /nix/store/ybdwy2xmslvjmdkxgrrhy1x5rwh45z0q-nginx.conf test is successful918gitlab # [ 9.436441] systemd[1]: Started Nginx Web Server.919gitlab # [ 9.469098] postgresql-pre-start[792]: The files belonging to this database system will be owned by user "postgres".920gitlab # [ 9.471867] postgresql-pre-start[792]: This user must also own the server process.921gitlab # [ 9.474315] redis-server[786]: Supervised by systemd. Please make sure you set appropriate values for TimeoutStartSec and TimeoutStopSec in your service unit.922gitlab # [ 9.478538] redis-server[786]: oO0OoO0OoO0Oo Redis is starting oO0OoO0OoO0Oo923gitlab # [ 9.479756] postgresql-pre-start[792]: The database cluster will be initialized with locale "en_US.UTF-8".924gitlab # [ 9.481159] postgresql-pre-start[792]: The default database encoding has accordingly been set to "UTF8".925gitlab # [ 9.482548] postgresql-pre-start[792]: The default text search configuration will be set to "english".926gitlab # [ 9.483874] postgresql-pre-start[792]: Data page checksums are enabled.927gitlab # [ 9.488128] postgresql-pre-start[792]: fixing permissions on existing directory /var/lib/postgresql/18 ... ok928gitlab # [ 9.489865] postgresql-pre-start[792]: creating subdirectories ... ok929gitlab # [ 9.490912] postgresql-pre-start[792]: selecting dynamic shared memory implementation ... posix930gitlab # [ 9.492243] systemd[1]: Started Redis Server - redis-gitlab.931gitlab # [ 9.493134] redis-server[786]: Redis version=8.8.1, bits=64, commit=00000000, modified=0, pid=786, just started932gitlab # [ 9.494752] redis-server[786]: Configuration loaded933gitlab # [ 9.495621] redis[786]: monotonic clock: ARM CNTVCT @ 1000 ticks/us934gitlab # [ 9.496722] redis[786]: Running mode=standalone, port=0.935gitlab # [ 9.497744] redis[786]: Server initialized936gitlab # [ 9.498675] redis[786]: Ready to accept connections unix937gitlab # [ 9.499687] redis[786]: WARNING: Redis does not require authentication. Redis will accept connections from any local client.938gitlab # [ 9.524489] postgresql-pre-start[792]: selecting default "max_connections" ... 100939gitlab # [ 9.584439] postgresql-pre-start[792]: selecting default "shared_buffers" ... 128MB940gitlab # [ 9.931244] systemd[1]: Started gitlab-workhorse.service.941gitlab # [ 10.020102] postgresql-pre-start[792]: selecting default time zone ... UTC942gitlab # [ 10.023613] postgresql-pre-start[792]: creating configuration files ... ok943gitlab # [ 10.105728] dhcpcd[763]: eth0: soliciting a DHCP lease944gitlab # [ 10.122329] dhcpcd[763]: eth0: offered 10.0.2.15 from 10.0.2.2945gitlab # [ 10.136466] dhcpcd[763]: eth0: probing address 10.0.2.15/24946gitlab # [ 10.168992] gitlab-workhorse[819]: time="2026-08-17T07:18:20Z" level=info msg=Starting build_time=19700101.000000 version=19.0.4947gitlab # [ 10.171141] gitlab-workhorse[819]: time="2026-08-17T07:18:20Z" level=info msg="Using redis/go-redis"948gitlab # [ 10.173042] gitlab-workhorse[819]: time="2026-08-17T07:18:20Z" level=info msg="Running upstream server" address=/run/gitlab/gitlab-workhorse.socket network=unix949gitlab # [ 10.281722] postgresql-pre-start[792]: running bootstrap script ... ok950gitlab # [ 10.942830] postgresql-pre-start[792]: performing post-bootstrap initialization ... ok951gitlab # [ 11.217894] postgresql-pre-start[792]: syncing data to disk ... ok952gitlab # [ 11.219922] postgresql-pre-start[792]: initdb: warning: enabling "trust" authentication for local connections953gitlab # [ 11.223159] postgresql-pre-start[792]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb.954gitlab # [ 11.227948] postgresql-pre-start[792]: Success. You can now start the database server using:955gitlab # [ 11.230404] postgresql-pre-start[792]: pg_ctl -D /var/lib/postgresql/18 -l logfile start956gitlab # [ 11.381131] postgres[852]: [852] LOG: starting PostgreSQL 18.4 on aarch64-unknown-linux-gnu, compiled by clang version 21.1.8, 64-bit957gitlab # [ 11.386825] postgres[852]: [852] LOG: listening on IPv6 address "::1", port 5432958gitlab # [ 11.390487] postgres[852]: [852] LOG: listening on IPv4 address "127.0.0.1", port 5432959gitlab # [ 11.395055] postgres[852]: [852] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432"960gitlab # [ 11.400907] postgres[862]: [862] LOG: database system was shut down at 2026-08-17 07:18:21 GMT961gitlab # [ 11.405476] postgres[852]: [852] LOG: database system is ready to accept connections962gitlab # [ 11.410914] systemd[1]: Started PostgreSQL Server.963gitlab # [ 11.415728] systemd[1]: Starting PostgreSQL Setup Scripts...964gitlab # [ 11.493869] dhcpcd[763]: eth0: soliciting an IPv6 router965gitlab # [ 11.497597] dhcpcd[763]: eth0: Router Advertisement from fe80::2966gitlab # [ 11.500315] dhcpcd[763]: eth0: adding address fec0::5054:ff:fe12:3456/64967gitlab # [ 11.503148] dhcpcd[763]: eth0: adding route to fec0::/64968gitlab # [ 11.505546] dhcpcd[763]: eth0: adding default route via fe80::2969gitlab # [ 11.836708] postgresql-setup-start[873]: CREATE DATABASE970gitlab # [ 11.882857] postgresql-setup-start[883]: CREATE ROLE971gitlab # [ 11.902401] postgresql-setup-start[885]: ALTER DATABASE972gitlab # [ 11.954372] postgresql-setup-start[890]: CREATE ROLE973gitlab # [ 11.959072] systemd[1]: Finished PostgreSQL Setup Scripts.974gitlab # [ 11.961218] systemd[1]: Reached target PostgreSQL.975gitlab # [ 11.966606] systemd[1]: Starting gitlab-postgresql.service...976gitlab # [ 12.060135] kmklqy2bdnfisygngf3cnp8jwzlh0j09-gitlab-config[878]: mkdir -p /var/gitlab/state/home/.ssh: OK977gitlab # [ 12.064336] kmklqy2bdnfisygngf3cnp8jwzlh0j09-gitlab-config[878]: chmod 700 /var/gitlab/state/home/.ssh: OK978gitlab # [ 12.173107] gitlab-postgresql-start[898]: CREATE DATABASE979gitlab # [ 12.175685] systemd[1]: Finished gitlab-config.service.980gitlab # [ 12.180390] systemd[1]: Started gitaly.service.981gitlab # [ 12.185448] systemd[1]: Starting gitlab-db-config.service...982gitlab # [ 12.252082] gitlab-postgresql-start[916]: CREATE EXTENSION983gitlab # [ 12.397420] gitlab-postgresql-start[923]: CREATE EXTENSION984gitlab # [ 12.402858] systemd[1]: Finished gitlab-postgresql.service.985gitlab # [ 12.779083] gitaly[913]: time="2026-08-17T07:18:23.552Z" level=warning msg="The current configurations will cause Gitaly to fail to start up in future versions. Please run 'gitaly configuration validate < /nix/store/0r0qd84zrxhqq373hk9spv8j9pg0qlnq-gitaly.toml' and fix the errors that are printed." pid=913986gitlab # [ 12.795936] gitaly[913]: time="2026-08-17T07:18:23.553Z" level=info msg="maxprocs: Leaving GOMAXPROCS=4: CPU quota undefined" pid=913987gitlab # [ 12.799200] gitaly[913]: time="2026-08-17T07:18:23.553Z" level=info msg="grpc prometheus histograms enabled" latencies="[0.001 0.005 0.025 0.1 0.5 1 10 30 60 300 1500]" pid=913988gitlab # [ 12.803130] gitaly[913]: time="2026-08-17T07:18:23.553Z" level=error msg="error initializing distributed tracing" error="tracing is disabled" pid=913989gitlab # [ 12.806621] gitaly[913]: time="2026-08-17T07:18:23.553Z" level=info msg="Starting Gitaly" pid=913 version=990gitlab # [ 12.987823] gitaly[913]: time="2026-08-17T07:18:23.762Z" level=info msg="finished unpacking auxiliary binaries" duration_ms=208 pid=913991gitlab # [ 12.989810] gitaly[913]: time="2026-08-17T07:18:23.762Z" level=info msg="finished initializing bootstrap" duration_ms=0 pid=913992gitlab # [ 12.991312] gitaly[913]: time="2026-08-17T07:18:23.762Z" level=info msg="finished initializing command factory" duration_ms=0 pid=913993gitlab # [ 12.992938] gitaly[913]: time="2026-08-17T07:18:23.762Z" level=info msg="using Git binary" binary_path=/run/gitaly/gitaly-913/git-exec-3959247271.d/git pid=913994gitlab # [ 12.994965] gitaly[913]: time="2026-08-17T07:18:23.769Z" level=info msg="finished detecting git version" duration_ms=6 pid=913995gitlab # [ 12.996575] gitaly[913]: time="2026-08-17T07:18:23.771Z" level=info msg="using Git version" pid=913 version=2.53.g996gitlab # [ 12.998535] gitaly[913]: time="2026-08-17T07:18:23.772Z" level=info msg="clearing disk cache object folder" pid=913 storage=default997gitlab # [ 13.000133] gitaly[913]: time="2026-08-17T07:18:23.773Z" level=info msg="moving disk cache object folder" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache1518521141 pid=913 storage=default998gitlab # [ 13.002424] gitaly[913]: time="2026-08-17T07:18:23.773Z" level=info msg="disk cache object folder doesn't exist, no need to remove" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache1518521141 pid=913 storage=default999gitlab # [ 13.005123] gitaly[913]: time="2026-08-17T07:18:23.774Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/cache path=/var/gitlab/state/repositories/+gitaly/cache pid=9131000gitlab # [ 13.007533] gitaly[913]: time="2026-08-17T07:18:23.774Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/state path=/var/gitlab/state/repositories/+gitaly/state pid=9131001gitlab # [ 13.010221] gitaly[913]: time="2026-08-17T07:18:23.774Z" level=info msg="cleared all cache object files" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache1518521141 clear_duration_ms=0 pid=913 storage=default1002gitlab # [ 13.015234] gitaly[913]: time="2026-08-17T07:18:23.789Z" level=warning msg="Unable to set SO_REUSEPORT: zero downtime upgrades will not work" error="operation not supported" pid=9131003gitlab # [ 13.018199] gitaly[913]: time="2026-08-17T07:18:23.792Z" level=info msg="finished tempdir cleaner walk" pid=913 storage=default time_ms=01004gitlab # [ 13.021279] gitaly[913]: time="2026-08-17T07:18:23.792Z" level=info msg="counting repositories" pid=9131005gitlab # [ 13.022571] gitaly[913]: time="2026-08-17T07:18:23.792Z" level=info msg="starting to count repositories" pid=913 storage_path=/var/gitlab/state/repositories1006gitlab # [ 13.024412] gitaly[913]: time="2026-08-17T07:18:23.792Z" level=info msg="listening at address" address=/var/gitlab/state/tmp/sockets/gitaly.socket pid=913 schema=unix1007gitlab # [ 13.026286] gitaly[913]: time="2026-08-17T07:18:23.792Z" level=info msg="completed counting repositories" counting_duration_ms=0 pid=913 storage_path=/var/gitlab/state/repositories1008gitlab # [ 13.028380] gitaly[913]: time="2026-08-17T07:18:23.792Z" level=info msg="completed counting all repositories" counting_duration=0 pid=9131009gitlab # [ 13.029954] gitaly[913]: time="2026-08-17T07:18:23.792Z" level=info msg="listening at address" address=/run/gitaly/gitaly-913/sock.d/intern pid=913 schema=unix1010gitlab # [ 13.031812] gitaly[913]: time="2026-08-17T07:18:23.795Z" level=info msg="starting prometheus listener" address="localhost:9236" pid=9131011gitlab # [ 13.033689] gitaly[913]: time="2026-08-17T07:18:23.795Z" level=info msg="Started Gitaly" duration_ms=241 pid=9131012gitlab # [ 13.035012] gitaly[913]: time="2026-08-17T07:18:23.795Z" level=info msg="Gitaly graceful stop timeout duration" duration_s=1m0s pid=9131013gitlab # [ 13.036624] gitaly[913]: time="2026-08-17T07:18:23.795Z" level=info msg="maintenance: daily scheduled" pid=913 scheduled="2026-08-17 12:00:00 +0000 UTC"1014gitlab # [ 13.524197] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[919]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1015gitlab # [ 13.528276] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[919]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1016gitlab # [ 13.546517] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[919]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1017gitlab # [ 14.507712] dhcpcd[763]: eth0: leased 10.0.2.15 for 86400 seconds1018gitlab # [ 14.510906] dhcpcd[763]: eth0: adding route to 10.0.2.0/241019gitlab # [ 14.513112] dhcpcd[763]: eth0: adding default route via 10.0.2.21020gitlab # [ 14.693161] systemd[1]: Started DHCP Client.1021gitlab # [ 14.695169] systemd[1]: Reached target Network is Online.1022gitlab # [ 16.758669] gitaly[913]: time="2026-08-17T07:18:27.532Z" level=info msg="License database preloaded" duration_ms=3978 pid=9131023gitlab # [ 58.219848] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[919]: W, [2026-08-17T07:19:08.992899 #919] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1024gitlab # [ 60.241697] gitlab-workhorse[819]: time="2026-08-17T07:19:11Z" level=error correlation_id= duration_ms=1 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1025gitlab # [ 61.167858] postgres[1429]: [1429] ERROR: relation "feature_gates" does not exist at character 5231026gitlab # [ 61.168321] postgres[1429]: [1429] STATEMENT: SELECT a.attname, format_type(a.atttypid, a.atttypmod),1027gitlab # [ 61.168448] postgres[1429]: pg_get_expr(d.adbin, d.adrelid), a.attnotnull, a.atttypid, a.atttypmod,1028gitlab # [ 61.168563] postgres[1429]: c.collname, col_description(a.attrelid, a.attnum) AS comment,1029gitlab # [ 61.168702] postgres[1429]: attidentity AS identity,1030gitlab # [ 61.168828] postgres[1429]: attgenerated as attgenerated1031gitlab # [ 61.168950] postgres[1429]: FROM pg_attribute a1032gitlab # [ 61.169068] postgres[1429]: LEFT JOIN pg_attrdef d ON a.attrelid = d.adrelid AND a.attnum = d.adnum1033gitlab # [ 61.169186] postgres[1429]: LEFT JOIN pg_type t ON a.atttypid = t.oid1034gitlab # [ 61.169325] postgres[1429]: LEFT JOIN pg_collation c ON a.attcollation = c.oid AND a.attcollation <> t.typcollation1035gitlab # [ 61.169443] postgres[1429]: WHERE a.attrelid = '"feature_gates"'::regclass1036gitlab # [ 61.169559] postgres[1429]: AND a.attnum > 0 AND NOT a.attisdropped1037gitlab # [ 61.169658] postgres[1429]: ORDER BY a.attnum1038gitlab # [ 61.169772] postgres[1429]:1039gitlab # [ 66.190935] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[1480]: psql:/var/gitlab/state/db/structure.sql:9: NOTICE: extension "btree_gist" already exists, skipping1040gitlab # [ 66.191355] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[1480]: psql:/var/gitlab/state/db/structure.sql:11: NOTICE: extension "pg_trgm" already exists, skipping1041gitlab # [ 70.250141] gitlab-workhorse[819]: time="2026-08-17T07:19:21Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1042gitlab # [ 80.258915] gitlab-workhorse[819]: time="2026-08-17T07:19:31Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1043gitlab # [ 90.259377] gitlab-workhorse[819]: time="2026-08-17T07:19:41Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1044gitlab # [ 91.902864] postgres[1574]: [1574] ERROR: relation "table_without_models" does not exist1045gitlab # [ 91.903221] postgres[1574]: [1574] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1046gitlab # [ 100.266970] gitlab-workhorse[819]: time="2026-08-17T07:19:51Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1047gitlab # [ 110.277237] gitlab-workhorse[819]: time="2026-08-17T07:20:01Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1048gitlab # [ 120.287328] gitlab-workhorse[819]: time="2026-08-17T07:20:11Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1049gitlab # [ 121.317807] systemd[1]: Finished gitlab-db-config.service.1050gitlab # [ 121.324660] systemd[1]: Started gitlab-sidekiq.service.1051gitlab # [ 121.329976] systemd[1]: Starting gitlab.service...1052gitlab # [ 121.864433] bundle[1949]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1053gitlab # [ 121.867275] bundle[1949]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1054gitlab # [ 121.873603] bundle[1949]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1055gitlab # [ 126.345016] sidekiq-cluster[1948]: {"severity":"INFO","time":"2026-08-17T07:20:17.091Z","message":"Starting cluster with 1 processes"}1056gitlab # [ 126.406240] bundle[1949]: {"timestamp":"2026-08-17T07:20:17.152Z","pid":1949,"message":"* Enabling systemd notification integration"}1057gitlab # [ 126.411273] bundle[1949]: {"timestamp":"2026-08-17T07:20:17.179Z","pid":1949,"message":"Puma starting in cluster mode..."}1058gitlab # [ 126.415798] bundle[1949]: {"timestamp":"2026-08-17T07:20:17.179Z","pid":1949,"message":"* Puma version: 8.0.1 (\"Into the Arena\")"}1059gitlab # [ 126.420662] bundle[1949]: {"timestamp":"2026-08-17T07:20:17.179Z","pid":1949,"message":"* Ruby version: ruby 3.3.10 (2025-10-23 revision 343ea05002) [aarch64-linux]"}1060gitlab # [ 126.426973] bundle[1949]: {"timestamp":"2026-08-17T07:20:17.179Z","pid":1949,"message":"* Min threads: 0"}1061gitlab # [ 126.431118] bundle[1949]: {"timestamp":"2026-08-17T07:20:17.179Z","pid":1949,"message":"* Max threads: 4"}1062gitlab # [ 126.435149] bundle[1949]: {"timestamp":"2026-08-17T07:20:17.179Z","pid":1949,"message":"* Environment: production"}1063gitlab # [ 126.439435] bundle[1949]: {"timestamp":"2026-08-17T07:20:17.179Z","pid":1949,"message":"* Master PID: 1949"}1064gitlab # [ 126.443555] bundle[1949]: {"timestamp":"2026-08-17T07:20:17.179Z","pid":1949,"message":"* Workers: 2"}1065gitlab # [ 126.447525] bundle[1949]: {"timestamp":"2026-08-17T07:20:17.180Z","pid":1949,"message":"* Restarts: (✔) hot (✖) phased (✖) refork"}1066gitlab # [ 126.452632] bundle[1949]: {"timestamp":"2026-08-17T07:20:17.180Z","pid":1949,"message":"* Preloading application"}1067gitlab # [ 130.293258] gitlab-workhorse[819]: time="2026-08-17T07:20:21Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1068gitlab # [ 140.295896] gitlab-workhorse[819]: time="2026-08-17T07:20:31Z" level=error correlation_id= duration_ms=1 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1069gitlab # [ 150.306643] gitlab-workhorse[819]: time="2026-08-17T07:20:41Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1070gitlab # [ 160.314244] gitlab-workhorse[819]: time="2026-08-17T07:20:51Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1071gitlab # [ 163.860568] bundle[1949]: W, [2026-08-17T07:20:54.633793 #1949] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1072gitlab # [ 167.695133] sidekiq-cluster[1997]: 2026-08-17T07:20:58.468Z pid=1997 tid=wo5 INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>1997, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>425967616}1073gitlab # [ 167.997263] sidekiq-cluster[1997]: W, [2026-08-17T07:20:58.771504 #1997] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1074gitlab # [ 168.140254] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:20:58.914Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"}1075gitlab # [ 170.324468] gitlab-workhorse[819]: time="2026-08-17T07:21:01Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1076gitlab # [ 171.440161] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:21:02.213Z","message":"GitLab reliable fetch activated!"}1077gitlab # [ 171.440538] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:21:02.213Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1078gitlab # [ 171.472535] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:21:02.246Z","message":"Cron Jobs - added job with name bbo_users_delete_unconfirmed_secondary in the namespace default"}1079gitlab # [ 171.482618] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:21:02.257Z","message":"Cron Jobs - added job with name background_operation_environments_auto_delete in the namespace default"}1080gitlab # [ 171.493698] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:21:02.268Z","message":"Cron Jobs - added job with name adjourned_group_deletion_worker in the namespace default"}1081gitlab # [ 171.503440] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:21:02.277Z","message":"Cron Jobs - added job with name authn_data_retention_authentication_event_archive_worker in the namespace default"}1082gitlab # [ 171.511789] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:21:02.286Z","message":"Cron Jobs - added job with name delete_expired_trigger_token_worker in the namespace default"}1083gitlab # [ 171.518717] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:21:02.291Z","message":"Cron Jobs - added job with name adjourned_projects_deletion_cron_worker in the namespace default"}1084gitlab # [ 171.525493] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:21:02.296Z","message":"Cron Jobs - added job with name stuck_ci_jobs_worker in the namespace default"}1085gitlab # [ 171.531161] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:21:02.300Z","message":"Cron Jobs - added job with name drop_timed_out_worker in the namespace default"}1086gitlab # [ 171.536575] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:21:02.304Z","message":"Cron Jobs - added job with name pipeline_schedule_worker in the namespace default"}1087gitlab # [ 171.541350] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:21:02.309Z","message":"Cron Jobs - added job with name ci_schedule_bulk_delete_job_artifact_cron_worker in the namespace default"}1088gitlab # [ 171.546313] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:21:02.313Z","message":"Cron Jobs - added job with name update_locked_unknown_artifacts_worker in the namespace default"}1089gitlab # [ 171.550778] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:21:02.319Z","message":"Cron Jobs - added job with name ci_partitioning_worker in the namespace default"}1090gitlab # [ 171.554648] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:21:02.323Z","message":"Cron Jobs - added job with name ci_pipelines_expire_artifacts_worker in the namespace default"}1091gitlab # [ 171.558589] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:21:02.327Z","message":"Cron Jobs - added job with name ci_schedule_delete_objects_worker in the namespace default"}1092gitlab # [ 171.562222] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:21:02.330Z","message":"Cron Jobs - added job with name environments_auto_stop_cron_worker in the namespace default"}1093gitlab # [ 171.565680] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:21:02.333Z","message":"Cron Jobs - added job with name repository_check_worker in the namespace default"}1094gitlab # [ 171.568803] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:21:02.337Z","message":"Cron Jobs - added job with name admin_email_worker in the namespace default"}1095gitlab # [ 171.571687] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:21:02.340Z","message":"Cron Jobs - added job with name personal_access_tokens_expiring_worker in the namespace default"}1096gitlab # [ 171.574987] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:21:02.343Z","message":"Cron Jobs - added job with name deploy_tokens_expiring_worker in the namespace default"}1097gitlab # [ 171.578009] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:21:02.346Z","message":"Cron Jobs - added job with name personal_access_tokens_expired_notification_worker in the namespace default"}1098gitlab # [ 171.581173] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:21:02.349Z","message":"Cron Jobs - added job with name resource_access_tokens_inactive_tokens_deletion_cron_worker in the namespace default"}1099gitlab # [ 171.584301] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:21:02.352Z","message":"Cron Jobs - added job with name repository_archive_cache_worker in the namespace default"}1100gitlab # [ 171.586925] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:21:02.354Z","message":"Cron Jobs - added job with name import_export_project_cleanup_worker in the namespace default"}1101gitlab # [ 171.589700] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:21:02.357Z","message":"Cron Jobs - added job with name gitlab_import_import_file_cleanup_worker in the namespace default"}1102gitlab # [ 171.592371] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:21:02.360Z","message":"Cron Jobs - added job with name ci_archive_traces_cron_worker in the namespace default"}1103gitlab # [ 171.594777] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:21:02.363Z","message":"Cron Jobs - added job with name members_expiring_worker in the namespace default"}1104gitlab # [ 171.597178] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:21:02.366Z","message":"Cron Jobs - added job with name remove_expired_members_worker in the namespace default"}1105gitlab # [ 171.599454] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:21:02.369Z","message":"Cron Jobs - added job with name remove_expired_group_links_worker in the namespace default"}1106gitlab # [ 171.601860] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:21:02.372Z","message":"Cron Jobs - added job with name remove_unaccepted_member_invites_worker in the namespace default"}1107gitlab # [ 171.604173] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:21:02.375Z","message":"Cron Jobs - added job with name prune_old_events_worker in the namespace default"}1108gitlab # [ 171.606297] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:21:02.378Z","message":"Cron Jobs - added job with name gitlab_export_prune_project_export_jobs_worker in the namespace default"}1109gitlab # [ 171.608734] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:21:02.381Z","message":"Cron Jobs - added job with name trending_projects_worker in the namespace default"}1110gitlab # [ 171.610859] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:21:02.384Z","message":"Cron Jobs - added job with name remove_unreferenced_lfs_objects_worker in the namespace default"}1111gitlab # [ 171.613212] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:21:02.387Z","message":"Cron Jobs - added job with name bulk_imports_stale_import_worker in the namespace default"}1112gitlab # [ 171.616501] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:21:02.390Z","message":"Cron Jobs - added job with name import_stuck_project_import_jobs in the namespace default"}1113gitlab # [ 171.621381] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:21:02.395Z","message":"Cron Jobs - added job with name jira_import_stuck_jira_import_jobs in the namespace default"}1114gitlab # [ 171.627028] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:21:02.401Z","message":"Cron Jobs - added job with name stuck_export_jobs_worker in the namespace default"}1115gitlab # [ 171.632996] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:21:02.407Z","message":"Cron Jobs - added job with name gitlab_service_ping_worker in the namespace default"}1116gitlab # [ 171.640406] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:21:02.414Z","message":"Cron Jobs - added job with name stuck_merge_jobs_worker in the namespace default"}1117gitlab # [ 171.646316] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:21:02.417Z","message":"Cron Jobs - added job with name pages_domain_verification_cron_worker in the namespace default"}1118gitlab # [ 171.652596] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:21:02.421Z","message":"Cron Jobs - added job with name pages_domain_removal_cron_worker in the namespace default"}1119gitlab # [ 171.658188] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:21:02.423Z","message":"Cron Jobs - added job with name pages_domain_ssl_renewal_cron_worker in the namespace default"}1120gitlab # [ 171.663531] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:21:02.426Z","message":"Cron Jobs - added job with name issue_due_scheduler_worker in the namespace default"}1121gitlab # [ 171.668741] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:21:02.429Z","message":"Cron Jobs - added job with name schedule_migrate_external_diffs_worker in the namespace default"}1122gitlab # [ 171.673809] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:21:02.432Z","message":"Cron Jobs - added job with name namespaces_prune_aggregation_schedules_worker in the namespace default"}1123gitlab # [ 171.678707] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:21:02.435Z","message":"Cron Jobs - added job with name container_expiration_policy_worker in the namespace default"}1124gitlab # [ 171.683047] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:21:02.438Z","message":"Cron Jobs - added job with name cleanup_container_registry_worker in the namespace default"}1125gitlab # [ 171.687437] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:21:02.441Z","message":"Cron Jobs - added job with name image_ttl_group_policy_worker in the namespace default"}1126gitlab # [ 171.691466] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:21:02.444Z","message":"Cron Jobs - added job with name cleanup_dependency_proxy_worker in the namespace default"}1127gitlab # [ 171.695475] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:21:02.446Z","message":"Cron Jobs - added job with name cleanup_package_registry_worker in the namespace default"}1128gitlab # [ 171.699436] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:21:02.449Z","message":"Cron Jobs - added job with name x509_issuer_crl_check_worker in the namespace default"}1129gitlab # [ 171.703429] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:21:02.452Z","message":"Cron Jobs - added job with name users_create_statistics_worker in the namespace default"}1130gitlab # [ 171.707287] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:21:02.465Z","message":"Cron Jobs - added job with name authorized_project_update_periodic_recalculate_worker in the namespace default"}1131gitlab # [ 171.711415] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:21:02.468Z","message":"Cron Jobs - added job with name update_container_registry_info_worker in the namespace default"}1132gitlab # [ 171.715040] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:21:02.471Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_manager in the namespace default"}1133gitlab # [ 171.718460] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:21:02.473Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_dropper in the namespace default"}1134gitlab # [ 171.721660] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:21:02.476Z","message":"Cron Jobs - added job with name analytics_usage_trends_count_job_trigger_worker in the namespace default"}1135gitlab # [ 171.724890] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:21:02.479Z","message":"Cron Jobs - added job with name member_invitation_reminder_emails_worker in the namespace default"}1136gitlab # [ 171.727804] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:21:02.480Z","message":"Cron Jobs - added job with name schedule_merge_request_cleanup_refs_worker in the namespace default"}1137gitlab # [ 171.730882] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:21:02.483Z","message":"Cron Jobs - added job with name manage_evidence_worker in the namespace default"}1138gitlab # [ 171.733496] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:21:02.484Z","message":"Cron Jobs - added job with name publish_release_worker in the namespace default"}1139gitlab # [ 171.735927] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:21:02.486Z","message":"Cron Jobs - added job with name user_status_cleanup_batch_worker in the namespace default"}1140gitlab # [ 171.787327] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:21:02.560Z","message":"Cron Jobs - added job with name ssh_keys_expired_notification_worker in the namespace default"}1141gitlab # [ 171.792679] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:21:02.565Z","message":"Cron Jobs - added job with name ssh_keys_expiring_soon_notification_worker in the namespace default"}1142gitlab # [ 171.797996] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:21:02.569Z","message":"Cron Jobs - added job with name users_deactivate_dormant_users_worker in the namespace default"}1143gitlab # [ 171.803211] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:21:02.571Z","message":"Cron Jobs - added job with name ci_delete_unit_tests_worker in the namespace default"}1144gitlab # [ 171.808296] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:21:02.575Z","message":"Cron Jobs - added job with name batched_background_migrations_worker in the namespace default"}1145gitlab # [ 171.813371] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:21:02.577Z","message":"Cron Jobs - added job with name batched_background_migration_worker_ci_database in the namespace default"}1146gitlab # [ 171.818665] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:21:02.579Z","message":"Cron Jobs - added job with name batched_background_migration_worker_sec_database in the namespace default"}1147gitlab # [ 171.823655] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:21:02.581Z","message":"Cron Jobs - added job with name background_operations_worker_main_database in the namespace default"}1148gitlab # [ 171.829485] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:21:02.584Z","message":"Cron Jobs - added job with name background_operations_worker_ci_database in the namespace default"}1149gitlab # [ 171.833799] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:21:02.586Z","message":"Cron Jobs - added job with name background_operations_worker_sec_database in the namespace default"}1150gitlab # [ 171.838133] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:21:02.588Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_main_database in the namespace default"}1151gitlab # [ 171.842743] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:21:02.591Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_ci_database in the namespace default"}1152gitlab # [ 171.847351] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:21:02.593Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_sec_database in the namespace default"}1153gitlab # [ 171.851991] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:21:02.596Z","message":"Cron Jobs - added job with name issues_reschedule_stuck_issue_rebalances in the namespace default"}1154gitlab # [ 171.855896] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:21:02.598Z","message":"Cron Jobs - added job with name projects_schedule_refresh_build_artifacts_size_statistics_worker in the namespace default"}1155gitlab # [ 171.860305] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:21:02.600Z","message":"Cron Jobs - added job with name inactive_projects_deletion_cron_worker in the namespace default"}1156gitlab # [ 171.863796] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:21:02.603Z","message":"Cron Jobs - added job with name loose_foreign_keys_cleanup_worker in the namespace default"}1157gitlab # [ 171.867384] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:21:02.605Z","message":"Cron Jobs - added job with name loose_foreign_keys_ci_pipelines_builds_cleanup_worker in the namespace default"}1158gitlab # [ 171.871091] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:21:02.608Z","message":"Cron Jobs - added job with name loose_foreign_keys_merge_request_diff_commit_cleanup_worker in the namespace default"}1159gitlab # [ 171.874705] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:21:02.610Z","message":"Cron Jobs - added job with name batched_git_ref_updates_cleanup_scheduler_worker in the namespace default"}1160gitlab # [ 171.878012] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:21:02.613Z","message":"Cron Jobs - added job with name ci_runner_versions_reconciliation_worker in the namespace default"}1161gitlab # [ 171.881016] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:21:02.615Z","message":"Cron Jobs - added job with name users_migrate_records_to_ghost_user_in_batches_worker in the namespace default"}1162gitlab # [ 171.884005] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:21:02.618Z","message":"Cron Jobs - added job with name ci_runners_stale_machines_cleanup_worker in the namespace default"}1163gitlab # [ 171.886730] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:21:02.620Z","message":"Cron Jobs - added job with name packages_cleanup_delete_orphaned_dependencies_worker in the namespace default"}1164gitlab # [ 171.889702] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:21:02.624Z","message":"Cron Jobs - added job with name cleanup_dangling_debian_package_files_worker in the namespace default"}1165gitlab # [ 171.892391] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:21:02.626Z","message":"Cron Jobs - added job with name object_storage_delete_stale_direct_uploads_worker in the namespace default"}1166gitlab # [ 171.895006] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:21:02.628Z","message":"Cron Jobs - added job with name service_desk_custom_email_verification_cleanup in the namespace default"}1167gitlab # [ 171.897693] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:21:02.630Z","message":"Cron Jobs - added job with name deactivated_pages_deployments_delete_cron_worker in the namespace default"}1168gitlab # [ 171.900270] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:21:02.632Z","message":"Cron Jobs - added job with name ci_schedule_unlock_pipelines_in_queue_worker in the namespace default"}1169gitlab # [ 171.902620] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:21:02.634Z","message":"Cron Jobs - added job with name ci_catalog_resources_process_sync_events_worker in the namespace default"}1170gitlab # [ 171.905107] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:21:02.637Z","message":"Cron Jobs - added job with name namespaces_process_outdated_namespace_descendants_cron_worker in the namespace default"}1171gitlab # [ 171.907621] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:21:02.639Z","message":"Cron Jobs - added job with name performance_bar_stats in the namespace default"}1172gitlab # [ 171.909850] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:21:02.642Z","message":"Cron Jobs - added job with name ci_catalog_resources_aggregate_last30_day_usage_worker in the namespace default"}1173gitlab # [ 171.912299] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:21:02.645Z","message":"Cron Jobs - added job with name ci_catalog_resources_cleanup_last_usages_worker in the namespace default"}1174gitlab # [ 171.914598] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:21:02.648Z","message":"Cron Jobs - added job with name ci_click_house_finished_pipelines_sync_worker in the namespace default"}1175gitlab # [ 171.916975] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:21:02.650Z","message":"Cron Jobs - added job with name deactivate_expired_deployments_cron_worker in the namespace default"}1176gitlab # [ 171.919156] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:21:02.664Z","message":"Cron Jobs - added job with name database_monitor_locked_tables_cron_worker in the namespace default"}1177gitlab # [ 171.921467] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:21:02.666Z","message":"Cron Jobs - added job with name merge_requests_process_scheduled_merge in the namespace default"}1178gitlab # [ 171.923598] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:21:02.669Z","message":"Cron Jobs - added job with name ci_schedule_old_pipelines_removal_cron_worker in the namespace default"}1179gitlab # [ 171.925999] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:21:02.672Z","message":"Cron Jobs - added job with name version_version_check_cron in the namespace default"}1180gitlab # [ 171.928038] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:21:02.676Z","message":"Cron Jobs - added job with name import_placeholder_user_cleanup_worker in the namespace default"}1181gitlab # [ 171.930171] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:21:02.679Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_grant_archive_worker in the namespace default"}1182gitlab # [ 171.932503] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:21:02.682Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_token_archive_worker in the namespace default"}1183gitlab # [ 171.934779] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:21:02.684Z","message":"Cron Jobs - added job with name lost_transaction_recovery_worker in the namespace default"}1184gitlab # [ 171.936922] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:21:02.687Z","message":"Cron Jobs - added job with name topology_service_stale_requests_cleanup_worker in the namespace default"}1185gitlab # [ 171.939120] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:21:02.689Z","message":"Cron Jobs - added job with name cells_schedule_claims_verification_worker in the namespace default"}1186gitlab # [ 171.941416] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:21:02.692Z","message":"Cron Jobs - added job with name concurrency_limit_resume_worker in the namespace default"}1187gitlab # [ 180.342222] gitlab-workhorse[819]: time="2026-08-17T07:21:11Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1188gitlab # [ 190.351924] gitlab-workhorse[819]: time="2026-08-17T07:21:21Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1189gitlab # [ 200.351895] gitlab-workhorse[819]: time="2026-08-17T07:21:31Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1190gitlab # [ 210.336784] postgres[2708]: [2708] ERROR: relation "table_without_models" does not exist1191gitlab # [ 210.337170] postgres[2708]: [2708] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1192gitlab # [ 210.362815] gitlab-workhorse[819]: time="2026-08-17T07:21:41Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1193gitlab # [ 214.287662] postgres[2737]: [2737] ERROR: relation "table_without_models" does not exist1194gitlab # [ 214.288005] postgres[2737]: [2737] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1195gitlab # [ 215.286996] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:21:46.060Z","message":"Booted Rails 7.2.3.1 application in production environment"}1196gitlab # [ 215.293064] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:21:46.066Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [aarch64-linux]"}1197gitlab # [ 215.295103] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:21:46.067Z","message":"See LICENSE and the LGPL-3.0 for licensing details."}1198gitlab # [ 215.300402] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:21:46.067Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"}1199gitlab # [ 215.307677] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:21:46.073Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1200gitlab # [ 218.003530] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:21:48.777Z","message":"Cleaning working queues"}1201gitlab # [ 218.008850] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:21:48.782Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"bdd0e662c93070e3a4584c73","created_at":"2026-08-17T07:20:11.572Z","trace_propagation_headers":{"sentry-trace":"c32ae76dab804d2ab80cc3a0e420b68d-b9e23337c4254657","baggage":"sentry-trace_id=c32ae76dab804d2ab80cc3a0e420b68d,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"ff8d0b9927f5e60771a20c5e5cb79c9b","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-08-17T07:20:11.583Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-bdd0e662c93070e3a4584c73: start","job_status":"start","queue_duration_s":97.198419,"scheduling_latency_s":97.198546}1202gitlab # [ 218.428617] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:21:49.201Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"bdd0e662c93070e3a4584c73","created_at":"2026-08-17T07:20:11.572Z","trace_propagation_headers":{"sentry-trace":"c32ae76dab804d2ab80cc3a0e420b68d-b9e23337c4254657","baggage":"sentry-trace_id=c32ae76dab804d2ab80cc3a0e420b68d,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"ff8d0b9927f5e60771a20c5e5cb79c9b","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-08-17T07:20:11.583Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-bdd0e662c93070e3a4584c73: done: 0.419799 sec","job_status":"done","queue_duration_s":97.198419,"scheduling_latency_s":97.198546,"redis_calls":29,"redis_duration_s":0.025081,"redis_read_bytes":282,"redis_write_bytes":3632,"redis_feature_flag_calls":18,"redis_feature_flag_duration_s":0.01415,"redis_feature_flag_read_bytes":272,"redis_feature_flag_write_bytes":2385,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.005716,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":688,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.005215,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":559,"db_count":15,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.026,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.021,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.212154,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.20775948,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.419799,"completed_at":"2026-08-17T07:21:49.201Z","load_balancing_strategy":"primary","db_duration_s":0.107899,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1203gitlab # [ 220.363570] gitlab-workhorse[819]: time="2026-08-17T07:21:51Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1204gitlab # [ 221.404692] bundle[1949]: {"timestamp":"2026-08-17T07:21:52.177Z","pid":1949,"message":"* Listening on unix:///var/gitlab/state//tmp/sockets/gitlab.socket"}1205gitlab # [ 221.408396] bundle[1949]: {"timestamp":"2026-08-17T07:21:52.178Z","pid":1949,"message":"! WARNING: Detected 2 Thread(s) started in app boot:"}1206gitlab # [ 221.410296] bundle[1949]: {"timestamp":"2026-08-17T07:21:52.178Z","pid":1949,"message":"! #\u003cThread:0x0000ef9acc2d9928 /nix/store/zj7sa5zsg6vhnyq28b8v0x1jajz1gpvc-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:72 sleep\u003e - /nix/store/zj7sa5zsg6vhnyq28b8v0x1jajz1gpvc-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:90:in `sleep'"}1207gitlab # [ 221.432197] bundle[1949]: {"timestamp":"2026-08-17T07:21:52.178Z","pid":1949,"message":"! #\u003cThread:0x0000ef9acc4dc8d8 /nix/store/lnly88svq5ykjs8ynaw5cm3g88z1lvsm-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:18 sleep\u003e - /nix/store/lnly88svq5ykjs8ynaw5cm3g88z1lvsm-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:20:in `sleep'"}1208gitlab # [ 221.447712] bundle[1949]: {"timestamp":"2026-08-17T07:21:52.178Z","pid":1949,"message":"Use Ctrl-C to stop"}1209gitlab # [ 221.451768] bundle[1949]: {"timestamp":"2026-08-17T07:21:52.178Z","pid":1949,"message":"Sending status to systemd every 1.0 sec"}1210gitlab # [ 224.976708] bundle[1949]: {"timestamp":"2026-08-17T07:21:55.750Z","pid":1949,"message":"- Worker 0 (PID: 2855) booted in 3.51s, phase: 0"}1211gitlab # [ 224.979230] bundle[1949]: {"timestamp":"2026-08-17T07:21:55.753Z","pid":1949,"message":"- Worker 1 (PID: 2859) booted in 3.48s, phase: 0"}1212gitlab # [ 224.992708] systemd[1]: Started gitlab.service.1213gitlab # [ 224.994396] systemd[1]: Reached target Common target for all GitLab services..1214gitlab # [ 225.005194] systemd[1]: Starting setup-gitlab.service...1215gitlab # [ 225.082771] setup-gitlab-start[2914]: + timeout 900 bash -c 'until curl -fs http://gitlab/users/sign_in > /dev/null; do sleep 5; done'1216gitlab # [ 227.007168] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/08/17:07:21:57 +0000] "GET /users/sign_in HTTP/1.1" 200 10655 "" "curl/8.21.0" 18251217gitlab # [ 227.017715] setup-gitlab-start[2914]: + TOKEN=nixbot-test-token-of-20-chars1218gitlab # [ 227.018945] setup-gitlab-start[2914]: + runuser -u gitlab -- /run/current-system/sw/bin/gitlab-rails runner $'\n ApplicationSetting.current.update!(allow_local_requests_from_web_hooks_and_services: true)\n Rails.cache.clear\n token = User.find_by_username(\'root\').personal_access_tokens.create!(\n name: \'nixbot\', scopes: [:api], expires_at: 7.days.from_now)\n token.set_token(\'nixbot-test-token-of-20-chars\')\n token.save!\n'1219gitlab # [ 227.044066] runuser[2928]: pam_unix(runuser:session): session opened for user gitlab(uid=165) by (uid=0)1220gitlab # [ 227.612357] setup-gitlab-start[2929]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1221gitlab # [ 227.618946] setup-gitlab-start[2929]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1222gitlab # [ 227.625353] setup-gitlab-start[2929]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1223gitlab # [ 228.439291] setup-gitlab-start[2929]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1224gitlab # [ 228.439701] setup-gitlab-start[2929]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1225gitlab # [ 228.442180] setup-gitlab-start[2929]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1226gitlab # [ 234.274688] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:22:05.047Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"10e0f7bf087a7ec6babeb818","created_at":"2026-08-17T07:22:04.907Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-c124a74e028d48d7","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"319aa1455c0f7b14fc0ccb1ea55f7530","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-17T07:22:05.042Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-10e0f7bf087a7ec6babeb818: start","job_status":"start","queue_duration_s":0.004158,"scheduling_latency_s":0.004225}1227gitlab # [ 234.461265] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:22:05.234Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"10e0f7bf087a7ec6babeb818","created_at":"2026-08-17T07:22:04.907Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-c124a74e028d48d7","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"319aa1455c0f7b14fc0ccb1ea55f7530","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-17T07:22:05.042Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-10e0f7bf087a7ec6babeb818: done: 0.187333 sec","job_status":"done","queue_duration_s":0.004158,"scheduling_latency_s":0.004225,"redis_calls":10,"redis_duration_s":0.023985,"redis_read_bytes":9,"redis_write_bytes":1061,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.004526,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.016126,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":550,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.003333,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":208,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.05097,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0036412,"duration_s":0.187333,"completed_at":"2026-08-17T07:22:05.234Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.034701,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1228gitlab # [ 234.563039] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:22:05.243Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleOldPipelinesRemovalCronWorker","jid":"6464df5e44c7fe9483a56ef6","created_at":"2026-08-17T07:22:05.056Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-c124a74e028d48d7","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"002477f9b34d2afe57cb9a4b69e8c53a","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5cd05815835513d57d02434c59416c33dd1bebcfa3138e1542ab850c977747b0","size_limiter":"validated","enqueued_at":"2026-08-17T07:22:05.072Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleOldPipelinesRemovalCronWorker JID-6464df5e44c7fe9483a56ef6: start","job_status":"start","queue_duration_s":0.170656,"scheduling_latency_s":0.170712}1229gitlab # [ 234.718425] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:22:05.491Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleOldPipelinesRemovalCronWorker","jid":"6464df5e44c7fe9483a56ef6","created_at":"2026-08-17T07:22:05.056Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-c124a74e028d48d7","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"002477f9b34d2afe57cb9a4b69e8c53a","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5cd05815835513d57d02434c59416c33dd1bebcfa3138e1542ab850c977747b0","size_limiter":"validated","enqueued_at":"2026-08-17T07:22:05.072Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleOldPipelinesRemovalCronWorker JID-6464df5e44c7fe9483a56ef6: done: 0.248524 sec","job_status":"done","queue_duration_s":0.170656,"scheduling_latency_s":0.170712,"redis_calls":28,"redis_duration_s":0.04331,"redis_read_bytes":36,"redis_write_bytes":10603,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.004958,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":680,"redis_queues_calls":2,"redis_queues_duration_s":0.002162,"redis_queues_read_bytes":3,"redis_queues_write_bytes":8315,"redis_queues_metadata_calls":16,"redis_queues_metadata_duration_s":0.030812,"redis_queues_metadata_read_bytes":24,"redis_queues_metadata_write_bytes":1162,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.005378,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":446,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.013,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.013,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.107503,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00185984,"duration_s":0.248524,"completed_at":"2026-08-17T07:22:05.491Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.017952,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1230gitlab # [ 234.815918] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:22:05.496Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"017251e00e17d31ce942ff45","created_at":"2026-08-17T07:22:05.102Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-c124a74e028d48d7","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"bfbd03072ae684b9d8a1712d4b4ef231","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-17T07:22:05.117Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-017251e00e17d31ce942ff45: start","job_status":"start","queue_duration_s":0.378866,"scheduling_latency_s":0.378913}1231gitlab # [ 234.834081] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:22:05.596Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"017251e00e17d31ce942ff45","created_at":"2026-08-17T07:22:05.102Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-c124a74e028d48d7","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"bfbd03072ae684b9d8a1712d4b4ef231","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-17T07:22:05.117Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-017251e00e17d31ce942ff45: done: 0.099884 sec","job_status":"done","queue_duration_s":0.378866,"scheduling_latency_s":0.378913,"redis_calls":12,"redis_duration_s":0.006919,"redis_read_bytes":11,"redis_write_bytes":1566,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.004075,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":628,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002067,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":670,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000777,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":268,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.041626,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0006645,"duration_s":0.099884,"completed_at":"2026-08-17T07:22:05.596Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006923,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1232gitlab # [ 234.877767] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:22:05.600Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"e25f10c4a60cf62ed89cbea9","created_at":"2026-08-17T07:22:05.128Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-c124a74e028d48d7","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"dacb9f9a41dc91a621654972008a480f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-17T07:22:05.144Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-e25f10c4a60cf62ed89cbea9: start","job_status":"start","queue_duration_s":0.455791,"scheduling_latency_s":0.455843}1233gitlab # [ 234.893381] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:22:05.666Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"e25f10c4a60cf62ed89cbea9","created_at":"2026-08-17T07:22:05.128Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-c124a74e028d48d7","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"dacb9f9a41dc91a621654972008a480f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-17T07:22:05.144Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-e25f10c4a60cf62ed89cbea9: done: 0.066231 sec","job_status":"done","queue_duration_s":0.455791,"scheduling_latency_s":0.455843,"redis_calls":10,"redis_duration_s":0.0035329999999999997,"redis_read_bytes":9,"redis_write_bytes":1215,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000762,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":343,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002005,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":626,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000766,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":246,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.030856,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0005663,"duration_s":0.066231,"completed_at":"2026-08-17T07:22:05.666Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00192,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1234gitlab # [ 234.936960] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:22:05.671Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"23efe90bd308c5aba76745f2","created_at":"2026-08-17T07:22:05.171Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-c124a74e028d48d7","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"998fee4224961f86bf57e2a3d7657190","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-17T07:22:05.194Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-23efe90bd308c5aba76745f2: start","job_status":"start","queue_duration_s":0.477507,"scheduling_latency_s":0.477559}1235gitlab # [ 234.950187] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:22:05.707Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0}1236gitlab # [ 234.959362] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:22:05.732Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"23efe90bd308c5aba76745f2","created_at":"2026-08-17T07:22:05.171Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-c124a74e028d48d7","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"998fee4224961f86bf57e2a3d7657190","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-17T07:22:05.194Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-23efe90bd308c5aba76745f2: done: 0.061072 sec","job_status":"done","queue_duration_s":0.477507,"scheduling_latency_s":0.477559,"redis_calls":10,"redis_duration_s":0.0031349999999999998,"redis_read_bytes":9,"redis_write_bytes":1253,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000571,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":351,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001843,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":646,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000721,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":256,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.027606,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00063264,"duration_s":0.061072,"completed_at":"2026-08-17T07:22:05.732Z","load_balancing_strategy":"primary","db_duration_s":0.003017,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1237gitlab # [ 235.001868] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:22:05.736Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"c8d62cdc6e771f3bf23cd4ce","created_at":"2026-08-17T07:22:05.226Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-c124a74e028d48d7","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a650d6698f9b2b0a69089db2a6f27eac","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-08-17T07:22:05.314Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-c8d62cdc6e771f3bf23cd4ce: start","job_status":"start","queue_duration_s":0.422169,"scheduling_latency_s":0.422211}1238gitlab # [ 235.118597] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:22:05.891Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"c8d62cdc6e771f3bf23cd4ce","created_at":"2026-08-17T07:22:05.226Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-c124a74e028d48d7","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a650d6698f9b2b0a69089db2a6f27eac","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-08-17T07:22:05.314Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-c8d62cdc6e771f3bf23cd4ce: done: 0.154449 sec","job_status":"done","queue_duration_s":0.422169,"scheduling_latency_s":0.422211,"redis_calls":19,"redis_duration_s":0.022759,"redis_read_bytes":22,"redis_write_bytes":4785,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.004116,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":672,"redis_queues_calls":2,"redis_queues_duration_s":0.002571,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3015,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.014052,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":814,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.00202,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":284,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.013,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.013,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.065697,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00166718,"duration_s":0.154449,"completed_at":"2026-08-17T07:22:05.890Z","load_balancing_strategy":"primary","db_duration_s":0.01332,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1239gitlab # [ 235.210700] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:22:05.898Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"f52fae90a8d5e5a2cf4fe575","created_at":"2026-08-17T07:22:05.337Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-c124a74e028d48d7","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a82e74693f26ac2c7b7c7966451c4f16","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-17T07:22:05.377Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-f52fae90a8d5e5a2cf4fe575: start","job_status":"start","queue_duration_s":0.520935,"scheduling_latency_s":0.520988}1240gitlab # [ 235.227217] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:22:05.939Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0}1241gitlab # [ 235.230993] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:22:05.996Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"f52fae90a8d5e5a2cf4fe575","created_at":"2026-08-17T07:22:05.337Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-c124a74e028d48d7","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a82e74693f26ac2c7b7c7966451c4f16","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-17T07:22:05.377Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-f52fae90a8d5e5a2cf4fe575: done: 0.098054 sec","job_status":"done","queue_duration_s":0.520935,"scheduling_latency_s":0.520988,"redis_calls":10,"redis_duration_s":0.0035269999999999998,"redis_read_bytes":9,"redis_write_bytes":1261,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000722,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":353,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002039,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":650,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000766,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":258,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.031077,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0006651,"duration_s":0.098054,"completed_at":"2026-08-17T07:22:05.996Z","load_balancing_strategy":"primary","db_duration_s":0.002034,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1242gitlab # [ 235.273540] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:22:06.000Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"8b1bf3792f5c3d0a1ac47883","created_at":"2026-08-17T07:22:05.298Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-50178889d3a44c64","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"002477f9b34d2afe57cb9a4b69e8c53a","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:22:05.448Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-8b1bf3792f5c3d0a1ac47883: start","job_status":"start","queue_duration_s":0.551359,"scheduling_latency_s":0.551409}1243gitlab # [ 235.450105] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:22:06.221Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"8b1bf3792f5c3d0a1ac47883","created_at":"2026-08-17T07:22:05.298Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-50178889d3a44c64","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"002477f9b34d2afe57cb9a4b69e8c53a","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:22:05.448Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-8b1bf3792f5c3d0a1ac47883: done: 0.221974 sec","job_status":"done","queue_duration_s":0.551359,"scheduling_latency_s":0.551409,"redis_calls":16,"redis_duration_s":0.019412,"redis_read_bytes":14,"redis_write_bytes":1526,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000657,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":301,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.003923,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":423,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.014832,"redis_shared_state_read_bytes":9,"redis_shared_state_write_bytes":802,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.033,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.033,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.056223,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00135666,"duration_s":0.221974,"completed_at":"2026-08-17T07:22:06.221Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.084278,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1244gitlab # [ 235.537250] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:22:06.232Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"a8a227b75b631e511dcd81b5","created_at":"2026-08-17T07:22:05.298Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-50178889d3a44c64","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"002477f9b34d2afe57cb9a4b69e8c53a","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:22:05.448Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-a8a227b75b631e511dcd81b5: start","job_status":"start","queue_duration_s":0.784197,"scheduling_latency_s":0.78425}1245gitlab # [ 235.691108] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:22:06.464Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"a8a227b75b631e511dcd81b5","created_at":"2026-08-17T07:22:05.298Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-50178889d3a44c64","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"002477f9b34d2afe57cb9a4b69e8c53a","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:22:05.448Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-a8a227b75b631e511dcd81b5: done: 0.231765 sec","job_status":"done","queue_duration_s":0.784197,"scheduling_latency_s":0.78425,"redis_calls":13,"redis_duration_s":0.038306,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.004927,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.033379,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.033983,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.231765,"completed_at":"2026-08-17T07:22:06.464Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002391,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1246gitlab # [ 235.778058] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:22:06.477Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"53bf9f0f0660dd53af5d3d44","created_at":"2026-08-17T07:22:05.298Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-50178889d3a44c64","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"002477f9b34d2afe57cb9a4b69e8c53a","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:22:05.448Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-53bf9f0f0660dd53af5d3d44: start","job_status":"start","queue_duration_s":1.029161,"scheduling_latency_s":1.029214}1247gitlab # [ 235.800591] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:22:06.573Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"53bf9f0f0660dd53af5d3d44","created_at":"2026-08-17T07:22:05.298Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-50178889d3a44c64","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"002477f9b34d2afe57cb9a4b69e8c53a","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:22:05.448Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-53bf9f0f0660dd53af5d3d44: done: 0.096077 sec","job_status":"done","queue_duration_s":1.029161,"scheduling_latency_s":1.029214,"redis_calls":13,"redis_duration_s":0.013721,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.003686,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.010035,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.027,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.027,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.034237,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.096077,"completed_at":"2026-08-17T07:22:06.573Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.02738,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1248gitlab # [ 235.855164] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:22:06.578Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"3734bb5dccbf244f32269f22","created_at":"2026-08-17T07:22:05.298Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-50178889d3a44c64","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"002477f9b34d2afe57cb9a4b69e8c53a","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:22:05.448Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-3734bb5dccbf244f32269f22: start","job_status":"start","queue_duration_s":1.129446,"scheduling_latency_s":1.129492}1249gitlab # [ 235.915275] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:22:06.688Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"3734bb5dccbf244f32269f22","created_at":"2026-08-17T07:22:05.298Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-50178889d3a44c64","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"002477f9b34d2afe57cb9a4b69e8c53a","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:22:05.448Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-3734bb5dccbf244f32269f22: done: 0.110989 sec","job_status":"done","queue_duration_s":1.129446,"scheduling_latency_s":1.129492,"redis_calls":13,"redis_duration_s":0.00461,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001508,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003102,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.030828,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.110989,"completed_at":"2026-08-17T07:22:06.688Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004164,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1250gitlab # [ 235.983183] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:22:06.696Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"87af98e5e53bbb2748ac0d7e","created_at":"2026-08-17T07:22:05.298Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-50178889d3a44c64","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"002477f9b34d2afe57cb9a4b69e8c53a","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:22:05.448Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-87af98e5e53bbb2748ac0d7e: start","job_status":"start","queue_duration_s":1.247992,"scheduling_latency_s":1.248042}1251gitlab # [ 236.001099] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:22:06.754Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"87af98e5e53bbb2748ac0d7e","created_at":"2026-08-17T07:22:05.298Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-50178889d3a44c64","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"002477f9b34d2afe57cb9a4b69e8c53a","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:22:05.448Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-87af98e5e53bbb2748ac0d7e: done: 0.057587 sec","job_status":"done","queue_duration_s":1.247992,"scheduling_latency_s":1.248042,"redis_calls":13,"redis_duration_s":0.005372,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001534,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003838,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.029964,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.057587,"completed_at":"2026-08-17T07:22:06.753Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007477,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1252gitlab # [ 236.046948] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:22:06.757Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"078e41a8ff968271f7597274","created_at":"2026-08-17T07:22:05.298Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-50178889d3a44c64","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"002477f9b34d2afe57cb9a4b69e8c53a","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:22:05.448Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-078e41a8ff968271f7597274: start","job_status":"start","queue_duration_s":1.308811,"scheduling_latency_s":1.308859}1253gitlab # [ 236.060346] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:22:06.791Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"078e41a8ff968271f7597274","created_at":"2026-08-17T07:22:05.298Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-50178889d3a44c64","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"002477f9b34d2afe57cb9a4b69e8c53a","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:22:05.448Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-078e41a8ff968271f7597274: done: 0.033934 sec","job_status":"done","queue_duration_s":1.308811,"scheduling_latency_s":1.308859,"redis_calls":13,"redis_duration_s":0.003273,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001241,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002032,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022095,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.033934,"completed_at":"2026-08-17T07:22:06.791Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001711,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1254gitlab # [ 236.099711] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:22:06.793Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"77f0209d0613c37e7b87fa2c","created_at":"2026-08-17T07:22:05.298Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-50178889d3a44c64","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"002477f9b34d2afe57cb9a4b69e8c53a","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:22:05.448Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-77f0209d0613c37e7b87fa2c: start","job_status":"start","queue_duration_s":1.344713,"scheduling_latency_s":1.344744}1255gitlab # [ 236.113164] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:22:06.819Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"77f0209d0613c37e7b87fa2c","created_at":"2026-08-17T07:22:05.298Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-50178889d3a44c64","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"002477f9b34d2afe57cb9a4b69e8c53a","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:22:05.448Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-77f0209d0613c37e7b87fa2c: done: 0.026473 sec","job_status":"done","queue_duration_s":1.344713,"scheduling_latency_s":1.344744,"redis_calls":13,"redis_duration_s":0.002581,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000856,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001725,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017017,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.026473,"completed_at":"2026-08-17T07:22:06.819Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000833,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1256gitlab # [ 236.152548] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:22:06.821Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"07d4e82fac7709da6870fb42","created_at":"2026-08-17T07:22:05.298Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-50178889d3a44c64","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"002477f9b34d2afe57cb9a4b69e8c53a","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:22:05.448Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-07d4e82fac7709da6870fb42: start","job_status":"start","queue_duration_s":1.372856,"scheduling_latency_s":1.372884}1257gitlab # [ 236.167187] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:22:06.845Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"07d4e82fac7709da6870fb42","created_at":"2026-08-17T07:22:05.298Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-50178889d3a44c64","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"002477f9b34d2afe57cb9a4b69e8c53a","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:22:05.448Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-07d4e82fac7709da6870fb42: done: 0.024568 sec","job_status":"done","queue_duration_s":1.372856,"scheduling_latency_s":1.372884,"redis_calls":13,"redis_duration_s":0.002172,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000795,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001377,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014401,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.024568,"completed_at":"2026-08-17T07:22:06.845Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00076,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1258gitlab # [ 236.206847] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:22:06.847Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"8cccd69d127cc035359500fe","created_at":"2026-08-17T07:22:05.298Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-50178889d3a44c64","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"002477f9b34d2afe57cb9a4b69e8c53a","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:22:05.448Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-8cccd69d127cc035359500fe: start","job_status":"start","queue_duration_s":1.399112,"scheduling_latency_s":1.399137}1259gitlab # [ 236.220219] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:22:06.865Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"8cccd69d127cc035359500fe","created_at":"2026-08-17T07:22:05.298Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-50178889d3a44c64","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"002477f9b34d2afe57cb9a4b69e8c53a","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:22:05.448Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-8cccd69d127cc035359500fe: done: 0.017782 sec","job_status":"done","queue_duration_s":1.399112,"scheduling_latency_s":1.399137,"redis_calls":13,"redis_duration_s":0.00171,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000652,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001058,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011745,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017782,"completed_at":"2026-08-17T07:22:06.865Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000599,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1260gitlab # [ 236.259254] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:22:06.866Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"f16a5e20cb436d7a0ad36fd3","created_at":"2026-08-17T07:22:05.298Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-50178889d3a44c64","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"002477f9b34d2afe57cb9a4b69e8c53a","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:22:05.448Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-f16a5e20cb436d7a0ad36fd3: start","job_status":"start","queue_duration_s":1.4183,"scheduling_latency_s":1.418326}1261gitlab # [ 236.272646] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:22:06.884Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"f16a5e20cb436d7a0ad36fd3","created_at":"2026-08-17T07:22:05.298Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-50178889d3a44c64","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"002477f9b34d2afe57cb9a4b69e8c53a","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:22:05.448Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-f16a5e20cb436d7a0ad36fd3: done: 0.017365 sec","job_status":"done","queue_duration_s":1.4183,"scheduling_latency_s":1.418326,"redis_calls":13,"redis_duration_s":0.002099,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000587,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001512,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011537,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017365,"completed_at":"2026-08-17T07:22:06.884Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00057,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1262gitlab # [ 236.312093] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:22:06.885Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"a533af25926160b5efd2bd31","created_at":"2026-08-17T07:22:05.437Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-c124a74e028d48d7","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"aa7a4df8309b5b8daa0b5501cc0dd651","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-17T07:22:05.464Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-a533af25926160b5efd2bd31: start","job_status":"start","queue_duration_s":1.421545,"scheduling_latency_s":1.421572}1263gitlab # [ 236.326533] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:22:06.920Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"a533af25926160b5efd2bd31","created_at":"2026-08-17T07:22:05.437Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-c124a74e028d48d7","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"aa7a4df8309b5b8daa0b5501cc0dd651","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-17T07:22:05.464Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-a533af25926160b5efd2bd31: done: 0.034641 sec","job_status":"done","queue_duration_s":1.421545,"scheduling_latency_s":1.421572,"redis_calls":13,"redis_duration_s":0.002145,"redis_read_bytes":12,"redis_write_bytes":1668,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000341,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001023,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":728,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000781,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":603,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024115,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.01097362,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.034641,"completed_at":"2026-08-17T07:22:06.920Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002733,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1264gitlab # [ 236.371476] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:22:06.921Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"d1290098bb813c9eed4556af","created_at":"2026-08-17T07:22:05.485Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-c124a74e028d48d7","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"52709c4f925f70d2fe4b22035535a89c","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-17T07:22:05.530Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-d1290098bb813c9eed4556af: start","job_status":"start","queue_duration_s":1.391007,"scheduling_latency_s":1.391033}1265gitlab # [ 236.386384] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:22:06.995Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"d1290098bb813c9eed4556af","created_at":"2026-08-17T07:22:05.485Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-c124a74e028d48d7","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"52709c4f925f70d2fe4b22035535a89c","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-17T07:22:05.530Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-d1290098bb813c9eed4556af: done: 0.073255 sec","job_status":"done","queue_duration_s":1.391007,"scheduling_latency_s":1.391033,"redis_calls":12,"redis_duration_s":0.001934,"redis_read_bytes":11,"redis_write_bytes":1622,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000335,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":349,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000819,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":658,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00078,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":615,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.016,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.016,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.048682,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00069352,"exclusive_lock_hold_duration_s":0.03774346,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.073255,"completed_at":"2026-08-17T07:22:06.994Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.017672,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1266gitlab # [ 236.430770] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:22:06.996Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"b5bf17eab68d79885caab03f","created_at":"2026-08-17T07:22:05.587Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-c124a74e028d48d7","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8ad736e917f51444265124900adf1ee5","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-17T07:22:05.609Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-b5bf17eab68d79885caab03f: start","job_status":"start","queue_duration_s":1.38706,"scheduling_latency_s":1.387083}1267gitlab # [ 236.445236] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:22:07.019Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"b5bf17eab68d79885caab03f","created_at":"2026-08-17T07:22:05.587Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-c124a74e028d48d7","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8ad736e917f51444265124900adf1ee5","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-17T07:22:05.609Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-b5bf17eab68d79885caab03f: done: 0.023214 sec","job_status":"done","queue_duration_s":1.38706,"scheduling_latency_s":1.387083,"redis_calls":12,"redis_duration_s":0.0018210000000000001,"redis_read_bytes":11,"redis_write_bytes":1511,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000294,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000838,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000689,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":566,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014707,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00049828,"exclusive_lock_hold_duration_s":0.00363476,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.023214,"completed_at":"2026-08-17T07:22:07.019Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001297,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1268gitlab # [ 236.488788] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:22:07.021Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"62d631948a0e39bf7e9803a7","created_at":"2026-08-17T07:22:05.669Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-c124a74e028d48d7","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"01d308a494432ea05bc8018486674e65","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-17T07:22:05.728Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-62d631948a0e39bf7e9803a7: start","job_status":"start","queue_duration_s":1.293116,"scheduling_latency_s":1.293506}1269gitlab # [ 236.503436] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:22:07.033Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0}1270gitlab # [ 236.506978] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:22:07.041Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"62d631948a0e39bf7e9803a7","created_at":"2026-08-17T07:22:05.669Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-c124a74e028d48d7","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"01d308a494432ea05bc8018486674e65","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-17T07:22:05.728Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-62d631948a0e39bf7e9803a7: done: 0.020826 sec","job_status":"done","queue_duration_s":1.293116,"scheduling_latency_s":1.293506,"redis_calls":10,"redis_duration_s":0.001482,"redis_read_bytes":9,"redis_write_bytes":1291,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000292,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":359,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000888,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000302,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012191,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00027196,"duration_s":0.020826,"completed_at":"2026-08-17T07:22:07.041Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000331,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1271gitlab # [ 236.549368] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:22:07.043Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"9daa8809deec0fa2016489fb","created_at":"2026-08-17T07:22:05.768Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-c124a74e028d48d7","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"932e9b4f5c947b175a76a06026774112","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-17T07:22:05.801Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-9daa8809deec0fa2016489fb: start","job_status":"start","queue_duration_s":1.242188,"scheduling_latency_s":1.24221}1272gitlab # [ 236.563940] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:22:07.090Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"9daa8809deec0fa2016489fb","created_at":"2026-08-17T07:22:05.768Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-c124a74e028d48d7","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"932e9b4f5c947b175a76a06026774112","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-17T07:22:05.801Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-9daa8809deec0fa2016489fb: done: 0.047085 sec","job_status":"done","queue_duration_s":1.242188,"scheduling_latency_s":1.24221,"redis_calls":14,"redis_duration_s":0.002239,"redis_read_bytes":13,"redis_write_bytes":1883,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000656,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":618,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000871,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":654,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000712,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":611,"db_count":8,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.01,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.027309,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00059216,"exclusive_lock_hold_duration_s":0.02226552,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.047085,"completed_at":"2026-08-17T07:22:07.090Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.011172,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1273gitlab # [ 236.610182] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:22:07.091Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"8ac5f5277e6c6a714b6d9102","created_at":"2026-08-17T07:22:05.788Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-fb900882e83c4de7","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"a650d6698f9b2b0a69089db2a6f27eac","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:22:05.851Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-8ac5f5277e6c6a714b6d9102: start","job_status":"start","queue_duration_s":1.240305,"scheduling_latency_s":1.240327}1274gitlab # [ 236.622999] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:22:07.111Z","message":"No existing merge request to be cleaned up."}1275gitlab # [ 236.624833] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:22:07.126Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"8ac5f5277e6c6a714b6d9102","created_at":"2026-08-17T07:22:05.788Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-fb900882e83c4de7","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"a650d6698f9b2b0a69089db2a6f27eac","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:22:05.851Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-8ac5f5277e6c6a714b6d9102: done: 0.034228 sec","job_status":"done","queue_duration_s":1.240305,"scheduling_latency_s":1.240327,"redis_calls":13,"redis_duration_s":0.001965,"redis_read_bytes":12,"redis_write_bytes":1401,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000291,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":301,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000722,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":431,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000952,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":669,"db_count":4,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022948,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0002599,"duration_s":0.034228,"completed_at":"2026-08-17T07:22:07.125Z","load_balancing_strategy":"primary","db_duration_s":0.003357,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1276gitlab # [ 236.665954] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:22:07.127Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"b8fff52bbd6cb880b2b40993","created_at":"2026-08-17T07:22:05.788Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-fb900882e83c4de7","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"a650d6698f9b2b0a69089db2a6f27eac","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:22:05.851Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-b8fff52bbd6cb880b2b40993: start","job_status":"start","queue_duration_s":1.275878,"scheduling_latency_s":1.2759}1277gitlab # [ 236.680421] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:22:07.139Z","message":"No existing merge request to be cleaned up."}1278gitlab # [ 236.682637] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:22:07.148Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"b8fff52bbd6cb880b2b40993","created_at":"2026-08-17T07:22:05.788Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-fb900882e83c4de7","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"a650d6698f9b2b0a69089db2a6f27eac","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:22:05.851Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-b8fff52bbd6cb880b2b40993: done: 0.021561 sec","job_status":"done","queue_duration_s":1.275878,"scheduling_latency_s":1.2759,"redis_calls":10,"redis_duration_s":0.001547,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000667,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.00088,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015197,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.021561,"completed_at":"2026-08-17T07:22:07.148Z","load_balancing_strategy":"primary","db_duration_s":0.001433,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1279gitlab # [ 236.733387] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:22:07.151Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"9e5739bf1015a325fa88c14a","created_at":"2026-08-17T07:22:05.788Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-fb900882e83c4de7","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"a650d6698f9b2b0a69089db2a6f27eac","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:22:05.851Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-9e5739bf1015a325fa88c14a: start","job_status":"start","queue_duration_s":1.299584,"scheduling_latency_s":1.299604}1280gitlab # [ 236.745791] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:22:07.162Z","message":"No existing merge request to be cleaned up."}1281gitlab # [ 236.747415] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:22:07.172Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"9e5739bf1015a325fa88c14a","created_at":"2026-08-17T07:22:05.788Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-fb900882e83c4de7","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"a650d6698f9b2b0a69089db2a6f27eac","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:22:05.851Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-9e5739bf1015a325fa88c14a: done: 0.021176 sec","job_status":"done","queue_duration_s":1.299584,"scheduling_latency_s":1.299604,"redis_calls":10,"redis_duration_s":0.002567,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001738,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000829,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014741,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.021176,"completed_at":"2026-08-17T07:22:07.172Z","load_balancing_strategy":"primary","db_duration_s":0.001294,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1282gitlab # [ 236.788117] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:22:07.173Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"bff8e4cb7841090cb309e300","created_at":"2026-08-17T07:22:05.788Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-fb900882e83c4de7","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"a650d6698f9b2b0a69089db2a6f27eac","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:22:05.851Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-bff8e4cb7841090cb309e300: start","job_status":"start","queue_duration_s":1.322431,"scheduling_latency_s":1.322448}1283gitlab # [ 236.800704] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:22:07.185Z","message":"No existing merge request to be cleaned up."}1284gitlab # [ 236.802404] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:22:07.193Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"bff8e4cb7841090cb309e300","created_at":"2026-08-17T07:22:05.788Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-fb900882e83c4de7","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"a650d6698f9b2b0a69089db2a6f27eac","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:22:05.851Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-bff8e4cb7841090cb309e300: done: 0.01999 sec","job_status":"done","queue_duration_s":1.322431,"scheduling_latency_s":1.322448,"redis_calls":10,"redis_duration_s":0.001399,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000589,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.00081,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01448,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01999,"completed_at":"2026-08-17T07:22:07.193Z","load_balancing_strategy":"primary","db_duration_s":0.001259,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1285gitlab # [ 236.840567] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:22:07.195Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"620ad61cd3216a292b3c328b","created_at":"2026-08-17T07:22:05.837Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-c124a74e028d48d7","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b065fdcde41cb36a20d81a9509e0d35f","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-08-17T07:22:05.860Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-620ad61cd3216a292b3c328b: start","job_status":"start","queue_duration_s":1.334708,"scheduling_latency_s":1.334725}1286gitlab # [ 236.853798] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:22:07.217Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"620ad61cd3216a292b3c328b","created_at":"2026-08-17T07:22:05.837Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-c124a74e028d48d7","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b065fdcde41cb36a20d81a9509e0d35f","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-08-17T07:22:05.860Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-620ad61cd3216a292b3c328b: done: 0.021917 sec","job_status":"done","queue_duration_s":1.334708,"scheduling_latency_s":1.334725,"redis_calls":12,"redis_duration_s":0.001851,"redis_read_bytes":10,"redis_write_bytes":1174,"redis_cache_calls":2,"redis_cache_duration_s":0.000428,"redis_cache_read_bytes":1,"redis_cache_write_bytes":93,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000301,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000813,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":562,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000309,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":214,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013419,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00024758,"duration_s":0.021917,"completed_at":"2026-08-17T07:22:07.216Z","load_balancing_strategy":"primary","db_duration_s":0.000323,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1287gitlab # [ 236.895829] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:22:07.218Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"9b14e894213f7b4478314094","created_at":"2026-08-17T07:22:05.883Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-c124a74e028d48d7","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e182d15cb4df302c6911d945582d6e2d","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-17T07:22:05.904Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-9b14e894213f7b4478314094: start","job_status":"start","queue_duration_s":1.314045,"scheduling_latency_s":1.314063}1288gitlab # [ 236.909640] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:22:07.247Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"9b14e894213f7b4478314094","created_at":"2026-08-17T07:22:05.883Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-c124a74e028d48d7","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e182d15cb4df302c6911d945582d6e2d","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-17T07:22:05.904Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-9b14e894213f7b4478314094: done: 0.028447 sec","job_status":"done","queue_duration_s":1.314045,"scheduling_latency_s":1.314063,"redis_calls":12,"redis_duration_s":0.002068,"redis_read_bytes":11,"redis_write_bytes":1489,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000299,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000775,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000994,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":560,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01687,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00048562,"exclusive_lock_hold_duration_s":0.00712284,"duration_s":0.028447,"completed_at":"2026-08-17T07:22:07.247Z","load_balancing_strategy":"primary","db_duration_s":0.002452,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1289gitlab # [ 236.950880] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:22:07.248Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"9b96545a9398bc6f3cbc4881","created_at":"2026-08-17T07:22:05.987Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-c124a74e028d48d7","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"cfedd8d9e6984162ca9f4688eaae20d5","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-17T07:22:06.008Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-9b96545a9398bc6f3cbc4881: start","job_status":"start","queue_duration_s":1.239721,"scheduling_latency_s":1.239738}1290gitlab # [ 236.964836] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:22:07.286Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"9b96545a9398bc6f3cbc4881","created_at":"2026-08-17T07:22:05.987Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-c124a74e028d48d7","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"cfedd8d9e6984162ca9f4688eaae20d5","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-17T07:22:06.008Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-9b96545a9398bc6f3cbc4881: done: 0.038496 sec","job_status":"done","queue_duration_s":1.239721,"scheduling_latency_s":1.239738,"redis_calls":10,"redis_duration_s":0.0015,"redis_read_bytes":9,"redis_write_bytes":1289,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000277,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000836,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000387,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.01,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016654,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00033956,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.038496,"completed_at":"2026-08-17T07:22:07.286Z","load_balancing_strategy":"primary","db_duration_s":0.011244,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1291gitlab # [ 237.008135] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:22:07.288Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"69ccf3842b2a6bec4264295e","created_at":"2026-08-17T07:22:06.061Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-c124a74e028d48d7","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"bd23a867ceb575855ead3d0f20e9a2be","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-17T07:22:06.073Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-69ccf3842b2a6bec4264295e: start","job_status":"start","queue_duration_s":1.214471,"scheduling_latency_s":1.214488}1292gitlab # [ 237.022461] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:22:07.300Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0}1293gitlab # [ 237.026116] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:22:07.308Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"69ccf3842b2a6bec4264295e","created_at":"2026-08-17T07:22:06.061Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-c124a74e028d48d7","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"bd23a867ceb575855ead3d0f20e9a2be","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-17T07:22:06.073Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-69ccf3842b2a6bec4264295e: done: 0.020207 sec","job_status":"done","queue_duration_s":1.214471,"scheduling_latency_s":1.214488,"redis_calls":10,"redis_duration_s":0.001406,"redis_read_bytes":9,"redis_write_bytes":1199,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000279,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000801,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":618,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000326,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":242,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011845,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00027578,"duration_s":0.020207,"completed_at":"2026-08-17T07:22:07.308Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00031,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1294gitlab # [ 237.067991] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:22:07.309Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"1a594fb98a7eceeaa5a43510","created_at":"2026-08-17T07:22:06.113Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-c124a74e028d48d7","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6637fecfea3937182e9935f035795239","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-08-17T07:22:06.140Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-1a594fb98a7eceeaa5a43510: start","job_status":"start","queue_duration_s":1.169118,"scheduling_latency_s":1.169136}1295gitlab # [ 237.082112] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:22:07.338Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"1a594fb98a7eceeaa5a43510","created_at":"2026-08-17T07:22:06.113Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-c124a74e028d48d7","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6637fecfea3937182e9935f035795239","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-08-17T07:22:06.140Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-1a594fb98a7eceeaa5a43510: done: 0.029096 sec","job_status":"done","queue_duration_s":1.169118,"scheduling_latency_s":1.169136,"redis_calls":10,"redis_duration_s":0.001418,"redis_read_bytes":9,"redis_write_bytes":1225,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000327,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00079,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":634,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000301,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":250,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018286,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00024894,"duration_s":0.029096,"completed_at":"2026-08-17T07:22:07.338Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002515,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1296gitlab # [ 237.124260] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:22:07.340Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"a21661d36587fe17d51659ec","created_at":"2026-08-17T07:22:06.163Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-c124a74e028d48d7","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3f3933b9dc6a3bc825fdd17b01725eb8","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-17T07:22:06.182Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-a21661d36587fe17d51659ec: start","job_status":"start","queue_duration_s":1.157674,"scheduling_latency_s":1.157691}1297gitlab # [ 237.138192] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:22:07.374Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"a21661d36587fe17d51659ec","created_at":"2026-08-17T07:22:06.163Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-c124a74e028d48d7","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3f3933b9dc6a3bc825fdd17b01725eb8","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-17T07:22:06.182Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-a21661d36587fe17d51659ec: done: 0.034097 sec","job_status":"done","queue_duration_s":1.157674,"scheduling_latency_s":1.157691,"redis_calls":16,"redis_duration_s":0.002212,"redis_read_bytes":15,"redis_write_bytes":1942,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.001134,"redis_feature_flag_read_bytes":8,"redis_feature_flag_write_bytes":1148,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000779,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":574,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000299,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":220,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022267,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00025134,"duration_s":0.034097,"completed_at":"2026-08-17T07:22:07.374Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003961,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1298gitlab # [ 237.180841] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:22:07.375Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"f0c981ee4734f8b2b9e06543","created_at":"2026-08-17T07:22:06.210Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-c124a74e028d48d7","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"475b0f2f262c6dbb0bb3194571c975d8","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-17T07:22:06.229Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-f0c981ee4734f8b2b9e06543: start","job_status":"start","queue_duration_s":1.146087,"scheduling_latency_s":1.146106}1299gitlab # [ 237.194833] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:22:07.706Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"f0c981ee4734f8b2b9e06543","created_at":"2026-08-17T07:22:06.210Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-c124a74e028d48d7","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"475b0f2f262c6dbb0bb3194571c975d8","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-17T07:22:06.229Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-f0c981ee4734f8b2b9e06543: done: 0.330506 sec","job_status":"done","queue_duration_s":1.146087,"scheduling_latency_s":1.146106,"redis_calls":14,"redis_duration_s":0.002173,"redis_read_bytes":13,"redis_write_bytes":1645,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000642,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":580,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000811,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00072,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":511,"db_count":131,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":131,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.04,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":131,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":84,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.04,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.268132,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00051238,"exclusive_lock_hold_duration_s":0.30780420000000003,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"main","turbo_mode":false},"duration_s":0.330506,"completed_at":"2026-08-17T07:22:07.706Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.075915,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1300gitlab # [ 237.238923] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:22:07.707Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"d91978d0598a2c3915bc7d17","created_at":"2026-08-17T07:22:06.269Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-c124a74e028d48d7","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"92214f4355681393002cb75d81002481","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-17T07:22:06.299Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-d91978d0598a2c3915bc7d17: start","job_status":"start","queue_duration_s":1.407941,"scheduling_latency_s":1.407959}1301gitlab # [ 237.257477] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:22:08.031Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"d91978d0598a2c3915bc7d17","created_at":"2026-08-17T07:22:06.269Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-c124a74e028d48d7","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"92214f4355681393002cb75d81002481","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-17T07:22:06.299Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-d91978d0598a2c3915bc7d17: done: 0.324016 sec","job_status":"done","queue_duration_s":1.407941,"scheduling_latency_s":1.407959,"redis_calls":565,"redis_duration_s":0.058985,"redis_read_bytes":564,"redis_write_bytes":49139,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000312,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000758,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":546,"redis_shared_state_calls":557,"redis_shared_state_duration_s":0.057915,"redis_shared_state_read_bytes":558,"redis_shared_state_write_bytes":48290,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.296241,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00024472,"duration_s":0.324016,"completed_at":"2026-08-17T07:22:08.031Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000612,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1302gitlab # [ 237.299442] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:22:08.032Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"c1dc7bab1d822c043ad92ace","created_at":"2026-08-17T07:22:06.452Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-c124a74e028d48d7","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fc2813c0f6abe64e974f945d73e4a079","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-17T07:22:06.468Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-c1dc7bab1d822c043ad92ace: start","job_status":"start","queue_duration_s":1.563998,"scheduling_latency_s":1.564015}1303gitlab # [ 237.314054] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:22:08.045Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0}1304gitlab # [ 237.317780] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:22:08.052Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"c1dc7bab1d822c043ad92ace","created_at":"2026-08-17T07:22:06.452Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-c124a74e028d48d7","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fc2813c0f6abe64e974f945d73e4a079","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-17T07:22:06.468Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-c1dc7bab1d822c043ad92ace: done: 0.019977 sec","job_status":"done","queue_duration_s":1.563998,"scheduling_latency_s":1.564015,"redis_calls":10,"redis_duration_s":0.00143,"redis_read_bytes":9,"redis_write_bytes":1283,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000286,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000775,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":662,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000369,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":264,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011323,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00025326,"duration_s":0.019977,"completed_at":"2026-08-17T07:22:08.052Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000819,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1305gitlab # [ 237.360085] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:22:08.053Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"d9e3ddca1ad18e73374c6b4b","created_at":"2026-08-17T07:22:06.476Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-c124a74e028d48d7","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"afb9d02de6dfa4d1ebc8be959e6c9ff9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-17T07:22:06.508Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-d9e3ddca1ad18e73374c6b4b: start","job_status":"start","queue_duration_s":1.545817,"scheduling_latency_s":1.545833}1306gitlab # [ 237.387147] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:22:08.161Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"d9e3ddca1ad18e73374c6b4b","created_at":"2026-08-17T07:22:06.476Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-c124a74e028d48d7","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"afb9d02de6dfa4d1ebc8be959e6c9ff9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-17T07:22:06.508Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-d9e3ddca1ad18e73374c6b4b: done: 0.107385 sec","job_status":"done","queue_duration_s":1.545817,"scheduling_latency_s":1.545833,"redis_calls":71,"redis_duration_s":0.0103,"redis_read_bytes":120,"redis_write_bytes":42674,"redis_feature_flag_calls":10,"redis_feature_flag_duration_s":0.001332,"redis_feature_flag_read_bytes":10,"redis_feature_flag_write_bytes":1471,"redis_queues_calls":2,"redis_queues_duration_s":0.00065,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37485,"redis_queues_metadata_calls":56,"redis_queues_metadata_duration_s":0.007885,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3418,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000433,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":300,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.094908,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00024784,"duration_s":0.107385,"completed_at":"2026-08-17T07:22:08.161Z","load_balancing_strategy":"primary","db_duration_s":0.002776,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1307gitlab # [ 237.429903] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:22:08.162Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"194ca1f3a62cd468a92a9127","created_at":"2026-08-17T07:22:06.540Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-c124a74e028d48d7","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d0c04f3cf6e36bc3594c5cc0795103da","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-17T07:22:06.570Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-194ca1f3a62cd468a92a9127: start","job_status":"start","queue_duration_s":1.592839,"scheduling_latency_s":1.592856}1308gitlab # [ 237.444415] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:22:08.175Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0}1309gitlab # [ 237.447485] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:22:08.182Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"194ca1f3a62cd468a92a9127","created_at":"2026-08-17T07:22:06.540Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-c124a74e028d48d7","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d0c04f3cf6e36bc3594c5cc0795103da","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-17T07:22:06.570Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-194ca1f3a62cd468a92a9127: done: 0.0193 sec","job_status":"done","queue_duration_s":1.592839,"scheduling_latency_s":1.592856,"redis_calls":10,"redis_duration_s":0.002391,"redis_read_bytes":9,"redis_write_bytes":1207,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00054,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001371,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00048,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010609,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00032628,"duration_s":0.0193,"completed_at":"2026-08-17T07:22:08.182Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000921,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1310gitlab # [ 237.489971] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:22:08.183Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"f68c751293fe1dd6149f306a","created_at":"2026-08-17T07:22:06.588Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-c124a74e028d48d7","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"780b41e6bb360cde5bdbf86f34c85b50","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-17T07:22:06.620Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-f68c751293fe1dd6149f306a: start","job_status":"start","queue_duration_s":1.562957,"scheduling_latency_s":1.562972}1311gitlab # [ 237.503111] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:22:08.218Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"f68c751293fe1dd6149f306a","created_at":"2026-08-17T07:22:06.588Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-c124a74e028d48d7","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"780b41e6bb360cde5bdbf86f34c85b50","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-17T07:22:06.620Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-f68c751293fe1dd6149f306a: done: 0.035217 sec","job_status":"done","queue_duration_s":1.562957,"scheduling_latency_s":1.562972,"redis_calls":10,"redis_duration_s":0.002695,"redis_read_bytes":9,"redis_write_bytes":1157,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000552,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00159,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000553,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020479,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00038048,"duration_s":0.035217,"completed_at":"2026-08-17T07:22:08.218Z","load_balancing_strategy":"primary","db_duration_s":0.007145,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1312gitlab # [ 237.543841] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:22:08.220Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"d3e707c05db09399f3e26ef3","created_at":"2026-08-17T07:22:06.683Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-c124a74e028d48d7","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fd4cf20105fc40d89f9cde7163c09a9c","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-08-17T07:22:06.700Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-d3e707c05db09399f3e26ef3: start","job_status":"start","queue_duration_s":1.519916,"scheduling_latency_s":1.519932}1313gitlab # [ 237.558461] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:22:08.246Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"d3e707c05db09399f3e26ef3","created_at":"2026-08-17T07:22:06.683Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-c124a74e028d48d7","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fd4cf20105fc40d89f9cde7163c09a9c","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-08-17T07:22:06.700Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-d3e707c05db09399f3e26ef3: done: 0.026528 sec","job_status":"done","queue_duration_s":1.519916,"scheduling_latency_s":1.519932,"redis_calls":12,"redis_duration_s":0.003321,"redis_read_bytes":11,"redis_write_bytes":1562,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000686,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001458,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":634,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001177,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":591,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0146,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00060628,"exclusive_lock_hold_duration_s":0.00672184,"duration_s":0.026528,"completed_at":"2026-08-17T07:22:08.246Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004175,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1314gitlab # [ 237.600521] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:22:08.248Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d636e44bafb8b52ee648a896","created_at":"2026-08-17T07:22:08.074Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-5f7b1aa69ee64994","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afb9d02de6dfa4d1ebc8be959e6c9ff9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:22:08.152Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d636e44bafb8b52ee648a896: start","job_status":"start","queue_duration_s":0.09566,"scheduling_latency_s":0.095675}1315gitlab # [ 237.613795] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:22:08.271Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d636e44bafb8b52ee648a896","created_at":"2026-08-17T07:22:08.074Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-5f7b1aa69ee64994","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afb9d02de6dfa4d1ebc8be959e6c9ff9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:22:08.152Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d636e44bafb8b52ee648a896: done: 0.0232 sec","job_status":"done","queue_duration_s":0.09566,"scheduling_latency_s":0.095675,"redis_calls":16,"redis_duration_s":0.003828,"redis_read_bytes":14,"redis_write_bytes":1544,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000533,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001125,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":439,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00217,"redis_shared_state_read_bytes":9,"redis_shared_state_write_bytes":798,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013366,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00035408,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.0232,"completed_at":"2026-08-17T07:22:08.271Z","load_balancing_strategy":"primary","db_duration_s":0.00068,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1316gitlab # [ 237.654119] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:22:08.272Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fed19bc1cb8db3748d5b882e","created_at":"2026-08-17T07:22:08.074Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-5f7b1aa69ee64994","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afb9d02de6dfa4d1ebc8be959e6c9ff9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:22:08.152Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fed19bc1cb8db3748d5b882e: start","job_status":"start","queue_duration_s":0.12027,"scheduling_latency_s":0.120285}1317gitlab # [ 237.666509] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:22:08.288Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fed19bc1cb8db3748d5b882e","created_at":"2026-08-17T07:22:08.074Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-5f7b1aa69ee64994","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afb9d02de6dfa4d1ebc8be959e6c9ff9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:22:08.152Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fed19bc1cb8db3748d5b882e: done: 0.015278 sec","job_status":"done","queue_duration_s":0.12027,"scheduling_latency_s":0.120285,"redis_calls":13,"redis_duration_s":0.0025139999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000938,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001576,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00972,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015278,"completed_at":"2026-08-17T07:22:08.288Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1318gitlab # [ 237.705471] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:22:08.289Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"86c63c011053702151227dc7","created_at":"2026-08-17T07:22:08.074Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-5f7b1aa69ee64994","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afb9d02de6dfa4d1ebc8be959e6c9ff9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:22:08.152Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-86c63c011053702151227dc7: start","job_status":"start","queue_duration_s":0.137099,"scheduling_latency_s":0.137114}1319gitlab # [ 237.717888] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:22:08.305Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"86c63c011053702151227dc7","created_at":"2026-08-17T07:22:08.074Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-5f7b1aa69ee64994","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afb9d02de6dfa4d1ebc8be959e6c9ff9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:22:08.152Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-86c63c011053702151227dc7: done: 0.015415 sec","job_status":"done","queue_duration_s":0.137099,"scheduling_latency_s":0.137114,"redis_calls":13,"redis_duration_s":0.002784,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000948,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001836,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009756,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015415,"completed_at":"2026-08-17T07:22:08.305Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1320gitlab # [ 237.756536] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:22:08.306Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"490e36885c46f525b1dd08c7","created_at":"2026-08-17T07:22:08.074Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-5f7b1aa69ee64994","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afb9d02de6dfa4d1ebc8be959e6c9ff9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:22:08.152Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-490e36885c46f525b1dd08c7: start","job_status":"start","queue_duration_s":0.154183,"scheduling_latency_s":0.1542}1321gitlab # [ 237.768589] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:22:08.322Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"490e36885c46f525b1dd08c7","created_at":"2026-08-17T07:22:08.074Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-5f7b1aa69ee64994","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afb9d02de6dfa4d1ebc8be959e6c9ff9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:22:08.152Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-490e36885c46f525b1dd08c7: done: 0.015435 sec","job_status":"done","queue_duration_s":0.154183,"scheduling_latency_s":0.1542,"redis_calls":13,"redis_duration_s":0.00273,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000946,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001784,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00987,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015435,"completed_at":"2026-08-17T07:22:08.322Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1322gitlab # [ 237.808877] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:22:08.323Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a44e2ee27c7f25b99d4ceeb1","created_at":"2026-08-17T07:22:08.074Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-5f7b1aa69ee64994","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afb9d02de6dfa4d1ebc8be959e6c9ff9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:22:08.152Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a44e2ee27c7f25b99d4ceeb1: start","job_status":"start","queue_duration_s":0.171185,"scheduling_latency_s":0.171201}1323gitlab # [ 237.821330] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:22:08.339Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a44e2ee27c7f25b99d4ceeb1","created_at":"2026-08-17T07:22:08.074Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-5f7b1aa69ee64994","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afb9d02de6dfa4d1ebc8be959e6c9ff9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:22:08.152Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a44e2ee27c7f25b99d4ceeb1: done: 0.015309 sec","job_status":"done","queue_duration_s":0.171185,"scheduling_latency_s":0.171201,"redis_calls":13,"redis_duration_s":0.0026750000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00092,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001755,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009784,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015309,"completed_at":"2026-08-17T07:22:08.339Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1324gitlab # [ 237.860770] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:22:08.340Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d5c0b2b81cbc103056a6b67f","created_at":"2026-08-17T07:22:08.074Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-5f7b1aa69ee64994","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afb9d02de6dfa4d1ebc8be959e6c9ff9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:22:08.152Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d5c0b2b81cbc103056a6b67f: start","job_status":"start","queue_duration_s":0.188019,"scheduling_latency_s":0.188035}1325gitlab # [ 237.874082] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:22:08.356Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d5c0b2b81cbc103056a6b67f","created_at":"2026-08-17T07:22:08.074Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-5f7b1aa69ee64994","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afb9d02de6dfa4d1ebc8be959e6c9ff9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:22:08.152Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d5c0b2b81cbc103056a6b67f: done: 0.015331 sec","job_status":"done","queue_duration_s":0.188019,"scheduling_latency_s":0.188035,"redis_calls":13,"redis_duration_s":0.002778,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000935,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001843,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009726,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015331,"completed_at":"2026-08-17T07:22:08.355Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1326gitlab # [ 237.913370] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:22:08.357Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ee0aa6b4b86f4a631bba644c","created_at":"2026-08-17T07:22:08.074Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-5f7b1aa69ee64994","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afb9d02de6dfa4d1ebc8be959e6c9ff9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:22:08.152Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ee0aa6b4b86f4a631bba644c: start","job_status":"start","queue_duration_s":0.204726,"scheduling_latency_s":0.204741}1327gitlab # [ 237.925824] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:22:08.372Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ee0aa6b4b86f4a631bba644c","created_at":"2026-08-17T07:22:08.074Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-5f7b1aa69ee64994","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afb9d02de6dfa4d1ebc8be959e6c9ff9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:22:08.152Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ee0aa6b4b86f4a631bba644c: done: 0.01547 sec","job_status":"done","queue_duration_s":0.204726,"scheduling_latency_s":0.204741,"redis_calls":13,"redis_duration_s":0.002741,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000983,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001758,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009715,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01547,"completed_at":"2026-08-17T07:22:08.372Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1328gitlab # [ 237.964800] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:22:08.374Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2287be8cc62ee4bfcb14e283","created_at":"2026-08-17T07:22:08.074Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-5f7b1aa69ee64994","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afb9d02de6dfa4d1ebc8be959e6c9ff9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:22:08.152Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2287be8cc62ee4bfcb14e283: start","job_status":"start","queue_duration_s":0.221528,"scheduling_latency_s":0.221543}1329gitlab # [ 237.977603] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:22:08.389Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2287be8cc62ee4bfcb14e283","created_at":"2026-08-17T07:22:08.074Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-5f7b1aa69ee64994","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afb9d02de6dfa4d1ebc8be959e6c9ff9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:22:08.152Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2287be8cc62ee4bfcb14e283: done: 0.015511 sec","job_status":"done","queue_duration_s":0.221528,"scheduling_latency_s":0.221543,"redis_calls":13,"redis_duration_s":0.002665,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000928,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001737,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009598,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015511,"completed_at":"2026-08-17T07:22:08.389Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1330gitlab # [ 238.018506] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:22:08.391Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6e007da959ec229a4c7a1974","created_at":"2026-08-17T07:22:08.074Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-5f7b1aa69ee64994","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afb9d02de6dfa4d1ebc8be959e6c9ff9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:22:08.152Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6e007da959ec229a4c7a1974: start","job_status":"start","queue_duration_s":0.238423,"scheduling_latency_s":0.238438}1331gitlab # [ 238.031909] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:22:08.406Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6e007da959ec229a4c7a1974","created_at":"2026-08-17T07:22:08.074Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-5f7b1aa69ee64994","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afb9d02de6dfa4d1ebc8be959e6c9ff9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:22:08.152Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6e007da959ec229a4c7a1974: done: 0.015482 sec","job_status":"done","queue_duration_s":0.238423,"scheduling_latency_s":0.238438,"redis_calls":13,"redis_duration_s":0.002807,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000945,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001862,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009543,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015482,"completed_at":"2026-08-17T07:22:08.406Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1332gitlab # [ 238.072225] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:22:08.408Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8e242fdfd2bdf9d54603814a","created_at":"2026-08-17T07:22:08.074Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-5f7b1aa69ee64994","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afb9d02de6dfa4d1ebc8be959e6c9ff9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:22:08.152Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8e242fdfd2bdf9d54603814a: start","job_status":"start","queue_duration_s":0.255296,"scheduling_latency_s":0.255312}1333gitlab # [ 238.084463] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:22:08.423Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8e242fdfd2bdf9d54603814a","created_at":"2026-08-17T07:22:08.074Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-5f7b1aa69ee64994","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afb9d02de6dfa4d1ebc8be959e6c9ff9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:22:08.152Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8e242fdfd2bdf9d54603814a: done: 0.015453 sec","job_status":"done","queue_duration_s":0.255296,"scheduling_latency_s":0.255312,"redis_calls":13,"redis_duration_s":0.002796,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000917,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001879,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009496,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015453,"completed_at":"2026-08-17T07:22:08.423Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1334gitlab # [ 238.124642] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:22:08.424Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"96e534c2d4c21bf6012aee9d","created_at":"2026-08-17T07:22:08.074Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-5f7b1aa69ee64994","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afb9d02de6dfa4d1ebc8be959e6c9ff9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:22:08.152Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-96e534c2d4c21bf6012aee9d: start","job_status":"start","queue_duration_s":0.272111,"scheduling_latency_s":0.272127}1335gitlab # [ 238.136918] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:22:08.440Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"96e534c2d4c21bf6012aee9d","created_at":"2026-08-17T07:22:08.074Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-5f7b1aa69ee64994","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afb9d02de6dfa4d1ebc8be959e6c9ff9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:22:08.152Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-96e534c2d4c21bf6012aee9d: done: 0.015645 sec","job_status":"done","queue_duration_s":0.272111,"scheduling_latency_s":0.272127,"redis_calls":13,"redis_duration_s":0.002921,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000945,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001976,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009679,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015645,"completed_at":"2026-08-17T07:22:08.440Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1336gitlab # [ 238.176891] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:22:08.441Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0e6479dc7ddaea4b7f91a0c0","created_at":"2026-08-17T07:22:08.074Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-5f7b1aa69ee64994","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afb9d02de6dfa4d1ebc8be959e6c9ff9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:22:08.152Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0e6479dc7ddaea4b7f91a0c0: start","job_status":"start","queue_duration_s":0.289248,"scheduling_latency_s":0.289264}1337gitlab # [ 238.189289] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:22:08.457Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0e6479dc7ddaea4b7f91a0c0","created_at":"2026-08-17T07:22:08.074Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-5f7b1aa69ee64994","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afb9d02de6dfa4d1ebc8be959e6c9ff9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:22:08.152Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0e6479dc7ddaea4b7f91a0c0: done: 0.01576 sec","job_status":"done","queue_duration_s":0.289248,"scheduling_latency_s":0.289264,"redis_calls":13,"redis_duration_s":0.002987,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000922,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002065,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009605,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01576,"completed_at":"2026-08-17T07:22:08.457Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1338gitlab # [ 238.229848] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:22:08.459Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c4dea6408eedb2d6e34bb76f","created_at":"2026-08-17T07:22:08.074Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-5f7b1aa69ee64994","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afb9d02de6dfa4d1ebc8be959e6c9ff9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:22:08.152Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c4dea6408eedb2d6e34bb76f: start","job_status":"start","queue_duration_s":0.306547,"scheduling_latency_s":0.306561}1339gitlab # [ 238.242557] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:22:08.474Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c4dea6408eedb2d6e34bb76f","created_at":"2026-08-17T07:22:08.074Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-5f7b1aa69ee64994","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afb9d02de6dfa4d1ebc8be959e6c9ff9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:22:08.152Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c4dea6408eedb2d6e34bb76f: done: 0.015675 sec","job_status":"done","queue_duration_s":0.306547,"scheduling_latency_s":0.306561,"redis_calls":13,"redis_duration_s":0.002707,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000931,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001776,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009927,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015675,"completed_at":"2026-08-17T07:22:08.474Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1340gitlab # [ 238.281799] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:22:08.476Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4ef2092fd98ed046f96b0347","created_at":"2026-08-17T07:22:08.074Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-5f7b1aa69ee64994","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afb9d02de6dfa4d1ebc8be959e6c9ff9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:22:08.152Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4ef2092fd98ed046f96b0347: start","job_status":"start","queue_duration_s":0.324127,"scheduling_latency_s":0.324143}1341gitlab # [ 238.294307] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:22:08.496Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4ef2092fd98ed046f96b0347","created_at":"2026-08-17T07:22:08.074Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-5f7b1aa69ee64994","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afb9d02de6dfa4d1ebc8be959e6c9ff9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:22:08.152Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4ef2092fd98ed046f96b0347: done: 0.019881 sec","job_status":"done","queue_duration_s":0.324127,"scheduling_latency_s":0.324143,"redis_calls":13,"redis_duration_s":0.0056500000000000005,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000624,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.005026,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011611,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019881,"completed_at":"2026-08-17T07:22:08.496Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1342gitlab # [ 238.333590] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:22:08.498Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"735769c70f142bddb7e99bf2","created_at":"2026-08-17T07:22:08.074Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-5f7b1aa69ee64994","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afb9d02de6dfa4d1ebc8be959e6c9ff9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:22:08.152Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-735769c70f142bddb7e99bf2: start","job_status":"start","queue_duration_s":0.345304,"scheduling_latency_s":0.345321}1343gitlab # [ 238.346094] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:22:08.513Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"735769c70f142bddb7e99bf2","created_at":"2026-08-17T07:22:08.074Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-5f7b1aa69ee64994","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afb9d02de6dfa4d1ebc8be959e6c9ff9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:22:08.152Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-735769c70f142bddb7e99bf2: done: 0.01506 sec","job_status":"done","queue_duration_s":0.345304,"scheduling_latency_s":0.345321,"redis_calls":13,"redis_duration_s":0.0015799999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000574,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001006,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010511,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01506,"completed_at":"2026-08-17T07:22:08.513Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1344gitlab # [ 238.385147] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:22:08.514Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e992df01da7f46af90942b5e","created_at":"2026-08-17T07:22:08.074Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-5f7b1aa69ee64994","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afb9d02de6dfa4d1ebc8be959e6c9ff9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:22:08.152Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e992df01da7f46af90942b5e: start","job_status":"start","queue_duration_s":0.361667,"scheduling_latency_s":0.361684}1345gitlab # [ 238.397509] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:22:08.529Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e992df01da7f46af90942b5e","created_at":"2026-08-17T07:22:08.074Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-5f7b1aa69ee64994","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afb9d02de6dfa4d1ebc8be959e6c9ff9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:22:08.152Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e992df01da7f46af90942b5e: done: 0.01469 sec","job_status":"done","queue_duration_s":0.361667,"scheduling_latency_s":0.361684,"redis_calls":13,"redis_duration_s":0.001714,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000762,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000952,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01025,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01469,"completed_at":"2026-08-17T07:22:08.528Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1346gitlab # [ 238.437390] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:22:08.530Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e81837337c8e8fd5e91fada7","created_at":"2026-08-17T07:22:08.074Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-5f7b1aa69ee64994","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afb9d02de6dfa4d1ebc8be959e6c9ff9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:22:08.152Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e81837337c8e8fd5e91fada7: start","job_status":"start","queue_duration_s":0.377461,"scheduling_latency_s":0.377477}1347gitlab # [ 238.449879] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:22:08.544Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e81837337c8e8fd5e91fada7","created_at":"2026-08-17T07:22:08.074Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-5f7b1aa69ee64994","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afb9d02de6dfa4d1ebc8be959e6c9ff9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:22:08.152Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e81837337c8e8fd5e91fada7: done: 0.014829 sec","job_status":"done","queue_duration_s":0.377461,"scheduling_latency_s":0.377477,"redis_calls":13,"redis_duration_s":0.0014880000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000532,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000956,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010296,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014829,"completed_at":"2026-08-17T07:22:08.544Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1348gitlab # [ 238.488898] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:22:08.546Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6f00d2a56667e2ca1e80f313","created_at":"2026-08-17T07:22:08.074Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-5f7b1aa69ee64994","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afb9d02de6dfa4d1ebc8be959e6c9ff9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:22:08.152Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6f00d2a56667e2ca1e80f313: start","job_status":"start","queue_duration_s":0.39338,"scheduling_latency_s":0.393396}1349gitlab # [ 238.501573] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:22:08.561Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6f00d2a56667e2ca1e80f313","created_at":"2026-08-17T07:22:08.074Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-5f7b1aa69ee64994","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afb9d02de6dfa4d1ebc8be959e6c9ff9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:22:08.152Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6f00d2a56667e2ca1e80f313: done: 0.01499 sec","job_status":"done","queue_duration_s":0.39338,"scheduling_latency_s":0.393396,"redis_calls":13,"redis_duration_s":0.0017929999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000538,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001255,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010342,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01499,"completed_at":"2026-08-17T07:22:08.561Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1350gitlab # [ 238.540666] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:22:08.562Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f79138c3de2667350de64a69","created_at":"2026-08-17T07:22:08.074Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-5f7b1aa69ee64994","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afb9d02de6dfa4d1ebc8be959e6c9ff9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:22:08.152Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f79138c3de2667350de64a69: start","job_status":"start","queue_duration_s":0.409437,"scheduling_latency_s":0.409454}1351gitlab # [ 238.552924] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:22:08.577Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f79138c3de2667350de64a69","created_at":"2026-08-17T07:22:08.074Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-5f7b1aa69ee64994","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afb9d02de6dfa4d1ebc8be959e6c9ff9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:22:08.152Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f79138c3de2667350de64a69: done: 0.014983 sec","job_status":"done","queue_duration_s":0.409437,"scheduling_latency_s":0.409454,"redis_calls":13,"redis_duration_s":0.0015270000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000548,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000979,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009994,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014983,"completed_at":"2026-08-17T07:22:08.577Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1352gitlab # [ 238.592156] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:22:08.578Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"13d31b200e5d2cb5c3f062cc","created_at":"2026-08-17T07:22:08.074Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-5f7b1aa69ee64994","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afb9d02de6dfa4d1ebc8be959e6c9ff9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:22:08.152Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-13d31b200e5d2cb5c3f062cc: start","job_status":"start","queue_duration_s":0.425495,"scheduling_latency_s":0.425511}1353gitlab # [ 238.604206] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:22:08.593Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"13d31b200e5d2cb5c3f062cc","created_at":"2026-08-17T07:22:08.074Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-5f7b1aa69ee64994","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afb9d02de6dfa4d1ebc8be959e6c9ff9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:22:08.152Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-13d31b200e5d2cb5c3f062cc: done: 0.015009 sec","job_status":"done","queue_duration_s":0.425495,"scheduling_latency_s":0.425511,"redis_calls":13,"redis_duration_s":0.001595,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000573,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001022,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010213,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015009,"completed_at":"2026-08-17T07:22:08.593Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1354gitlab # [ 238.644377] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:22:08.594Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"63051f8fb645e1062e1d06ee","created_at":"2026-08-17T07:22:08.074Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-5f7b1aa69ee64994","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afb9d02de6dfa4d1ebc8be959e6c9ff9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:22:08.152Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-63051f8fb645e1062e1d06ee: start","job_status":"start","queue_duration_s":0.441624,"scheduling_latency_s":0.441641}1355gitlab # [ 238.656799] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:22:08.608Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"63051f8fb645e1062e1d06ee","created_at":"2026-08-17T07:22:08.074Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-5f7b1aa69ee64994","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afb9d02de6dfa4d1ebc8be959e6c9ff9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:22:08.152Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-63051f8fb645e1062e1d06ee: done: 0.014575 sec","job_status":"done","queue_duration_s":0.441624,"scheduling_latency_s":0.441641,"redis_calls":13,"redis_duration_s":0.0015119999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000541,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000971,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010066,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014575,"completed_at":"2026-08-17T07:22:08.608Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1356gitlab # [ 238.696234] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:22:08.610Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4798108e3c1400d59588e411","created_at":"2026-08-17T07:22:08.074Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-5f7b1aa69ee64994","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afb9d02de6dfa4d1ebc8be959e6c9ff9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:22:08.152Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4798108e3c1400d59588e411: start","job_status":"start","queue_duration_s":0.457535,"scheduling_latency_s":0.457552}1357gitlab # [ 238.708400] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:22:08.624Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4798108e3c1400d59588e411","created_at":"2026-08-17T07:22:08.074Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-5f7b1aa69ee64994","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afb9d02de6dfa4d1ebc8be959e6c9ff9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:22:08.152Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4798108e3c1400d59588e411: done: 0.014711 sec","job_status":"done","queue_duration_s":0.457535,"scheduling_latency_s":0.457552,"redis_calls":13,"redis_duration_s":0.001508,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000559,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000949,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010139,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014711,"completed_at":"2026-08-17T07:22:08.624Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1358gitlab # [ 238.748305] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:22:08.626Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4e12d879fc2238ca25dc6125","created_at":"2026-08-17T07:22:08.074Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-5f7b1aa69ee64994","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afb9d02de6dfa4d1ebc8be959e6c9ff9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:22:08.152Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4e12d879fc2238ca25dc6125: start","job_status":"start","queue_duration_s":0.473477,"scheduling_latency_s":0.473493}1359gitlab # [ 238.760528] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:22:08.640Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4e12d879fc2238ca25dc6125","created_at":"2026-08-17T07:22:08.074Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-5f7b1aa69ee64994","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afb9d02de6dfa4d1ebc8be959e6c9ff9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:22:08.152Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4e12d879fc2238ca25dc6125: done: 0.014491 sec","job_status":"done","queue_duration_s":0.473477,"scheduling_latency_s":0.473493,"redis_calls":13,"redis_duration_s":0.001503,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000548,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000955,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010208,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014491,"completed_at":"2026-08-17T07:22:08.640Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1360gitlab # [ 238.799906] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:22:08.641Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3ac60c064849fbfef6d9eef8","created_at":"2026-08-17T07:22:08.074Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-5f7b1aa69ee64994","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afb9d02de6dfa4d1ebc8be959e6c9ff9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:22:08.152Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3ac60c064849fbfef6d9eef8: start","job_status":"start","queue_duration_s":0.4892,"scheduling_latency_s":0.489217}1361gitlab # [ 238.812541] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:22:08.656Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3ac60c064849fbfef6d9eef8","created_at":"2026-08-17T07:22:08.074Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-5f7b1aa69ee64994","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afb9d02de6dfa4d1ebc8be959e6c9ff9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:22:08.152Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3ac60c064849fbfef6d9eef8: done: 0.014487 sec","job_status":"done","queue_duration_s":0.4892,"scheduling_latency_s":0.489217,"redis_calls":13,"redis_duration_s":0.001532,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000537,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000995,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010231,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014487,"completed_at":"2026-08-17T07:22:08.656Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1362gitlab # [ 238.852459] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:22:08.657Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9b629da87df55383291f8ff0","created_at":"2026-08-17T07:22:08.074Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-5f7b1aa69ee64994","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afb9d02de6dfa4d1ebc8be959e6c9ff9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:22:08.152Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9b629da87df55383291f8ff0: start","job_status":"start","queue_duration_s":0.504917,"scheduling_latency_s":0.504933}1363gitlab # [ 238.864815] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:22:08.672Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9b629da87df55383291f8ff0","created_at":"2026-08-17T07:22:08.074Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-5f7b1aa69ee64994","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afb9d02de6dfa4d1ebc8be959e6c9ff9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:22:08.152Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9b629da87df55383291f8ff0: done: 0.014866 sec","job_status":"done","queue_duration_s":0.504917,"scheduling_latency_s":0.504933,"redis_calls":13,"redis_duration_s":0.00162,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000627,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000993,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010468,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014866,"completed_at":"2026-08-17T07:22:08.672Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1364gitlab # [ 238.904215] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:22:08.673Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"11976fff750d975b506f60b1","created_at":"2026-08-17T07:22:08.074Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-5f7b1aa69ee64994","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afb9d02de6dfa4d1ebc8be959e6c9ff9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:22:08.152Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-11976fff750d975b506f60b1: start","job_status":"start","queue_duration_s":0.521112,"scheduling_latency_s":0.521129}1365gitlab # [ 238.916505] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:22:08.688Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"11976fff750d975b506f60b1","created_at":"2026-08-17T07:22:08.074Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-5f7b1aa69ee64994","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afb9d02de6dfa4d1ebc8be959e6c9ff9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:22:08.152Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-11976fff750d975b506f60b1: done: 0.014889 sec","job_status":"done","queue_duration_s":0.521112,"scheduling_latency_s":0.521129,"redis_calls":13,"redis_duration_s":0.001467,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000536,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000931,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01026,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014889,"completed_at":"2026-08-17T07:22:08.688Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1366gitlab # [ 238.955858] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:22:08.689Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dd8d663cc40c5b9d19d2b83f","created_at":"2026-08-17T07:22:08.074Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-5f7b1aa69ee64994","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afb9d02de6dfa4d1ebc8be959e6c9ff9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:22:08.152Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dd8d663cc40c5b9d19d2b83f: start","job_status":"start","queue_duration_s":0.537095,"scheduling_latency_s":0.53711}1367gitlab # [ 238.968399] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:22:08.704Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dd8d663cc40c5b9d19d2b83f","created_at":"2026-08-17T07:22:08.074Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-5f7b1aa69ee64994","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afb9d02de6dfa4d1ebc8be959e6c9ff9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:22:08.152Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dd8d663cc40c5b9d19d2b83f: done: 0.01451 sec","job_status":"done","queue_duration_s":0.537095,"scheduling_latency_s":0.53711,"redis_calls":13,"redis_duration_s":0.001669,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000531,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001138,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010064,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01451,"completed_at":"2026-08-17T07:22:08.704Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1368gitlab # [ 239.007803] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:22:08.705Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"900f2ce98aa55a438b6abb3e","created_at":"2026-08-17T07:22:08.074Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-5f7b1aa69ee64994","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afb9d02de6dfa4d1ebc8be959e6c9ff9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:22:08.152Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-900f2ce98aa55a438b6abb3e: start","job_status":"start","queue_duration_s":0.552681,"scheduling_latency_s":0.552697}1369gitlab # [ 239.020372] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:22:08.719Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"900f2ce98aa55a438b6abb3e","created_at":"2026-08-17T07:22:08.074Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-5f7b1aa69ee64994","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afb9d02de6dfa4d1ebc8be959e6c9ff9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:22:08.152Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-900f2ce98aa55a438b6abb3e: done: 0.014596 sec","job_status":"done","queue_duration_s":0.552681,"scheduling_latency_s":0.552697,"redis_calls":13,"redis_duration_s":0.001643,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000529,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001114,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010121,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014596,"completed_at":"2026-08-17T07:22:08.719Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1370gitlab # [ 239.060221] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:22:08.721Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5b582405992b5916d120cb76","created_at":"2026-08-17T07:22:08.074Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-5f7b1aa69ee64994","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afb9d02de6dfa4d1ebc8be959e6c9ff9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:22:08.152Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5b582405992b5916d120cb76: start","job_status":"start","queue_duration_s":0.568352,"scheduling_latency_s":0.568369}1371gitlab # [ 239.072659] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:22:08.736Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5b582405992b5916d120cb76","created_at":"2026-08-17T07:22:08.074Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-5f7b1aa69ee64994","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afb9d02de6dfa4d1ebc8be959e6c9ff9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:22:08.152Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5b582405992b5916d120cb76: done: 0.014968 sec","job_status":"done","queue_duration_s":0.568352,"scheduling_latency_s":0.568369,"redis_calls":13,"redis_duration_s":0.001919,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000722,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001197,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010174,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014968,"completed_at":"2026-08-17T07:22:08.735Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1372gitlab # [ 239.111845] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:22:08.737Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0b4d2b33f71904296584cb1b","created_at":"2026-08-17T07:22:08.074Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-5f7b1aa69ee64994","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afb9d02de6dfa4d1ebc8be959e6c9ff9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:22:08.152Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0b4d2b33f71904296584cb1b: start","job_status":"start","queue_duration_s":0.584443,"scheduling_latency_s":0.58446}1373gitlab # [ 239.124596] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:22:08.751Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0b4d2b33f71904296584cb1b","created_at":"2026-08-17T07:22:08.074Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-5f7b1aa69ee64994","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afb9d02de6dfa4d1ebc8be959e6c9ff9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:22:08.152Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0b4d2b33f71904296584cb1b: done: 0.014574 sec","job_status":"done","queue_duration_s":0.584443,"scheduling_latency_s":0.58446,"redis_calls":13,"redis_duration_s":0.001442,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000529,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000913,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009894,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014574,"completed_at":"2026-08-17T07:22:08.751Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1374gitlab # [ 239.163784] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:22:08.752Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5731cc2ce0fc0ac521607d4d","created_at":"2026-08-17T07:22:08.074Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-5f7b1aa69ee64994","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afb9d02de6dfa4d1ebc8be959e6c9ff9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:22:08.152Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5731cc2ce0fc0ac521607d4d: start","job_status":"start","queue_duration_s":0.600071,"scheduling_latency_s":0.600087}1375gitlab # [ 239.176122] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:22:08.767Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5731cc2ce0fc0ac521607d4d","created_at":"2026-08-17T07:22:08.074Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-5f7b1aa69ee64994","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afb9d02de6dfa4d1ebc8be959e6c9ff9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:22:08.152Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5731cc2ce0fc0ac521607d4d: done: 0.014375 sec","job_status":"done","queue_duration_s":0.600071,"scheduling_latency_s":0.600087,"redis_calls":13,"redis_duration_s":0.001464,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000539,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000925,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009902,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014375,"completed_at":"2026-08-17T07:22:08.767Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1376gitlab # [ 239.215367] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:22:08.768Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bc978831c6a02f9a6b0825ab","created_at":"2026-08-17T07:22:08.074Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-5f7b1aa69ee64994","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afb9d02de6dfa4d1ebc8be959e6c9ff9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:22:08.152Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bc978831c6a02f9a6b0825ab: start","job_status":"start","queue_duration_s":0.615729,"scheduling_latency_s":0.615745}1377gitlab # [ 239.228155] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:22:08.783Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bc978831c6a02f9a6b0825ab","created_at":"2026-08-17T07:22:08.074Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-5f7b1aa69ee64994","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afb9d02de6dfa4d1ebc8be959e6c9ff9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:22:08.152Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bc978831c6a02f9a6b0825ab: done: 0.015063 sec","job_status":"done","queue_duration_s":0.615729,"scheduling_latency_s":0.615745,"redis_calls":13,"redis_duration_s":0.001683,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000551,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001132,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010211,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015063,"completed_at":"2026-08-17T07:22:08.783Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1378gitlab # [ 239.268322] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:22:08.784Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bb7e0c6cf0544c2df0882949","created_at":"2026-08-17T07:22:08.074Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-5f7b1aa69ee64994","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afb9d02de6dfa4d1ebc8be959e6c9ff9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:22:08.152Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bb7e0c6cf0544c2df0882949: start","job_status":"start","queue_duration_s":0.632137,"scheduling_latency_s":0.632153}1379gitlab # [ 239.280689] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:22:08.804Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bb7e0c6cf0544c2df0882949","created_at":"2026-08-17T07:22:08.074Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-5f7b1aa69ee64994","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afb9d02de6dfa4d1ebc8be959e6c9ff9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:22:08.152Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bb7e0c6cf0544c2df0882949: done: 0.019313 sec","job_status":"done","queue_duration_s":0.632137,"scheduling_latency_s":0.632153,"redis_calls":13,"redis_duration_s":0.0014910000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000541,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00095,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010305,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019313,"completed_at":"2026-08-17T07:22:08.804Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1380gitlab # [ 239.320031] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:22:08.812Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5c48a84264400a2d158ee523","created_at":"2026-08-17T07:22:08.074Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-5f7b1aa69ee64994","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afb9d02de6dfa4d1ebc8be959e6c9ff9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:22:08.152Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5c48a84264400a2d158ee523: start","job_status":"start","queue_duration_s":0.659749,"scheduling_latency_s":0.659792}1381gitlab # [ 239.332392] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:22:08.851Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5c48a84264400a2d158ee523","created_at":"2026-08-17T07:22:08.074Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-5f7b1aa69ee64994","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afb9d02de6dfa4d1ebc8be959e6c9ff9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:22:08.152Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5c48a84264400a2d158ee523: done: 0.038897 sec","job_status":"done","queue_duration_s":0.659749,"scheduling_latency_s":0.659792,"redis_calls":13,"redis_duration_s":0.003548,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001221,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002327,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026049,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.038897,"completed_at":"2026-08-17T07:22:08.851Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1382gitlab # [ 239.371549] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:22:08.854Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"15e94fa7f45ba6a3a87a191c","created_at":"2026-08-17T07:22:08.074Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-5f7b1aa69ee64994","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afb9d02de6dfa4d1ebc8be959e6c9ff9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:22:08.152Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-15e94fa7f45ba6a3a87a191c: start","job_status":"start","queue_duration_s":0.701757,"scheduling_latency_s":0.701797}1383gitlab # [ 239.383996] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:22:08.892Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"15e94fa7f45ba6a3a87a191c","created_at":"2026-08-17T07:22:08.074Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-5f7b1aa69ee64994","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afb9d02de6dfa4d1ebc8be959e6c9ff9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:22:08.152Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-15e94fa7f45ba6a3a87a191c: done: 0.038404 sec","job_status":"done","queue_duration_s":0.701757,"scheduling_latency_s":0.701797,"redis_calls":13,"redis_duration_s":0.004903,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001514,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003389,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026601,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.038404,"completed_at":"2026-08-17T07:22:08.892Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1384gitlab # [ 239.423285] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:22:08.895Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"87924feb184d107ab22ca872","created_at":"2026-08-17T07:22:08.074Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-5f7b1aa69ee64994","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afb9d02de6dfa4d1ebc8be959e6c9ff9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:22:08.152Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-87924feb184d107ab22ca872: start","job_status":"start","queue_duration_s":0.74272,"scheduling_latency_s":0.742751}1385gitlab # [ 239.435853] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:22:08.921Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"87924feb184d107ab22ca872","created_at":"2026-08-17T07:22:08.074Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-5f7b1aa69ee64994","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afb9d02de6dfa4d1ebc8be959e6c9ff9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:22:08.152Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-87924feb184d107ab22ca872: done: 0.026498 sec","job_status":"done","queue_duration_s":0.74272,"scheduling_latency_s":0.742751,"redis_calls":13,"redis_duration_s":0.0037089999999999996,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001289,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00242,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017714,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.026498,"completed_at":"2026-08-17T07:22:08.921Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1386gitlab # [ 239.476733] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:22:08.923Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"28dc8d8368daf92fc2a5a65f","created_at":"2026-08-17T07:22:08.074Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-5f7b1aa69ee64994","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afb9d02de6dfa4d1ebc8be959e6c9ff9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:22:08.152Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-28dc8d8368daf92fc2a5a65f: start","job_status":"start","queue_duration_s":0.771164,"scheduling_latency_s":0.771187}1387gitlab # [ 239.489147] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:22:08.943Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"28dc8d8368daf92fc2a5a65f","created_at":"2026-08-17T07:22:08.074Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-5f7b1aa69ee64994","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afb9d02de6dfa4d1ebc8be959e6c9ff9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:22:08.152Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-28dc8d8368daf92fc2a5a65f: done: 0.019714 sec","job_status":"done","queue_duration_s":0.771164,"scheduling_latency_s":0.771187,"redis_calls":13,"redis_duration_s":0.0029389999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00107,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001869,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01282,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019714,"completed_at":"2026-08-17T07:22:08.943Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1388gitlab # [ 239.528755] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:22:08.945Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3cdae43b6406433f7b610a9a","created_at":"2026-08-17T07:22:08.074Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-5f7b1aa69ee64994","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afb9d02de6dfa4d1ebc8be959e6c9ff9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:22:08.152Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3cdae43b6406433f7b610a9a: start","job_status":"start","queue_duration_s":0.792435,"scheduling_latency_s":0.792452}1389gitlab # [ 239.541248] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:22:08.962Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3cdae43b6406433f7b610a9a","created_at":"2026-08-17T07:22:08.074Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-5f7b1aa69ee64994","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afb9d02de6dfa4d1ebc8be959e6c9ff9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:22:08.152Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3cdae43b6406433f7b610a9a: done: 0.016981 sec","job_status":"done","queue_duration_s":0.792435,"scheduling_latency_s":0.792452,"redis_calls":13,"redis_duration_s":0.002804,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000954,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00185,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010688,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016981,"completed_at":"2026-08-17T07:22:08.962Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1390gitlab # [ 239.580261] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:22:08.963Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0d4d8e0556d14879548db8d2","created_at":"2026-08-17T07:22:08.074Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-5f7b1aa69ee64994","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afb9d02de6dfa4d1ebc8be959e6c9ff9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:22:08.152Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0d4d8e0556d14879548db8d2: start","job_status":"start","queue_duration_s":0.810899,"scheduling_latency_s":0.810917}1391gitlab # [ 239.592967] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:22:08.979Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0d4d8e0556d14879548db8d2","created_at":"2026-08-17T07:22:08.074Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-5f7b1aa69ee64994","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afb9d02de6dfa4d1ebc8be959e6c9ff9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:22:08.152Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0d4d8e0556d14879548db8d2: done: 0.016034 sec","job_status":"done","queue_duration_s":0.810899,"scheduling_latency_s":0.810917,"redis_calls":13,"redis_duration_s":0.002888,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000955,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001933,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009867,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016034,"completed_at":"2026-08-17T07:22:08.979Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1392gitlab # [ 239.632238] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:22:08.981Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"79617742a83305b0a5b1c639","created_at":"2026-08-17T07:22:08.074Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-5f7b1aa69ee64994","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afb9d02de6dfa4d1ebc8be959e6c9ff9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:22:08.152Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-79617742a83305b0a5b1c639: start","job_status":"start","queue_duration_s":0.82841,"scheduling_latency_s":0.828426}1393gitlab # [ 239.645597] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:22:08.996Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"79617742a83305b0a5b1c639","created_at":"2026-08-17T07:22:08.074Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-5f7b1aa69ee64994","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afb9d02de6dfa4d1ebc8be959e6c9ff9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:22:08.152Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-79617742a83305b0a5b1c639: done: 0.0152 sec","job_status":"done","queue_duration_s":0.82841,"scheduling_latency_s":0.828426,"redis_calls":13,"redis_duration_s":0.002653,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000947,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001706,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009474,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.0152,"completed_at":"2026-08-17T07:22:08.996Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1394gitlab # [ 239.684449] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:22:08.997Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5ffdf8b351a3d034ad2e3d59","created_at":"2026-08-17T07:22:08.074Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-5f7b1aa69ee64994","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afb9d02de6dfa4d1ebc8be959e6c9ff9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:22:08.152Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5ffdf8b351a3d034ad2e3d59: start","job_status":"start","queue_duration_s":0.844949,"scheduling_latency_s":0.844966}1395gitlab # [ 239.696797] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:22:09.012Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5ffdf8b351a3d034ad2e3d59","created_at":"2026-08-17T07:22:08.074Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-5f7b1aa69ee64994","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afb9d02de6dfa4d1ebc8be959e6c9ff9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:22:08.152Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5ffdf8b351a3d034ad2e3d59: done: 0.014869 sec","job_status":"done","queue_duration_s":0.844949,"scheduling_latency_s":0.844966,"redis_calls":13,"redis_duration_s":0.002724,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000925,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001799,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009155,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014869,"completed_at":"2026-08-17T07:22:09.012Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1396gitlab # [ 239.736227] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:22:09.013Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"823ac29daef9176ebdf6ad3e","created_at":"2026-08-17T07:22:08.074Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-5f7b1aa69ee64994","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afb9d02de6dfa4d1ebc8be959e6c9ff9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:22:08.152Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-823ac29daef9176ebdf6ad3e: start","job_status":"start","queue_duration_s":0.861138,"scheduling_latency_s":0.861155}1397gitlab # [ 239.748777] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:22:09.028Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"823ac29daef9176ebdf6ad3e","created_at":"2026-08-17T07:22:08.074Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-5f7b1aa69ee64994","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afb9d02de6dfa4d1ebc8be959e6c9ff9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:22:08.152Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-823ac29daef9176ebdf6ad3e: done: 0.014738 sec","job_status":"done","queue_duration_s":0.861138,"scheduling_latency_s":0.861155,"redis_calls":13,"redis_duration_s":0.002686,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000926,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00176,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009092,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014738,"completed_at":"2026-08-17T07:22:09.028Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1398gitlab # [ 239.788344] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:22:09.029Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8c0098a5b2c83009736f9253","created_at":"2026-08-17T07:22:08.074Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-5f7b1aa69ee64994","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afb9d02de6dfa4d1ebc8be959e6c9ff9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:22:08.152Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8c0098a5b2c83009736f9253: start","job_status":"start","queue_duration_s":0.877231,"scheduling_latency_s":0.877247}1399gitlab # [ 239.800883] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:22:09.045Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8c0098a5b2c83009736f9253","created_at":"2026-08-17T07:22:08.074Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-5f7b1aa69ee64994","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afb9d02de6dfa4d1ebc8be959e6c9ff9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:22:08.152Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8c0098a5b2c83009736f9253: done: 0.015113 sec","job_status":"done","queue_duration_s":0.877231,"scheduling_latency_s":0.877247,"redis_calls":13,"redis_duration_s":0.002839,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000939,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.0019,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009265,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015113,"completed_at":"2026-08-17T07:22:09.044Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1400gitlab # [ 239.840699] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:22:09.046Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c071381851ccd7ec39db5554","created_at":"2026-08-17T07:22:08.074Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-5f7b1aa69ee64994","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afb9d02de6dfa4d1ebc8be959e6c9ff9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:22:08.152Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c071381851ccd7ec39db5554: start","job_status":"start","queue_duration_s":0.893857,"scheduling_latency_s":0.893872}1401gitlab # [ 239.854036] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:22:09.061Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c071381851ccd7ec39db5554","created_at":"2026-08-17T07:22:08.074Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-5f7b1aa69ee64994","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afb9d02de6dfa4d1ebc8be959e6c9ff9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:22:08.152Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c071381851ccd7ec39db5554: done: 0.015066 sec","job_status":"done","queue_duration_s":0.893857,"scheduling_latency_s":0.893872,"redis_calls":13,"redis_duration_s":0.0025930000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000921,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001672,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009655,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015066,"completed_at":"2026-08-17T07:22:09.061Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1402gitlab # [ 239.893288] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:22:09.063Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6b4686494fc554af3415049b","created_at":"2026-08-17T07:22:08.074Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-5f7b1aa69ee64994","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afb9d02de6dfa4d1ebc8be959e6c9ff9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:22:08.152Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6b4686494fc554af3415049b: start","job_status":"start","queue_duration_s":0.910496,"scheduling_latency_s":0.910512}1403gitlab # [ 239.905669] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:22:09.078Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6b4686494fc554af3415049b","created_at":"2026-08-17T07:22:08.074Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-5f7b1aa69ee64994","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afb9d02de6dfa4d1ebc8be959e6c9ff9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:22:08.152Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6b4686494fc554af3415049b: done: 0.015305 sec","job_status":"done","queue_duration_s":0.910496,"scheduling_latency_s":0.910512,"redis_calls":13,"redis_duration_s":0.002892,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001124,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001768,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009795,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015305,"completed_at":"2026-08-17T07:22:09.078Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1404gitlab # [ 239.944569] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:22:09.080Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e75204e299f70c8831042b19","created_at":"2026-08-17T07:22:08.074Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-5f7b1aa69ee64994","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afb9d02de6dfa4d1ebc8be959e6c9ff9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:22:08.152Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e75204e299f70c8831042b19: start","job_status":"start","queue_duration_s":0.927845,"scheduling_latency_s":0.927863}1405gitlab # [ 239.956669] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:22:09.096Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e75204e299f70c8831042b19","created_at":"2026-08-17T07:22:08.074Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-5f7b1aa69ee64994","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afb9d02de6dfa4d1ebc8be959e6c9ff9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:22:08.152Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e75204e299f70c8831042b19: done: 0.015613 sec","job_status":"done","queue_duration_s":0.927845,"scheduling_latency_s":0.927863,"redis_calls":13,"redis_duration_s":0.003112,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000979,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002133,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009797,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015613,"completed_at":"2026-08-17T07:22:09.096Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1406gitlab # [ 239.995689] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:22:09.097Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"42c89b7b4a345314cc4644c6","created_at":"2026-08-17T07:22:08.074Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-5f7b1aa69ee64994","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afb9d02de6dfa4d1ebc8be959e6c9ff9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:22:08.152Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-42c89b7b4a345314cc4644c6: start","job_status":"start","queue_duration_s":0.944992,"scheduling_latency_s":0.945007}1407gitlab # [ 240.008314] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:22:09.112Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"42c89b7b4a345314cc4644c6","created_at":"2026-08-17T07:22:08.074Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-5f7b1aa69ee64994","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afb9d02de6dfa4d1ebc8be959e6c9ff9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:22:08.152Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-42c89b7b4a345314cc4644c6: done: 0.01525 sec","job_status":"done","queue_duration_s":0.944992,"scheduling_latency_s":0.945007,"redis_calls":13,"redis_duration_s":0.002815,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000958,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001857,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009645,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01525,"completed_at":"2026-08-17T07:22:09.112Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1408gitlab # [ 240.047087] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:22:09.114Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c1583906f6be837522091a41","created_at":"2026-08-17T07:22:08.074Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-5f7b1aa69ee64994","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afb9d02de6dfa4d1ebc8be959e6c9ff9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:22:08.152Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c1583906f6be837522091a41: start","job_status":"start","queue_duration_s":0.96163,"scheduling_latency_s":0.961647}1409gitlab # [ 240.060530] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:22:09.129Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c1583906f6be837522091a41","created_at":"2026-08-17T07:22:08.074Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-5f7b1aa69ee64994","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afb9d02de6dfa4d1ebc8be959e6c9ff9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:22:08.152Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c1583906f6be837522091a41: done: 0.015057 sec","job_status":"done","queue_duration_s":0.96163,"scheduling_latency_s":0.961647,"redis_calls":13,"redis_duration_s":0.002614,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00091,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001704,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00946,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015057,"completed_at":"2026-08-17T07:22:09.129Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1410gitlab # [ 240.099545] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:22:09.130Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fc610c6a3f6502998fd00f21","created_at":"2026-08-17T07:22:08.074Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-5f7b1aa69ee64994","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afb9d02de6dfa4d1ebc8be959e6c9ff9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:22:08.152Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fc610c6a3f6502998fd00f21: start","job_status":"start","queue_duration_s":0.977966,"scheduling_latency_s":0.977984}1411gitlab # [ 240.112134] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:22:09.146Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fc610c6a3f6502998fd00f21","created_at":"2026-08-17T07:22:08.074Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-5f7b1aa69ee64994","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afb9d02de6dfa4d1ebc8be959e6c9ff9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:22:08.152Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fc610c6a3f6502998fd00f21: done: 0.015464 sec","job_status":"done","queue_duration_s":0.977966,"scheduling_latency_s":0.977984,"redis_calls":13,"redis_duration_s":0.002692,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000948,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001744,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009788,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015464,"completed_at":"2026-08-17T07:22:09.146Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1412gitlab # [ 240.151032] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:22:09.147Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7e5fcd478e519713628684a4","created_at":"2026-08-17T07:22:08.074Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-5f7b1aa69ee64994","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afb9d02de6dfa4d1ebc8be959e6c9ff9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:22:08.152Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7e5fcd478e519713628684a4: start","job_status":"start","queue_duration_s":0.994697,"scheduling_latency_s":0.994713}1413gitlab # [ 240.163289] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:22:09.162Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7e5fcd478e519713628684a4","created_at":"2026-08-17T07:22:08.074Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-5f7b1aa69ee64994","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afb9d02de6dfa4d1ebc8be959e6c9ff9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:22:08.152Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7e5fcd478e519713628684a4: done: 0.015541 sec","job_status":"done","queue_duration_s":0.994697,"scheduling_latency_s":0.994713,"redis_calls":13,"redis_duration_s":0.002781,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000924,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001857,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009551,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015541,"completed_at":"2026-08-17T07:22:09.162Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1414gitlab # [ 269.486051] setup-gitlab-start[2929]: W, [2026-08-17T07:22:40.259373 #2929] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1415gitlab # [ 292.742302] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:23:03.515Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::PipelineArtifacts::ExpireArtifactsWorker","jid":"0119ec28acbda01301f4e81f","created_at":"2026-08-17T07:23:03.489Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-c124a74e028d48d7","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"916681dda919cb99bc9c7b32d8525223","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:35dc78c13bdf78a98c09fc2795030a4961be87ad882288b77a6a3c9be677e4d5","size_limiter":"validated","enqueued_at":"2026-08-17T07:23:03.511Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::ExpireArtifactsWorker JID-0119ec28acbda01301f4e81f: start","job_status":"start","queue_duration_s":0.002994,"scheduling_latency_s":0.003039}1416gitlab # [ 293.008769] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:23:03.781Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::PipelineArtifacts::ExpireArtifactsWorker","jid":"0119ec28acbda01301f4e81f","created_at":"2026-08-17T07:23:03.489Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-c124a74e028d48d7","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"916681dda919cb99bc9c7b32d8525223","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:35dc78c13bdf78a98c09fc2795030a4961be87ad882288b77a6a3c9be677e4d5","size_limiter":"validated","enqueued_at":"2026-08-17T07:23:03.511Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::ExpireArtifactsWorker JID-0119ec28acbda01301f4e81f: done: 0.266995 sec","job_status":"done","queue_duration_s":0.002994,"scheduling_latency_s":0.003039,"redis_calls":19,"redis_duration_s":0.036564,"redis_read_bytes":907,"redis_write_bytes":1930,"redis_feature_flag_calls":9,"redis_feature_flag_duration_s":0.018443,"redis_feature_flag_read_bytes":898,"redis_feature_flag_write_bytes":780,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.009075,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.009046,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":548,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.014,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.011,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.071637,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.0066632,"exclusive_lock_hold_duration_s":0.15431704,"extra.ci_pipeline_artifacts_expire_artifacts_worker.destroyed_pipeline_artifacts_count":0,"duration_s":0.266995,"completed_at":"2026-08-17T07:23:03.781Z","load_balancing_strategy":"primary","db_duration_s":0.071298,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1417gitlab # [ 293.089078] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:23:03.805Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"bd6809a42728db2bf7cf8428","created_at":"2026-08-17T07:23:03.533Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-c124a74e028d48d7","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9c3c6af8679ce8a84a2c75e2c97a7388","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-17T07:23:03.546Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-bd6809a42728db2bf7cf8428: start","job_status":"start","queue_duration_s":0.258283,"scheduling_latency_s":0.258334}1418gitlab # [ 293.195750] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:23:03.969Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"bd6809a42728db2bf7cf8428","created_at":"2026-08-17T07:23:03.533Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-c124a74e028d48d7","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9c3c6af8679ce8a84a2c75e2c97a7388","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-17T07:23:03.546Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-bd6809a42728db2bf7cf8428: done: 0.163966 sec","job_status":"done","queue_duration_s":0.258283,"scheduling_latency_s":0.258334,"redis_calls":7,"redis_duration_s":0.019958999999999998,"redis_read_bytes":5,"redis_write_bytes":681,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.013531,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":473,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.006428,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":208,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.07,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.07,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.028673,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.163966,"completed_at":"2026-08-17T07:23:03.968Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.070027,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1419gitlab # [ 293.300244] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:23:03.983Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"aef1dac791d439473a7b8cd8","created_at":"2026-08-17T07:23:03.581Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-c124a74e028d48d7","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"cfcf3e4adcae56db25162999222a9f1a","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-17T07:23:03.598Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-aef1dac791d439473a7b8cd8: start","job_status":"start","queue_duration_s":0.38522,"scheduling_latency_s":0.385272}1420gitlab # [ 293.327752] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:23:04.050Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"aef1dac791d439473a7b8cd8","created_at":"2026-08-17T07:23:03.581Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-c124a74e028d48d7","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"cfcf3e4adcae56db25162999222a9f1a","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-17T07:23:03.598Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-aef1dac791d439473a7b8cd8: done: 0.066586 sec","job_status":"done","queue_duration_s":0.38522,"scheduling_latency_s":0.385272,"redis_calls":8,"redis_duration_s":0.005137999999999999,"redis_read_bytes":133,"redis_write_bytes":901,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000332,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":70,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.004023,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":563,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000783,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":268,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024869,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.066586,"completed_at":"2026-08-17T07:23:04.050Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1421gitlab # [ 293.383920] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:23:04.052Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"dcfa9aa87e4487c29bfaaeec","created_at":"2026-08-17T07:23:03.609Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-c124a74e028d48d7","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7a7ffcb848460578275a2b440b39c2cd","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-17T07:23:03.616Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-dcfa9aa87e4487c29bfaaeec: start","job_status":"start","queue_duration_s":0.435361,"scheduling_latency_s":0.435389}1422gitlab # [ 293.398611] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:23:04.079Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"dcfa9aa87e4487c29bfaaeec","created_at":"2026-08-17T07:23:03.609Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-c124a74e028d48d7","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7a7ffcb848460578275a2b440b39c2cd","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-17T07:23:03.616Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-dcfa9aa87e4487c29bfaaeec: done: 0.027572 sec","job_status":"done","queue_duration_s":0.435361,"scheduling_latency_s":0.435389,"redis_calls":7,"redis_duration_s":0.001402,"redis_read_bytes":5,"redis_write_bytes":776,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001057,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000345,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":246,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010827,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.027572,"completed_at":"2026-08-17T07:23:04.079Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1423gitlab # [ 293.440371] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:23:04.081Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"4e3384143ab4e308c47035d7","created_at":"2026-08-17T07:23:03.623Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-c124a74e028d48d7","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2ef847ba4a9ccf764219f386071c7720","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-17T07:23:03.629Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-4e3384143ab4e308c47035d7: start","job_status":"start","queue_duration_s":0.451378,"scheduling_latency_s":0.451401}1424gitlab # [ 293.454054] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:23:04.090Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0}1425gitlab # [ 293.457875] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:23:04.098Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"4e3384143ab4e308c47035d7","created_at":"2026-08-17T07:23:03.623Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-c124a74e028d48d7","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2ef847ba4a9ccf764219f386071c7720","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-17T07:23:03.629Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-4e3384143ab4e308c47035d7: done: 0.017126 sec","job_status":"done","queue_duration_s":0.451378,"scheduling_latency_s":0.451401,"redis_calls":7,"redis_duration_s":0.001236,"redis_read_bytes":5,"redis_write_bytes":801,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00089,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":545,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000346,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":256,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010259,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017126,"completed_at":"2026-08-17T07:23:04.098Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1426gitlab # [ 293.497614] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:23:04.099Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"c98991588a7a36d3fb2340ae","created_at":"2026-08-17T07:23:03.644Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-c124a74e028d48d7","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fa1d3639f2df20434e40bbba4e96e1e3","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-08-17T07:23:03.668Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-c98991588a7a36d3fb2340ae: start","job_status":"start","queue_duration_s":0.430618,"scheduling_latency_s":0.430641}1427gitlab # [ 293.512259] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:23:04.172Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"c98991588a7a36d3fb2340ae","created_at":"2026-08-17T07:23:03.644Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-c124a74e028d48d7","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fa1d3639f2df20434e40bbba4e96e1e3","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-08-17T07:23:03.668Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-c98991588a7a36d3fb2340ae: done: 0.072633 sec","job_status":"done","queue_duration_s":0.430618,"scheduling_latency_s":0.430641,"redis_calls":14,"redis_duration_s":0.0020280000000000003,"redis_read_bytes":16,"redis_write_bytes":4030,"redis_queues_calls":2,"redis_queues_duration_s":0.000206,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3019,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.001378,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":727,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000444,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":284,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.029,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.029,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020798,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.072633,"completed_at":"2026-08-17T07:23:04.172Z","load_balancing_strategy":"primary","db_duration_s":0.028504,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1428gitlab # [ 293.553504] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:23:04.173Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"f508c91c98f50203a7b37982","created_at":"2026-08-17T07:23:03.684Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-c124a74e028d48d7","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"57bf63c205553e3e31eb011900e54eb1","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-17T07:23:03.690Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-f508c91c98f50203a7b37982: start","job_status":"start","queue_duration_s":0.482617,"scheduling_latency_s":0.482639}1429gitlab # [ 293.567083] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:23:04.180Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0}1430gitlab # [ 293.570579] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:23:04.202Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"f508c91c98f50203a7b37982","created_at":"2026-08-17T07:23:03.684Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-c124a74e028d48d7","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"57bf63c205553e3e31eb011900e54eb1","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-17T07:23:03.690Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-f508c91c98f50203a7b37982: done: 0.028873 sec","job_status":"done","queue_duration_s":0.482617,"scheduling_latency_s":0.482639,"redis_calls":7,"redis_duration_s":0.001009,"redis_read_bytes":5,"redis_write_bytes":806,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000709,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":548,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.0003,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":258,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024172,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.028873,"completed_at":"2026-08-17T07:23:04.202Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1431gitlab # [ 293.610421] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:23:04.203Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"6bc636a4178310b881934380","created_at":"2026-08-17T07:23:03.724Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-c124a74e028d48d7","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"61c12afaf886d47d1295459dcc0dc393","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-17T07:23:03.740Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-6bc636a4178310b881934380: start","job_status":"start","queue_duration_s":0.463405,"scheduling_latency_s":0.463425}1432gitlab # [ 293.625246] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:23:04.231Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"6bc636a4178310b881934380","created_at":"2026-08-17T07:23:03.724Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-c124a74e028d48d7","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"61c12afaf886d47d1295459dcc0dc393","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-17T07:23:03.740Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-6bc636a4178310b881934380: done: 0.027647 sec","job_status":"done","queue_duration_s":0.463405,"scheduling_latency_s":0.463425,"redis_calls":10,"redis_duration_s":0.002436,"redis_read_bytes":8,"redis_write_bytes":1239,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001432,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":636,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001004,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":603,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015178,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.01125602,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.027647,"completed_at":"2026-08-17T07:23:04.231Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007342,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1433gitlab # [ 293.668465] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:23:04.232Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"d6e3cbe86e6b5a75493f4883","created_at":"2026-08-17T07:23:03.758Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-c124a74e028d48d7","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4a2109794d11bf52efbe199506673c8c","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-17T07:23:03.775Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-d6e3cbe86e6b5a75493f4883: start","job_status":"start","queue_duration_s":0.457847,"scheduling_latency_s":0.457867}1434gitlab # [ 293.683436] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:23:04.293Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"d6e3cbe86e6b5a75493f4883","created_at":"2026-08-17T07:23:03.758Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-c124a74e028d48d7","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4a2109794d11bf52efbe199506673c8c","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-17T07:23:03.775Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-d6e3cbe86e6b5a75493f4883: done: 0.060837 sec","job_status":"done","queue_duration_s":0.457847,"scheduling_latency_s":0.457867,"redis_calls":9,"redis_duration_s":0.0028009999999999997,"redis_read_bytes":7,"redis_write_bytes":1169,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001369,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001432,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":615,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.032,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.032,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021205,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00083586,"exclusive_lock_hold_duration_s":0.0256965,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.060837,"completed_at":"2026-08-17T07:23:04.293Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.033567,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1435gitlab # [ 293.728263] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:23:04.295Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"7a0016250e255604c07a80ce","created_at":"2026-08-17T07:23:03.797Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-c124a74e028d48d7","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"aaea7b87c60eb7d499d653ff0aa2f707","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-17T07:23:03.803Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-7a0016250e255604c07a80ce: start","job_status":"start","queue_duration_s":0.491851,"scheduling_latency_s":0.491876}1436gitlab # [ 293.743105] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:23:04.317Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"7a0016250e255604c07a80ce","created_at":"2026-08-17T07:23:03.797Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-c124a74e028d48d7","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"aaea7b87c60eb7d499d653ff0aa2f707","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-17T07:23:03.803Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-7a0016250e255604c07a80ce: done: 0.021298 sec","job_status":"done","queue_duration_s":0.491851,"scheduling_latency_s":0.491876,"redis_calls":9,"redis_duration_s":0.002564,"redis_read_bytes":7,"redis_write_bytes":1087,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001352,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001212,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":566,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013026,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00065638,"exclusive_lock_hold_duration_s":0.00372244,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.021298,"completed_at":"2026-08-17T07:23:04.316Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001746,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1437gitlab # [ 293.786026] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:23:04.318Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"fc19ce57237cc64a837a5b15","created_at":"2026-08-17T07:23:03.827Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-c124a74e028d48d7","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1434015dc00bdd92907b355a9dcc5234","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-17T07:23:03.838Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-fc19ce57237cc64a837a5b15: start","job_status":"start","queue_duration_s":0.480805,"scheduling_latency_s":0.480831}1438gitlab # [ 293.801013] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:23:04.329Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0}1439gitlab # [ 293.804396] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:23:04.335Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"fc19ce57237cc64a837a5b15","created_at":"2026-08-17T07:23:03.827Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-c124a74e028d48d7","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1434015dc00bdd92907b355a9dcc5234","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-17T07:23:03.838Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-fc19ce57237cc64a837a5b15: done: 0.016528 sec","job_status":"done","queue_duration_s":0.480805,"scheduling_latency_s":0.480831,"redis_calls":7,"redis_duration_s":0.0031669999999999997,"redis_read_bytes":5,"redis_write_bytes":826,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002244,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000923,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009954,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016528,"completed_at":"2026-08-17T07:23:04.335Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1440gitlab # [ 293.845538] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:23:04.337Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"90b3acb6d783f517df3eea0f","created_at":"2026-08-17T07:23:03.854Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-c124a74e028d48d7","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"eeb27549c4ddae0f81873b9f172ddb9c","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-17T07:23:03.860Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-90b3acb6d783f517df3eea0f: start","job_status":"start","queue_duration_s":0.476776,"scheduling_latency_s":0.476794}1441gitlab # [ 293.860269] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:23:04.375Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"90b3acb6d783f517df3eea0f","created_at":"2026-08-17T07:23:03.854Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-c124a74e028d48d7","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"eeb27549c4ddae0f81873b9f172ddb9c","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-17T07:23:03.860Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-90b3acb6d783f517df3eea0f: done: 0.038208 sec","job_status":"done","queue_duration_s":0.476776,"scheduling_latency_s":0.476794,"redis_calls":9,"redis_duration_s":0.0023179999999999997,"redis_read_bytes":7,"redis_write_bytes":1162,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001219,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":551,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001099,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":611,"db_count":6,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.011,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021879,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00062342,"exclusive_lock_hold_duration_s":0.02163368,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.038208,"completed_at":"2026-08-17T07:23:04.375Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.011577,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1442gitlab # [ 293.904052] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:23:04.376Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"2499c8906f676673d2addff7","created_at":"2026-08-17T07:23:03.876Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-c124a74e028d48d7","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"57ea3aa391414f18815cae448534081b","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-17T07:23:03.881Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-2499c8906f676673d2addff7: start","job_status":"start","queue_duration_s":0.49545,"scheduling_latency_s":0.495465}1443gitlab # [ 293.918412] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:23:04.395Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"2499c8906f676673d2addff7","created_at":"2026-08-17T07:23:03.876Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-c124a74e028d48d7","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"57ea3aa391414f18815cae448534081b","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-17T07:23:03.881Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-2499c8906f676673d2addff7: done: 0.018596 sec","job_status":"done","queue_duration_s":0.49545,"scheduling_latency_s":0.495465,"redis_calls":9,"redis_duration_s":0.0023610000000000003,"redis_read_bytes":7,"redis_write_bytes":1072,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001227,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001134,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":560,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011484,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.0005738,"exclusive_lock_hold_duration_s":0.00457616,"duration_s":0.018596,"completed_at":"2026-08-17T07:23:04.395Z","load_balancing_strategy":"primary","db_duration_s":0.001602,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1444gitlab # [ 293.959683] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:23:04.396Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"c6204841475b190a18c8af77","created_at":"2026-08-17T07:23:03.900Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-c124a74e028d48d7","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c3eb568bd2f1edf8b14a2c1f1a8ff655","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-17T07:23:03.904Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-c6204841475b190a18c8af77: start","job_status":"start","queue_duration_s":0.49208,"scheduling_latency_s":0.492095}1445gitlab # [ 293.974967] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:23:04.430Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"c6204841475b190a18c8af77","created_at":"2026-08-17T07:23:03.900Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-c124a74e028d48d7","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c3eb568bd2f1edf8b14a2c1f1a8ff655","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-17T07:23:03.904Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-c6204841475b190a18c8af77: done: 0.034235 sec","job_status":"done","queue_duration_s":0.49208,"scheduling_latency_s":0.492095,"redis_calls":7,"redis_duration_s":0.002001,"redis_read_bytes":5,"redis_write_bytes":826,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001478,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000523,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.016,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.016,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012809,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.034235,"completed_at":"2026-08-17T07:23:04.430Z","load_balancing_strategy":"primary","db_duration_s":0.016206,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1446gitlab # [ 294.016353] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:23:04.432Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"5adaeab514630f035c4abba8","created_at":"2026-08-17T07:23:03.914Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-c124a74e028d48d7","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4d169cd7d3b6335c31e8710df90a515c","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-17T07:23:03.924Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-5adaeab514630f035c4abba8: start","job_status":"start","queue_duration_s":0.508587,"scheduling_latency_s":0.508603}1447gitlab # [ 294.030701] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:23:04.441Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0}1448gitlab # [ 294.034397] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:23:04.447Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"5adaeab514630f035c4abba8","created_at":"2026-08-17T07:23:03.914Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-c124a74e028d48d7","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4d169cd7d3b6335c31e8710df90a515c","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-17T07:23:03.924Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-5adaeab514630f035c4abba8: done: 0.014533 sec","job_status":"done","queue_duration_s":0.508587,"scheduling_latency_s":0.508603,"redis_calls":7,"redis_duration_s":0.0017079999999999999,"redis_read_bytes":5,"redis_write_bytes":766,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001215,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":524,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000493,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":242,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009244,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.014533,"completed_at":"2026-08-17T07:23:04.447Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1449gitlab # [ 294.075130] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:23:04.448Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"90f2b8729fbac9036bdeda50","created_at":"2026-08-17T07:23:03.955Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-c124a74e028d48d7","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"12326d1d42662c5f94bdaf2c364d8d3c","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-17T07:23:03.963Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-90f2b8729fbac9036bdeda50: start","job_status":"start","queue_duration_s":0.484759,"scheduling_latency_s":0.484775}1450gitlab # [ 294.089432] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:23:04.472Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"90f2b8729fbac9036bdeda50","created_at":"2026-08-17T07:23:03.955Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-c124a74e028d48d7","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"12326d1d42662c5f94bdaf2c364d8d3c","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-17T07:23:03.963Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-90f2b8729fbac9036bdeda50: done: 0.024253 sec","job_status":"done","queue_duration_s":0.484759,"scheduling_latency_s":0.484775,"redis_calls":7,"redis_duration_s":0.0019399999999999999,"redis_read_bytes":5,"redis_write_bytes":711,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001387,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":491,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000553,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":220,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011977,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.024253,"completed_at":"2026-08-17T07:23:04.472Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006295,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1451gitlab # [ 294.130563] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:23:04.475Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"2306fab4d2a91099fb890290","created_at":"2026-08-17T07:23:03.974Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-c124a74e028d48d7","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6a14a0b1bbc40b85ed60a9712d603081","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-17T07:23:03.979Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-2306fab4d2a91099fb890290: start","job_status":"start","queue_duration_s":0.496156,"scheduling_latency_s":0.496172}1452gitlab # [ 294.144781] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:23:04.712Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"2306fab4d2a91099fb890290","created_at":"2026-08-17T07:23:03.974Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-c124a74e028d48d7","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6a14a0b1bbc40b85ed60a9712d603081","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-17T07:23:03.979Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-2306fab4d2a91099fb890290: done: 0.236965 sec","job_status":"done","queue_duration_s":0.496156,"scheduling_latency_s":0.496172,"redis_calls":9,"redis_duration_s":0.007487,"redis_read_bytes":7,"redis_write_bytes":987,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.006009,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":476,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001478,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":511,"db_count":129,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":129,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.027,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":129,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":84,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.027,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.201928,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.0006184,"exclusive_lock_hold_duration_s":0.2152246,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"ci","turbo_mode":false},"duration_s":0.236965,"completed_at":"2026-08-17T07:23:04.712Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.038467,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1453gitlab # [ 294.188033] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:23:04.714Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"22da557e035ac4f3bd44f776","created_at":"2026-08-17T07:23:04.027Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-c124a74e028d48d7","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"169c718cdad27cf560085e5eef549d92","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-17T07:23:04.032Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-22da557e035ac4f3bd44f776: start","job_status":"start","queue_duration_s":0.681165,"scheduling_latency_s":0.681183}1454gitlab # [ 294.331976] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:23:05.105Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"22da557e035ac4f3bd44f776","created_at":"2026-08-17T07:23:04.027Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-c124a74e028d48d7","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"169c718cdad27cf560085e5eef549d92","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-17T07:23:04.032Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-22da557e035ac4f3bd44f776: done: 0.391976 sec","job_status":"done","queue_duration_s":0.681165,"scheduling_latency_s":0.681183,"redis_calls":562,"redis_duration_s":0.09521700000000001,"redis_read_bytes":560,"redis_write_bytes":48760,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001089,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":470,"redis_shared_state_calls":557,"redis_shared_state_duration_s":0.094128,"redis_shared_state_read_bytes":556,"redis_shared_state_write_bytes":48290,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.344806,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.391976,"completed_at":"2026-08-17T07:23:05.105Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1455gitlab # [ 294.398597] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:23:05.107Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"c831303e5a5bbb784410a21a","created_at":"2026-08-17T07:23:04.048Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-c124a74e028d48d7","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"deb101f708e75d8a385b31a9ce4c6684","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-17T07:23:04.055Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-c831303e5a5bbb784410a21a: start","job_status":"start","queue_duration_s":1.052018,"scheduling_latency_s":1.052041}1456gitlab # [ 294.414849] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:23:05.116Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0}1457gitlab # [ 294.418828] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:23:05.121Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"c831303e5a5bbb784410a21a","created_at":"2026-08-17T07:23:04.048Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-c124a74e028d48d7","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"deb101f708e75d8a385b31a9ce4c6684","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-17T07:23:04.055Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-c831303e5a5bbb784410a21a: done: 0.014281 sec","job_status":"done","queue_duration_s":1.052018,"scheduling_latency_s":1.052041,"redis_calls":7,"redis_duration_s":0.000996,"redis_read_bytes":5,"redis_write_bytes":821,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000717,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":557,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000279,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":264,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008236,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.014281,"completed_at":"2026-08-17T07:23:05.121Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1458gitlab # [ 294.459223] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:23:05.123Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"PipelineScheduleWorker","jid":"047236083d3f5b1d1387437c","created_at":"2026-08-17T07:23:04.058Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-c124a74e028d48d7","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e321173bb49c13be6726e67e8c3e6123","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f6baa6e6d21754c4b13358fe49f8c31a08729a9dd276fb680a810caf1bc7fab5","size_limiter":"validated","enqueued_at":"2026-08-17T07:23:04.115Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineScheduleWorker JID-047236083d3f5b1d1387437c: start","job_status":"start","queue_duration_s":1.00783,"scheduling_latency_s":1.007847}1459gitlab # [ 294.472429] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:23:05.155Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"PipelineScheduleWorker","jid":"047236083d3f5b1d1387437c","created_at":"2026-08-17T07:23:04.058Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-c124a74e028d48d7","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e321173bb49c13be6726e67e8c3e6123","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f6baa6e6d21754c4b13358fe49f8c31a08729a9dd276fb680a810caf1bc7fab5","size_limiter":"validated","enqueued_at":"2026-08-17T07:23:04.115Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineScheduleWorker JID-047236083d3f5b1d1387437c: done: 0.032162 sec","job_status":"done","queue_duration_s":1.00783,"scheduling_latency_s":1.007847,"redis_calls":12,"redis_duration_s":0.001773,"redis_read_bytes":11,"redis_write_bytes":1281,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00032,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":287,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000761,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":518,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000692,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":476,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020365,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00052728,"exclusive_lock_hold_duration_s":0.01124348,"duration_s":0.032162,"completed_at":"2026-08-17T07:23:05.155Z","load_balancing_strategy":"primary","db_duration_s":0.004406,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1460gitlab # [ 294.513319] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:23:05.156Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"38e230821d8ae9c7e02b7cb5","created_at":"2026-08-17T07:23:04.119Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-c124a74e028d48d7","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"400c9c62788c0324cbac26deb2944cb1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-17T07:23:04.121Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-38e230821d8ae9c7e02b7cb5: start","job_status":"start","queue_duration_s":1.035188,"scheduling_latency_s":1.035204}1461gitlab # [ 294.526842] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:23:05.271Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"38e230821d8ae9c7e02b7cb5","created_at":"2026-08-17T07:23:04.119Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-c124a74e028d48d7","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"400c9c62788c0324cbac26deb2944cb1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-17T07:23:04.121Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-38e230821d8ae9c7e02b7cb5: done: 0.114726 sec","job_status":"done","queue_duration_s":1.035188,"scheduling_latency_s":1.035204,"redis_calls":60,"redis_duration_s":0.009318,"redis_read_bytes":108,"redis_write_bytes":41109,"redis_queues_calls":2,"redis_queues_duration_s":0.000534,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37485,"redis_queues_metadata_calls":55,"redis_queues_metadata_duration_s":0.008368,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3324,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000416,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":300,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.011,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.095099,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.114726,"completed_at":"2026-08-17T07:23:05.271Z","load_balancing_strategy":"primary","db_duration_s":0.010877,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1462gitlab # [ 294.568578] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:23:05.272Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"49b30aa212d85248ab2f11cd","created_at":"2026-08-17T07:23:04.132Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-c124a74e028d48d7","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"48322ac79a148237c9e74ed840639573","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-17T07:23:04.134Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-49b30aa212d85248ab2f11cd: start","job_status":"start","queue_duration_s":1.137803,"scheduling_latency_s":1.137822}1463gitlab # [ 294.582821] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:23:05.279Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0}1464gitlab # [ 294.586081] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:23:05.286Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"49b30aa212d85248ab2f11cd","created_at":"2026-08-17T07:23:04.132Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-c124a74e028d48d7","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"48322ac79a148237c9e74ed840639573","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-17T07:23:04.134Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-49b30aa212d85248ab2f11cd: done: 0.013451 sec","job_status":"done","queue_duration_s":1.137803,"scheduling_latency_s":1.137822,"redis_calls":7,"redis_duration_s":0.00103,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000739,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000291,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008896,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013451,"completed_at":"2026-08-17T07:23:05.286Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1465gitlab # [ 294.626548] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:23:05.287Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"c9a0b6b83ee95de32a2d88d6","created_at":"2026-08-17T07:23:04.137Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-c124a74e028d48d7","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e4e2c1e31d44f96357147d29629c31cc","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-17T07:23:04.146Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-c9a0b6b83ee95de32a2d88d6: start","job_status":"start","queue_duration_s":1.140555,"scheduling_latency_s":1.140571}1466gitlab # [ 294.639845] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:23:05.310Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"c9a0b6b83ee95de32a2d88d6","created_at":"2026-08-17T07:23:04.137Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-c124a74e028d48d7","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e4e2c1e31d44f96357147d29629c31cc","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-17T07:23:04.146Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-c9a0b6b83ee95de32a2d88d6: done: 0.022824 sec","job_status":"done","queue_duration_s":1.140555,"scheduling_latency_s":1.140571,"redis_calls":7,"redis_duration_s":0.001008,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000728,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00028,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01502,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.022824,"completed_at":"2026-08-17T07:23:05.310Z","load_balancing_strategy":"primary","db_duration_s":0.003578,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1467gitlab # [ 294.678950] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:23:05.311Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"db6755f46398930a05afada1","created_at":"2026-08-17T07:23:04.138Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-5f46687faeac4bad","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"fa1d3639f2df20434e40bbba4e96e1e3","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:23:04.166Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-db6755f46398930a05afada1: start","job_status":"start","queue_duration_s":1.144489,"scheduling_latency_s":1.144506}1468gitlab # [ 294.691417] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:23:05.322Z","message":"No existing merge request to be cleaned up."}1469gitlab # [ 294.693205] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:23:05.331Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"db6755f46398930a05afada1","created_at":"2026-08-17T07:23:04.138Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-5f46687faeac4bad","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"fa1d3639f2df20434e40bbba4e96e1e3","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:23:04.166Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-db6755f46398930a05afada1: done: 0.02001 sec","job_status":"done","queue_duration_s":1.144489,"scheduling_latency_s":1.144506,"redis_calls":10,"redis_duration_s":0.00139,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00057,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.00082,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013407,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.02001,"completed_at":"2026-08-17T07:23:05.331Z","load_balancing_strategy":"primary","db_duration_s":0.002994,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1470gitlab # [ 294.731524] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:23:05.332Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"761e98a3cc568f6f9d757660","created_at":"2026-08-17T07:23:04.138Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-5f46687faeac4bad","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"fa1d3639f2df20434e40bbba4e96e1e3","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:23:04.166Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-761e98a3cc568f6f9d757660: start","job_status":"start","queue_duration_s":1.165647,"scheduling_latency_s":1.165663}1471gitlab # [ 294.745324] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:23:05.343Z","message":"No existing merge request to be cleaned up."}1472gitlab # [ 294.746969] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:23:05.351Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"761e98a3cc568f6f9d757660","created_at":"2026-08-17T07:23:04.138Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-5f46687faeac4bad","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"fa1d3639f2df20434e40bbba4e96e1e3","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:23:04.166Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-761e98a3cc568f6f9d757660: done: 0.019176 sec","job_status":"done","queue_duration_s":1.165647,"scheduling_latency_s":1.165663,"redis_calls":10,"redis_duration_s":0.0016350000000000002,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000805,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.00083,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012938,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019176,"completed_at":"2026-08-17T07:23:05.351Z","load_balancing_strategy":"primary","db_duration_s":0.002544,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1473gitlab # [ 294.785675] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:23:05.352Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"8df6883441f5db5eabb60555","created_at":"2026-08-17T07:23:04.138Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-5f46687faeac4bad","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"fa1d3639f2df20434e40bbba4e96e1e3","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:23:04.166Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-8df6883441f5db5eabb60555: start","job_status":"start","queue_duration_s":1.18595,"scheduling_latency_s":1.185965}1474gitlab # [ 294.797686] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:23:05.363Z","message":"No existing merge request to be cleaned up."}1475gitlab # [ 294.799310] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:23:05.371Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"8df6883441f5db5eabb60555","created_at":"2026-08-17T07:23:04.138Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-5f46687faeac4bad","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"fa1d3639f2df20434e40bbba4e96e1e3","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:23:04.166Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-8df6883441f5db5eabb60555: done: 0.018817 sec","job_status":"done","queue_duration_s":1.18595,"scheduling_latency_s":1.185965,"redis_calls":10,"redis_duration_s":0.0014,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000593,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000807,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012805,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018817,"completed_at":"2026-08-17T07:23:05.371Z","load_balancing_strategy":"primary","db_duration_s":0.002611,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1476gitlab # [ 294.837929] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:23:05.372Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"ba7f0513eaf2a02ac47ff26a","created_at":"2026-08-17T07:23:04.138Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-5f46687faeac4bad","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"fa1d3639f2df20434e40bbba4e96e1e3","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:23:04.166Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-ba7f0513eaf2a02ac47ff26a: start","job_status":"start","queue_duration_s":1.205893,"scheduling_latency_s":1.205909}1477gitlab # [ 294.850244] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:23:05.383Z","message":"No existing merge request to be cleaned up."}1478gitlab # [ 294.851872] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:23:05.391Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"ba7f0513eaf2a02ac47ff26a","created_at":"2026-08-17T07:23:04.138Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-5f46687faeac4bad","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"fa1d3639f2df20434e40bbba4e96e1e3","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:23:04.166Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-ba7f0513eaf2a02ac47ff26a: done: 0.019183 sec","job_status":"done","queue_duration_s":1.205893,"scheduling_latency_s":1.205909,"redis_calls":10,"redis_duration_s":0.001403,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00058,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000823,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013217,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019183,"completed_at":"2026-08-17T07:23:05.391Z","load_balancing_strategy":"primary","db_duration_s":0.00263,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1479gitlab # [ 294.890207] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:23:05.393Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"39ad547499cfa11a3edc655f","created_at":"2026-08-17T07:23:05.165Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-737a27e83da14645","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"400c9c62788c0324cbac26deb2944cb1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:23:05.263Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-39ad547499cfa11a3edc655f: start","job_status":"start","queue_duration_s":0.12936,"scheduling_latency_s":0.129377}1480gitlab # [ 294.902776] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:23:05.408Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"39ad547499cfa11a3edc655f","created_at":"2026-08-17T07:23:05.165Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-737a27e83da14645","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"400c9c62788c0324cbac26deb2944cb1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:23:05.263Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-39ad547499cfa11a3edc655f: done: 0.015743 sec","job_status":"done","queue_duration_s":0.12936,"scheduling_latency_s":0.129377,"redis_calls":13,"redis_duration_s":0.0016719999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00064,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001032,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010846,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015743,"completed_at":"2026-08-17T07:23:05.408Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1481gitlab # [ 294.942890] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:23:05.410Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b2f82821e628b91962ad79f8","created_at":"2026-08-17T07:23:05.165Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-737a27e83da14645","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"400c9c62788c0324cbac26deb2944cb1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:23:05.263Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b2f82821e628b91962ad79f8: start","job_status":"start","queue_duration_s":0.146322,"scheduling_latency_s":0.146338}1482gitlab # [ 294.955413] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:23:05.424Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b2f82821e628b91962ad79f8","created_at":"2026-08-17T07:23:05.165Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-737a27e83da14645","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"400c9c62788c0324cbac26deb2944cb1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:23:05.263Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b2f82821e628b91962ad79f8: done: 0.014278 sec","job_status":"done","queue_duration_s":0.146322,"scheduling_latency_s":0.146338,"redis_calls":13,"redis_duration_s":0.001547,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000559,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000988,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009866,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014278,"completed_at":"2026-08-17T07:23:05.424Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1483gitlab # [ 294.994649] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:23:05.425Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d91e6a21a25a653f830694d1","created_at":"2026-08-17T07:23:05.165Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-737a27e83da14645","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"400c9c62788c0324cbac26deb2944cb1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:23:05.263Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d91e6a21a25a653f830694d1: start","job_status":"start","queue_duration_s":0.161681,"scheduling_latency_s":0.161696}1484gitlab # [ 295.007172] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:23:05.439Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d91e6a21a25a653f830694d1","created_at":"2026-08-17T07:23:05.165Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-737a27e83da14645","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"400c9c62788c0324cbac26deb2944cb1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:23:05.263Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d91e6a21a25a653f830694d1: done: 0.014622 sec","job_status":"done","queue_duration_s":0.161681,"scheduling_latency_s":0.161696,"redis_calls":13,"redis_duration_s":0.001529,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000542,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000987,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009881,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014622,"completed_at":"2026-08-17T07:23:05.439Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1485gitlab # [ 295.046557] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:23:05.441Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9d3300346c02341f0f5b0524","created_at":"2026-08-17T07:23:05.165Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-737a27e83da14645","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"400c9c62788c0324cbac26deb2944cb1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:23:05.263Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9d3300346c02341f0f5b0524: start","job_status":"start","queue_duration_s":0.177418,"scheduling_latency_s":0.177434}1486gitlab # [ 295.058978] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:23:05.455Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9d3300346c02341f0f5b0524","created_at":"2026-08-17T07:23:05.165Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-737a27e83da14645","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"400c9c62788c0324cbac26deb2944cb1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:23:05.263Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9d3300346c02341f0f5b0524: done: 0.014233 sec","job_status":"done","queue_duration_s":0.177418,"scheduling_latency_s":0.177434,"redis_calls":13,"redis_duration_s":0.0014880000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00055,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000938,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009718,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014233,"completed_at":"2026-08-17T07:23:05.455Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1487gitlab # [ 295.098233] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:23:05.456Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"96f48cee0c87f34a264c66e1","created_at":"2026-08-17T07:23:05.165Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-737a27e83da14645","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"400c9c62788c0324cbac26deb2944cb1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:23:05.263Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-96f48cee0c87f34a264c66e1: start","job_status":"start","queue_duration_s":0.192819,"scheduling_latency_s":0.192887}1488gitlab # [ 295.110407] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:23:05.471Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"96f48cee0c87f34a264c66e1","created_at":"2026-08-17T07:23:05.165Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-737a27e83da14645","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"400c9c62788c0324cbac26deb2944cb1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:23:05.263Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-96f48cee0c87f34a264c66e1: done: 0.014688 sec","job_status":"done","queue_duration_s":0.192819,"scheduling_latency_s":0.192887,"redis_calls":13,"redis_duration_s":0.0015509999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00056,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000991,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010037,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014688,"completed_at":"2026-08-17T07:23:05.471Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1489gitlab # [ 295.150699] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:23:05.472Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"af4617232350215bacbd3aa8","created_at":"2026-08-17T07:23:05.165Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-737a27e83da14645","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"400c9c62788c0324cbac26deb2944cb1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:23:05.263Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-af4617232350215bacbd3aa8: start","job_status":"start","queue_duration_s":0.208649,"scheduling_latency_s":0.208666}1490gitlab # [ 295.163138] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:23:05.486Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"af4617232350215bacbd3aa8","created_at":"2026-08-17T07:23:05.165Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-737a27e83da14645","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"400c9c62788c0324cbac26deb2944cb1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:23:05.263Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-af4617232350215bacbd3aa8: done: 0.014197 sec","job_status":"done","queue_duration_s":0.208649,"scheduling_latency_s":0.208666,"redis_calls":13,"redis_duration_s":0.001482,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000533,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000949,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009743,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014197,"completed_at":"2026-08-17T07:23:05.486Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1491gitlab # [ 295.202009] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:23:05.487Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e51cc4011815a7b31cdaad1a","created_at":"2026-08-17T07:23:05.165Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-737a27e83da14645","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"400c9c62788c0324cbac26deb2944cb1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:23:05.263Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e51cc4011815a7b31cdaad1a: start","job_status":"start","queue_duration_s":0.224018,"scheduling_latency_s":0.224037}1492gitlab # [ 295.214468] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:23:05.501Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e51cc4011815a7b31cdaad1a","created_at":"2026-08-17T07:23:05.165Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-737a27e83da14645","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"400c9c62788c0324cbac26deb2944cb1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:23:05.263Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e51cc4011815a7b31cdaad1a: done: 0.014276 sec","job_status":"done","queue_duration_s":0.224018,"scheduling_latency_s":0.224037,"redis_calls":13,"redis_duration_s":0.001478,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000538,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00094,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009811,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014276,"completed_at":"2026-08-17T07:23:05.501Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1493gitlab # [ 295.253376] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:23:05.503Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"eb834abb407465ea3f88dd6c","created_at":"2026-08-17T07:23:05.165Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-737a27e83da14645","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"400c9c62788c0324cbac26deb2944cb1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:23:05.263Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-eb834abb407465ea3f88dd6c: start","job_status":"start","queue_duration_s":0.23947,"scheduling_latency_s":0.239488}1494gitlab # [ 295.265524] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:23:05.517Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"eb834abb407465ea3f88dd6c","created_at":"2026-08-17T07:23:05.165Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-737a27e83da14645","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"400c9c62788c0324cbac26deb2944cb1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:23:05.263Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-eb834abb407465ea3f88dd6c: done: 0.014411 sec","job_status":"done","queue_duration_s":0.23947,"scheduling_latency_s":0.239488,"redis_calls":13,"redis_duration_s":0.001501,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000565,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000936,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009733,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014411,"completed_at":"2026-08-17T07:23:05.517Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1495gitlab # [ 295.304418] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:23:05.518Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"99cdd55fc638e911e02720c9","created_at":"2026-08-17T07:23:05.165Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-737a27e83da14645","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"400c9c62788c0324cbac26deb2944cb1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:23:05.263Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-99cdd55fc638e911e02720c9: start","job_status":"start","queue_duration_s":0.255113,"scheduling_latency_s":0.255133}1496gitlab # [ 295.316480] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:23:05.533Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"99cdd55fc638e911e02720c9","created_at":"2026-08-17T07:23:05.165Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-737a27e83da14645","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"400c9c62788c0324cbac26deb2944cb1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:23:05.263Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-99cdd55fc638e911e02720c9: done: 0.01457 sec","job_status":"done","queue_duration_s":0.255113,"scheduling_latency_s":0.255133,"redis_calls":13,"redis_duration_s":0.0015040000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000543,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000961,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009978,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01457,"completed_at":"2026-08-17T07:23:05.533Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1497gitlab # [ 295.357253] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:23:05.534Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"aa7ae709013e40b334a371ba","created_at":"2026-08-17T07:23:05.165Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-737a27e83da14645","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"400c9c62788c0324cbac26deb2944cb1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:23:05.263Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-aa7ae709013e40b334a371ba: start","job_status":"start","queue_duration_s":0.271008,"scheduling_latency_s":0.271031}1498gitlab # [ 295.369854] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:23:05.549Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"aa7ae709013e40b334a371ba","created_at":"2026-08-17T07:23:05.165Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-737a27e83da14645","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"400c9c62788c0324cbac26deb2944cb1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:23:05.263Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-aa7ae709013e40b334a371ba: done: 0.014809 sec","job_status":"done","queue_duration_s":0.271008,"scheduling_latency_s":0.271031,"redis_calls":13,"redis_duration_s":0.0014889999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000542,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000947,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009935,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014809,"completed_at":"2026-08-17T07:23:05.549Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1499gitlab # [ 295.409192] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:23:05.550Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"481ec1b512e8313b0f6eb355","created_at":"2026-08-17T07:23:05.165Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-737a27e83da14645","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"400c9c62788c0324cbac26deb2944cb1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:23:05.263Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-481ec1b512e8313b0f6eb355: start","job_status":"start","queue_duration_s":0.286858,"scheduling_latency_s":0.286874}1500gitlab # [ 295.421994] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:23:05.564Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"481ec1b512e8313b0f6eb355","created_at":"2026-08-17T07:23:05.165Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-737a27e83da14645","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"400c9c62788c0324cbac26deb2944cb1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:23:05.263Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-481ec1b512e8313b0f6eb355: done: 0.014147 sec","job_status":"done","queue_duration_s":0.286858,"scheduling_latency_s":0.286874,"redis_calls":13,"redis_duration_s":0.001477,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000531,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000946,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009679,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014147,"completed_at":"2026-08-17T07:23:05.564Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1501gitlab # [ 295.460658] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:23:05.565Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9696b9826b7f4df6e6d94662","created_at":"2026-08-17T07:23:05.165Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-737a27e83da14645","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"400c9c62788c0324cbac26deb2944cb1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:23:05.263Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9696b9826b7f4df6e6d94662: start","job_status":"start","queue_duration_s":0.302077,"scheduling_latency_s":0.302094}1502gitlab # [ 295.472932] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:23:05.579Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9696b9826b7f4df6e6d94662","created_at":"2026-08-17T07:23:05.165Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-737a27e83da14645","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"400c9c62788c0324cbac26deb2944cb1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:23:05.263Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9696b9826b7f4df6e6d94662: done: 0.014158 sec","job_status":"done","queue_duration_s":0.302077,"scheduling_latency_s":0.302094,"redis_calls":13,"redis_duration_s":0.00146,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000522,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000938,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009793,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014158,"completed_at":"2026-08-17T07:23:05.579Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1503gitlab # [ 295.511757] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:23:05.581Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"393b2a94d55dd6bf189d5d24","created_at":"2026-08-17T07:23:05.165Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-737a27e83da14645","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"400c9c62788c0324cbac26deb2944cb1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:23:05.263Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-393b2a94d55dd6bf189d5d24: start","job_status":"start","queue_duration_s":0.317298,"scheduling_latency_s":0.317314}1504gitlab # [ 295.524339] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:23:05.595Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"393b2a94d55dd6bf189d5d24","created_at":"2026-08-17T07:23:05.165Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-737a27e83da14645","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"400c9c62788c0324cbac26deb2944cb1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:23:05.263Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-393b2a94d55dd6bf189d5d24: done: 0.014021 sec","job_status":"done","queue_duration_s":0.317298,"scheduling_latency_s":0.317314,"redis_calls":13,"redis_duration_s":0.001488,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000561,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000927,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009665,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014021,"completed_at":"2026-08-17T07:23:05.594Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1505gitlab # [ 295.565350] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:23:05.596Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e69c354347c86f808762704f","created_at":"2026-08-17T07:23:05.165Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-737a27e83da14645","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"400c9c62788c0324cbac26deb2944cb1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:23:05.263Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e69c354347c86f808762704f: start","job_status":"start","queue_duration_s":0.332457,"scheduling_latency_s":0.332473}1506gitlab # [ 295.577747] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:23:05.610Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e69c354347c86f808762704f","created_at":"2026-08-17T07:23:05.165Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-737a27e83da14645","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"400c9c62788c0324cbac26deb2944cb1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:23:05.263Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e69c354347c86f808762704f: done: 0.014262 sec","job_status":"done","queue_duration_s":0.332457,"scheduling_latency_s":0.332473,"redis_calls":13,"redis_duration_s":0.001532,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00057,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000962,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009865,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014262,"completed_at":"2026-08-17T07:23:05.610Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1507gitlab # [ 295.616238] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:23:05.611Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8f38508e3203c33bafa5eeee","created_at":"2026-08-17T07:23:05.165Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-737a27e83da14645","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"400c9c62788c0324cbac26deb2944cb1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:23:05.263Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8f38508e3203c33bafa5eeee: start","job_status":"start","queue_duration_s":0.347811,"scheduling_latency_s":0.347827}1508gitlab # [ 295.628410] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:23:05.625Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8f38508e3203c33bafa5eeee","created_at":"2026-08-17T07:23:05.165Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-737a27e83da14645","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"400c9c62788c0324cbac26deb2944cb1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:23:05.263Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8f38508e3203c33bafa5eeee: done: 0.014034 sec","job_status":"done","queue_duration_s":0.347811,"scheduling_latency_s":0.347827,"redis_calls":13,"redis_duration_s":0.001498,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000552,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000946,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009788,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014034,"completed_at":"2026-08-17T07:23:05.625Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1509gitlab # [ 295.666932] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:23:05.626Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9b309895aa272cc782a748c1","created_at":"2026-08-17T07:23:05.165Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-737a27e83da14645","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"400c9c62788c0324cbac26deb2944cb1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:23:05.263Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9b309895aa272cc782a748c1: start","job_status":"start","queue_duration_s":0.36292,"scheduling_latency_s":0.36296}1510gitlab # [ 295.679294] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:23:05.641Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9b309895aa272cc782a748c1","created_at":"2026-08-17T07:23:05.165Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-737a27e83da14645","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"400c9c62788c0324cbac26deb2944cb1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:23:05.263Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9b309895aa272cc782a748c1: done: 0.014506 sec","job_status":"done","queue_duration_s":0.36292,"scheduling_latency_s":0.36296,"redis_calls":13,"redis_duration_s":0.001486,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00054,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000946,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009835,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014506,"completed_at":"2026-08-17T07:23:05.641Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1511gitlab # [ 295.718012] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:23:05.642Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1d90b34859aacdf885e7c09b","created_at":"2026-08-17T07:23:05.165Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-737a27e83da14645","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"400c9c62788c0324cbac26deb2944cb1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:23:05.263Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1d90b34859aacdf885e7c09b: start","job_status":"start","queue_duration_s":0.378542,"scheduling_latency_s":0.378559}1512gitlab # [ 295.730791] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:23:05.656Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1d90b34859aacdf885e7c09b","created_at":"2026-08-17T07:23:05.165Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-737a27e83da14645","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"400c9c62788c0324cbac26deb2944cb1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:23:05.263Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1d90b34859aacdf885e7c09b: done: 0.014131 sec","job_status":"done","queue_duration_s":0.378542,"scheduling_latency_s":0.378559,"redis_calls":13,"redis_duration_s":0.0015249999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000543,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000982,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00978,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014131,"completed_at":"2026-08-17T07:23:05.656Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1513gitlab # [ 295.771416] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:23:05.657Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7b1995c38aa0836c3bbb2bf9","created_at":"2026-08-17T07:23:05.165Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-737a27e83da14645","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"400c9c62788c0324cbac26deb2944cb1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:23:05.263Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7b1995c38aa0836c3bbb2bf9: start","job_status":"start","queue_duration_s":0.393741,"scheduling_latency_s":0.393757}1514gitlab # [ 295.784084] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:23:05.671Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7b1995c38aa0836c3bbb2bf9","created_at":"2026-08-17T07:23:05.165Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-737a27e83da14645","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"400c9c62788c0324cbac26deb2944cb1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:23:05.263Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7b1995c38aa0836c3bbb2bf9: done: 0.014301 sec","job_status":"done","queue_duration_s":0.393741,"scheduling_latency_s":0.393757,"redis_calls":13,"redis_duration_s":0.001521,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000548,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000973,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009873,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014301,"completed_at":"2026-08-17T07:23:05.671Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1515gitlab # [ 295.823053] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:23:05.672Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fa0fbba6bba5bab7b978b432","created_at":"2026-08-17T07:23:05.165Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-737a27e83da14645","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"400c9c62788c0324cbac26deb2944cb1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:23:05.263Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fa0fbba6bba5bab7b978b432: start","job_status":"start","queue_duration_s":0.409126,"scheduling_latency_s":0.409143}1516gitlab # [ 295.835627] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:23:05.687Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fa0fbba6bba5bab7b978b432","created_at":"2026-08-17T07:23:05.165Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-737a27e83da14645","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"400c9c62788c0324cbac26deb2944cb1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:23:05.263Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fa0fbba6bba5bab7b978b432: done: 0.014214 sec","job_status":"done","queue_duration_s":0.409126,"scheduling_latency_s":0.409143,"redis_calls":13,"redis_duration_s":0.001507,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000545,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000962,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009722,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014214,"completed_at":"2026-08-17T07:23:05.686Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1517gitlab # [ 295.875523] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:23:05.688Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4dfc07f9c1fc4c873785c256","created_at":"2026-08-17T07:23:05.165Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-737a27e83da14645","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"400c9c62788c0324cbac26deb2944cb1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:23:05.263Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4dfc07f9c1fc4c873785c256: start","job_status":"start","queue_duration_s":0.424479,"scheduling_latency_s":0.424494}1518gitlab # [ 295.888195] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:23:05.702Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4dfc07f9c1fc4c873785c256","created_at":"2026-08-17T07:23:05.165Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-737a27e83da14645","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"400c9c62788c0324cbac26deb2944cb1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:23:05.263Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4dfc07f9c1fc4c873785c256: done: 0.014 sec","job_status":"done","queue_duration_s":0.424479,"scheduling_latency_s":0.424494,"redis_calls":13,"redis_duration_s":0.001456,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000522,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000934,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00969,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014,"completed_at":"2026-08-17T07:23:05.702Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1519gitlab # [ 295.927470] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:23:05.703Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ab8b27c88527e99494508fe1","created_at":"2026-08-17T07:23:05.165Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-737a27e83da14645","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"400c9c62788c0324cbac26deb2944cb1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:23:05.263Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ab8b27c88527e99494508fe1: start","job_status":"start","queue_duration_s":0.439602,"scheduling_latency_s":0.439619}1520gitlab # [ 295.940223] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:23:05.717Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ab8b27c88527e99494508fe1","created_at":"2026-08-17T07:23:05.165Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-737a27e83da14645","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"400c9c62788c0324cbac26deb2944cb1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:23:05.263Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ab8b27c88527e99494508fe1: done: 0.014144 sec","job_status":"done","queue_duration_s":0.439602,"scheduling_latency_s":0.439619,"redis_calls":13,"redis_duration_s":0.001539,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000544,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000995,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009815,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014144,"completed_at":"2026-08-17T07:23:05.717Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1521gitlab # [ 295.980342] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:23:05.718Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"652930cc749105a92c3d5592","created_at":"2026-08-17T07:23:05.165Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-737a27e83da14645","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"400c9c62788c0324cbac26deb2944cb1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:23:05.263Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-652930cc749105a92c3d5592: start","job_status":"start","queue_duration_s":0.454836,"scheduling_latency_s":0.454851}1522gitlab # [ 295.992744] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:23:05.732Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"652930cc749105a92c3d5592","created_at":"2026-08-17T07:23:05.165Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-737a27e83da14645","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"400c9c62788c0324cbac26deb2944cb1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:23:05.263Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-652930cc749105a92c3d5592: done: 0.014159 sec","job_status":"done","queue_duration_s":0.454836,"scheduling_latency_s":0.454851,"redis_calls":13,"redis_duration_s":0.0014980000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000528,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00097,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009844,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014159,"completed_at":"2026-08-17T07:23:05.732Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1523gitlab # [ 296.032384] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:23:05.733Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d116cd37fbf6098e344b75f9","created_at":"2026-08-17T07:23:05.165Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-737a27e83da14645","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"400c9c62788c0324cbac26deb2944cb1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:23:05.263Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d116cd37fbf6098e344b75f9: start","job_status":"start","queue_duration_s":0.470052,"scheduling_latency_s":0.470069}1524gitlab # [ 296.044699] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:23:05.748Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d116cd37fbf6098e344b75f9","created_at":"2026-08-17T07:23:05.165Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-737a27e83da14645","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"400c9c62788c0324cbac26deb2944cb1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:23:05.263Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d116cd37fbf6098e344b75f9: done: 0.014809 sec","job_status":"done","queue_duration_s":0.470052,"scheduling_latency_s":0.470069,"redis_calls":13,"redis_duration_s":0.001569,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000546,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001023,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009995,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014809,"completed_at":"2026-08-17T07:23:05.748Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1525gitlab # [ 296.084061] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:23:05.749Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"be76393aacb85310d0e7d94e","created_at":"2026-08-17T07:23:05.165Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-737a27e83da14645","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"400c9c62788c0324cbac26deb2944cb1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:23:05.263Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-be76393aacb85310d0e7d94e: start","job_status":"start","queue_duration_s":0.48593,"scheduling_latency_s":0.485947}1526gitlab # [ 296.096186] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:23:05.763Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"be76393aacb85310d0e7d94e","created_at":"2026-08-17T07:23:05.165Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-737a27e83da14645","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"400c9c62788c0324cbac26deb2944cb1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:23:05.263Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-be76393aacb85310d0e7d94e: done: 0.01421 sec","job_status":"done","queue_duration_s":0.48593,"scheduling_latency_s":0.485947,"redis_calls":13,"redis_duration_s":0.001569,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000538,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001031,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009752,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01421,"completed_at":"2026-08-17T07:23:05.763Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1527gitlab # [ 296.135367] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:23:05.764Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9d9f724bf51814fddfc11428","created_at":"2026-08-17T07:23:05.165Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-737a27e83da14645","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"400c9c62788c0324cbac26deb2944cb1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:23:05.263Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9d9f724bf51814fddfc11428: start","job_status":"start","queue_duration_s":0.501211,"scheduling_latency_s":0.501226}1528gitlab # [ 296.148146] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:23:05.779Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9d9f724bf51814fddfc11428","created_at":"2026-08-17T07:23:05.165Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-737a27e83da14645","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"400c9c62788c0324cbac26deb2944cb1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:23:05.263Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9d9f724bf51814fddfc11428: done: 0.014243 sec","job_status":"done","queue_duration_s":0.501211,"scheduling_latency_s":0.501226,"redis_calls":13,"redis_duration_s":0.001487,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000551,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000936,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009674,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014243,"completed_at":"2026-08-17T07:23:05.779Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1529gitlab # [ 296.188892] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:23:05.780Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"64dce6e0cbc6df543d755a79","created_at":"2026-08-17T07:23:05.165Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-737a27e83da14645","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"400c9c62788c0324cbac26deb2944cb1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:23:05.263Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-64dce6e0cbc6df543d755a79: start","job_status":"start","queue_duration_s":0.516514,"scheduling_latency_s":0.51653}1530gitlab # [ 296.201266] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:23:05.798Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"64dce6e0cbc6df543d755a79","created_at":"2026-08-17T07:23:05.165Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-737a27e83da14645","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"400c9c62788c0324cbac26deb2944cb1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:23:05.263Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-64dce6e0cbc6df543d755a79: done: 0.018112 sec","job_status":"done","queue_duration_s":0.516514,"scheduling_latency_s":0.51653,"redis_calls":13,"redis_duration_s":0.004961,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001944,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003017,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010455,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018112,"completed_at":"2026-08-17T07:23:05.798Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1531gitlab # [ 296.240412] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:23:05.799Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"70231ea9869719ca16bc42a7","created_at":"2026-08-17T07:23:05.165Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-737a27e83da14645","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"400c9c62788c0324cbac26deb2944cb1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:23:05.263Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-70231ea9869719ca16bc42a7: start","job_status":"start","queue_duration_s":0.53622,"scheduling_latency_s":0.536236}1532gitlab # [ 296.252921] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:23:05.814Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"70231ea9869719ca16bc42a7","created_at":"2026-08-17T07:23:05.165Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-737a27e83da14645","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"400c9c62788c0324cbac26deb2944cb1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:23:05.263Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-70231ea9869719ca16bc42a7: done: 0.01493 sec","job_status":"done","queue_duration_s":0.53622,"scheduling_latency_s":0.536236,"redis_calls":13,"redis_duration_s":0.001604,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000642,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000962,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010322,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01493,"completed_at":"2026-08-17T07:23:05.814Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1533gitlab # [ 296.292141] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:23:05.815Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"47b79ca6ccb2fba241ed3dfe","created_at":"2026-08-17T07:23:05.165Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-737a27e83da14645","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"400c9c62788c0324cbac26deb2944cb1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:23:05.263Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-47b79ca6ccb2fba241ed3dfe: start","job_status":"start","queue_duration_s":0.552241,"scheduling_latency_s":0.552257}1534gitlab # [ 296.304578] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:23:05.830Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"47b79ca6ccb2fba241ed3dfe","created_at":"2026-08-17T07:23:05.165Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-737a27e83da14645","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"400c9c62788c0324cbac26deb2944cb1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:23:05.263Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-47b79ca6ccb2fba241ed3dfe: done: 0.014927 sec","job_status":"done","queue_duration_s":0.552241,"scheduling_latency_s":0.552257,"redis_calls":13,"redis_duration_s":0.0015270000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000538,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000989,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010505,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014927,"completed_at":"2026-08-17T07:23:05.830Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1535gitlab # [ 296.344222] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:23:05.831Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"aaa228c3853837cfdca2d6ea","created_at":"2026-08-17T07:23:05.165Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-737a27e83da14645","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"400c9c62788c0324cbac26deb2944cb1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:23:05.263Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-aaa228c3853837cfdca2d6ea: start","job_status":"start","queue_duration_s":0.568235,"scheduling_latency_s":0.568251}1536gitlab # [ 296.356419] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:23:05.846Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"aaa228c3853837cfdca2d6ea","created_at":"2026-08-17T07:23:05.165Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-737a27e83da14645","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"400c9c62788c0324cbac26deb2944cb1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:23:05.263Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-aaa228c3853837cfdca2d6ea: done: 0.014709 sec","job_status":"done","queue_duration_s":0.568235,"scheduling_latency_s":0.568251,"redis_calls":13,"redis_duration_s":0.001721,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000549,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001172,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010191,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014709,"completed_at":"2026-08-17T07:23:05.846Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1537gitlab # [ 296.396513] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:23:05.847Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1887df953cc5cf09e4b62d5a","created_at":"2026-08-17T07:23:05.165Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-737a27e83da14645","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"400c9c62788c0324cbac26deb2944cb1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:23:05.263Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1887df953cc5cf09e4b62d5a: start","job_status":"start","queue_duration_s":0.584065,"scheduling_latency_s":0.584082}1538gitlab # [ 296.408954] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:23:05.862Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1887df953cc5cf09e4b62d5a","created_at":"2026-08-17T07:23:05.165Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-737a27e83da14645","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"400c9c62788c0324cbac26deb2944cb1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:23:05.263Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1887df953cc5cf09e4b62d5a: done: 0.014985 sec","job_status":"done","queue_duration_s":0.584065,"scheduling_latency_s":0.584082,"redis_calls":13,"redis_duration_s":0.001506,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000574,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000932,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009692,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014985,"completed_at":"2026-08-17T07:23:05.862Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1539gitlab # [ 296.448657] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:23:05.863Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5b291d5668240b9d5d3cb5c2","created_at":"2026-08-17T07:23:05.165Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-737a27e83da14645","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"400c9c62788c0324cbac26deb2944cb1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:23:05.263Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5b291d5668240b9d5d3cb5c2: start","job_status":"start","queue_duration_s":0.600137,"scheduling_latency_s":0.600152}1540gitlab # [ 296.461081] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:23:05.878Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5b291d5668240b9d5d3cb5c2","created_at":"2026-08-17T07:23:05.165Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-737a27e83da14645","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"400c9c62788c0324cbac26deb2944cb1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:23:05.263Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5b291d5668240b9d5d3cb5c2: done: 0.014624 sec","job_status":"done","queue_duration_s":0.600137,"scheduling_latency_s":0.600152,"redis_calls":13,"redis_duration_s":0.0015170000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000537,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00098,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010263,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014624,"completed_at":"2026-08-17T07:23:05.878Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1541gitlab # [ 296.500974] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:23:05.879Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e81659fbb88068d2c5e48a3a","created_at":"2026-08-17T07:23:05.165Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-737a27e83da14645","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"400c9c62788c0324cbac26deb2944cb1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:23:05.263Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e81659fbb88068d2c5e48a3a: start","job_status":"start","queue_duration_s":0.61589,"scheduling_latency_s":0.615906}1542gitlab # [ 296.513633] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:23:05.894Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e81659fbb88068d2c5e48a3a","created_at":"2026-08-17T07:23:05.165Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-737a27e83da14645","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"400c9c62788c0324cbac26deb2944cb1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:23:05.263Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e81659fbb88068d2c5e48a3a: done: 0.014787 sec","job_status":"done","queue_duration_s":0.61589,"scheduling_latency_s":0.615906,"redis_calls":13,"redis_duration_s":0.001575,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000633,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000942,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010352,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014787,"completed_at":"2026-08-17T07:23:05.894Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1543gitlab # [ 296.553440] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:23:05.895Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a06c14947ec4871e735154d2","created_at":"2026-08-17T07:23:05.165Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-737a27e83da14645","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"400c9c62788c0324cbac26deb2944cb1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:23:05.263Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a06c14947ec4871e735154d2: start","job_status":"start","queue_duration_s":0.631814,"scheduling_latency_s":0.631831}1544gitlab # [ 296.566080] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:23:05.910Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a06c14947ec4871e735154d2","created_at":"2026-08-17T07:23:05.165Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-737a27e83da14645","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"400c9c62788c0324cbac26deb2944cb1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:23:05.263Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a06c14947ec4871e735154d2: done: 0.014577 sec","job_status":"done","queue_duration_s":0.631814,"scheduling_latency_s":0.631831,"redis_calls":13,"redis_duration_s":0.0015119999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000541,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000971,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009773,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014577,"completed_at":"2026-08-17T07:23:05.910Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1545gitlab # [ 296.606609] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:23:05.911Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"baba1d9bc1a34e78b69bfc3e","created_at":"2026-08-17T07:23:05.165Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-737a27e83da14645","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"400c9c62788c0324cbac26deb2944cb1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:23:05.263Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-baba1d9bc1a34e78b69bfc3e: start","job_status":"start","queue_duration_s":0.647871,"scheduling_latency_s":0.647887}1546gitlab # [ 296.619105] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:23:05.926Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"baba1d9bc1a34e78b69bfc3e","created_at":"2026-08-17T07:23:05.165Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-737a27e83da14645","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"400c9c62788c0324cbac26deb2944cb1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:23:05.263Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-baba1d9bc1a34e78b69bfc3e: done: 0.014717 sec","job_status":"done","queue_duration_s":0.647871,"scheduling_latency_s":0.647887,"redis_calls":13,"redis_duration_s":0.001519,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00054,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000979,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010259,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014717,"completed_at":"2026-08-17T07:23:05.926Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1547gitlab # [ 296.658438] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:23:05.927Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f86c641f1c56843bd1e2ab70","created_at":"2026-08-17T07:23:05.165Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-737a27e83da14645","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"400c9c62788c0324cbac26deb2944cb1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:23:05.263Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f86c641f1c56843bd1e2ab70: start","job_status":"start","queue_duration_s":0.663721,"scheduling_latency_s":0.663738}1548gitlab # [ 296.670732] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:23:05.942Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f86c641f1c56843bd1e2ab70","created_at":"2026-08-17T07:23:05.165Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-737a27e83da14645","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"400c9c62788c0324cbac26deb2944cb1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:23:05.263Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f86c641f1c56843bd1e2ab70: done: 0.014722 sec","job_status":"done","queue_duration_s":0.663721,"scheduling_latency_s":0.663738,"redis_calls":13,"redis_duration_s":0.0014650000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000528,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000937,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010139,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014722,"completed_at":"2026-08-17T07:23:05.942Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1549gitlab # [ 296.711020] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:23:05.943Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0e8de273b406e7d95d561c6e","created_at":"2026-08-17T07:23:05.165Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-737a27e83da14645","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"400c9c62788c0324cbac26deb2944cb1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:23:05.263Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0e8de273b406e7d95d561c6e: start","job_status":"start","queue_duration_s":0.67957,"scheduling_latency_s":0.679586}1550gitlab # [ 296.723943] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:23:05.957Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0e8de273b406e7d95d561c6e","created_at":"2026-08-17T07:23:05.165Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-737a27e83da14645","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"400c9c62788c0324cbac26deb2944cb1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:23:05.263Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0e8de273b406e7d95d561c6e: done: 0.014445 sec","job_status":"done","queue_duration_s":0.67957,"scheduling_latency_s":0.679586,"redis_calls":13,"redis_duration_s":0.001478,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000529,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000949,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009727,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014445,"completed_at":"2026-08-17T07:23:05.957Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1551gitlab # [ 296.764044] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:23:05.959Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3ce5b2aa6d8036b4b2e57efc","created_at":"2026-08-17T07:23:05.165Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-737a27e83da14645","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"400c9c62788c0324cbac26deb2944cb1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:23:05.263Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3ce5b2aa6d8036b4b2e57efc: start","job_status":"start","queue_duration_s":0.69559,"scheduling_latency_s":0.695606}1552gitlab # [ 296.778098] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:23:05.984Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3ce5b2aa6d8036b4b2e57efc","created_at":"2026-08-17T07:23:05.165Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-737a27e83da14645","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"400c9c62788c0324cbac26deb2944cb1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:23:05.263Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3ce5b2aa6d8036b4b2e57efc: done: 0.02486 sec","job_status":"done","queue_duration_s":0.69559,"scheduling_latency_s":0.695606,"redis_calls":13,"redis_duration_s":0.001603,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000559,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001044,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020434,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.02486,"completed_at":"2026-08-17T07:23:05.984Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1553gitlab # [ 296.818265] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:23:05.985Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"120a2a8bea436004191eae20","created_at":"2026-08-17T07:23:05.165Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-737a27e83da14645","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"400c9c62788c0324cbac26deb2944cb1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:23:05.263Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-120a2a8bea436004191eae20: start","job_status":"start","queue_duration_s":0.721579,"scheduling_latency_s":0.721595}1554gitlab # [ 296.830917] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:23:05.999Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"120a2a8bea436004191eae20","created_at":"2026-08-17T07:23:05.165Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-737a27e83da14645","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"400c9c62788c0324cbac26deb2944cb1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:23:05.263Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-120a2a8bea436004191eae20: done: 0.014662 sec","job_status":"done","queue_duration_s":0.721579,"scheduling_latency_s":0.721595,"redis_calls":13,"redis_duration_s":0.001639,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000559,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00108,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010142,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014662,"completed_at":"2026-08-17T07:23:05.999Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1555gitlab # [ 296.871000] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:23:06.001Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"594454ffdc739cbf6e9008c7","created_at":"2026-08-17T07:23:05.165Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-737a27e83da14645","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"400c9c62788c0324cbac26deb2944cb1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:23:05.263Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-594454ffdc739cbf6e9008c7: start","job_status":"start","queue_duration_s":0.737302,"scheduling_latency_s":0.737319}1556gitlab # [ 296.883745] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:23:06.014Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"594454ffdc739cbf6e9008c7","created_at":"2026-08-17T07:23:05.165Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-737a27e83da14645","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"400c9c62788c0324cbac26deb2944cb1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:23:05.263Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-594454ffdc739cbf6e9008c7: done: 0.013984 sec","job_status":"done","queue_duration_s":0.737302,"scheduling_latency_s":0.737319,"redis_calls":13,"redis_duration_s":0.001454,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000528,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000926,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009623,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013984,"completed_at":"2026-08-17T07:23:06.014Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1557gitlab # [ 296.924244] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:23:06.016Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d28b1752744131dc13d54252","created_at":"2026-08-17T07:23:05.165Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-737a27e83da14645","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"400c9c62788c0324cbac26deb2944cb1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:23:05.263Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d28b1752744131dc13d54252: start","job_status":"start","queue_duration_s":0.752356,"scheduling_latency_s":0.752373}1558gitlab # [ 296.936844] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:23:06.030Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d28b1752744131dc13d54252","created_at":"2026-08-17T07:23:05.165Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-737a27e83da14645","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"400c9c62788c0324cbac26deb2944cb1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:23:05.263Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d28b1752744131dc13d54252: done: 0.013967 sec","job_status":"done","queue_duration_s":0.752356,"scheduling_latency_s":0.752373,"redis_calls":13,"redis_duration_s":0.001485,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000526,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000959,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00966,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013967,"completed_at":"2026-08-17T07:23:06.029Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1559gitlab # [ 296.977965] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:23:06.031Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1b26e95bdb54cf840389fa11","created_at":"2026-08-17T07:23:05.165Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-737a27e83da14645","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"400c9c62788c0324cbac26deb2944cb1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:23:05.263Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1b26e95bdb54cf840389fa11: start","job_status":"start","queue_duration_s":0.767458,"scheduling_latency_s":0.767474}1560gitlab # [ 296.990816] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:23:06.047Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1b26e95bdb54cf840389fa11","created_at":"2026-08-17T07:23:05.165Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-737a27e83da14645","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"400c9c62788c0324cbac26deb2944cb1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:23:05.263Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1b26e95bdb54cf840389fa11: done: 0.015862 sec","job_status":"done","queue_duration_s":0.767458,"scheduling_latency_s":0.767474,"redis_calls":13,"redis_duration_s":0.0030440000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000762,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002282,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010206,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015862,"completed_at":"2026-08-17T07:23:06.046Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1561gitlab # [ 297.031229] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:23:06.048Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3729de1a8fd974f214a3c3b5","created_at":"2026-08-17T07:23:05.165Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-737a27e83da14645","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"400c9c62788c0324cbac26deb2944cb1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:23:05.263Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3729de1a8fd974f214a3c3b5: start","job_status":"start","queue_duration_s":0.784749,"scheduling_latency_s":0.784765}1562gitlab # [ 297.043967] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:23:06.063Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3729de1a8fd974f214a3c3b5","created_at":"2026-08-17T07:23:05.165Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-737a27e83da14645","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"400c9c62788c0324cbac26deb2944cb1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:23:05.263Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3729de1a8fd974f214a3c3b5: done: 0.015233 sec","job_status":"done","queue_duration_s":0.784749,"scheduling_latency_s":0.784765,"redis_calls":13,"redis_duration_s":0.002796,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000982,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001814,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009615,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015233,"completed_at":"2026-08-17T07:23:06.063Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1563gitlab # [ 297.084785] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:23:06.065Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dec3f6fdce879ff3182dda2e","created_at":"2026-08-17T07:23:05.165Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-737a27e83da14645","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"400c9c62788c0324cbac26deb2944cb1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:23:05.263Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dec3f6fdce879ff3182dda2e: start","job_status":"start","queue_duration_s":0.801398,"scheduling_latency_s":0.801413}1564gitlab # [ 297.097384] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:23:06.079Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dec3f6fdce879ff3182dda2e","created_at":"2026-08-17T07:23:05.165Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-737a27e83da14645","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"400c9c62788c0324cbac26deb2944cb1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:23:05.263Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dec3f6fdce879ff3182dda2e: done: 0.014798 sec","job_status":"done","queue_duration_s":0.801398,"scheduling_latency_s":0.801413,"redis_calls":13,"redis_duration_s":0.002713,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000931,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001782,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00924,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014798,"completed_at":"2026-08-17T07:23:06.079Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1565gitlab # [ 297.138006] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:23:06.081Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2410075214875f883ce62338","created_at":"2026-08-17T07:23:05.165Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-737a27e83da14645","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"400c9c62788c0324cbac26deb2944cb1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:23:05.263Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2410075214875f883ce62338: start","job_status":"start","queue_duration_s":0.817557,"scheduling_latency_s":0.817573}1566gitlab # [ 297.150824] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:23:06.095Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2410075214875f883ce62338","created_at":"2026-08-17T07:23:05.165Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-737a27e83da14645","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"400c9c62788c0324cbac26deb2944cb1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:23:05.263Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2410075214875f883ce62338: done: 0.01467 sec","job_status":"done","queue_duration_s":0.817557,"scheduling_latency_s":0.817573,"redis_calls":13,"redis_duration_s":0.002601,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000936,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001665,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009217,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01467,"completed_at":"2026-08-17T07:23:06.095Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1567gitlab # [ 297.192380] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:23:06.097Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3845fc936965f39113f601a1","created_at":"2026-08-17T07:23:05.165Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-737a27e83da14645","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"400c9c62788c0324cbac26deb2944cb1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:23:05.263Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3845fc936965f39113f601a1: start","job_status":"start","queue_duration_s":0.833592,"scheduling_latency_s":0.833607}1568gitlab # [ 297.205163] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:23:06.111Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3845fc936965f39113f601a1","created_at":"2026-08-17T07:23:05.165Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-737a27e83da14645","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"400c9c62788c0324cbac26deb2944cb1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:23:05.263Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3845fc936965f39113f601a1: done: 0.014695 sec","job_status":"done","queue_duration_s":0.833592,"scheduling_latency_s":0.833607,"redis_calls":13,"redis_duration_s":0.002637,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000942,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001695,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00924,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014695,"completed_at":"2026-08-17T07:23:06.111Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1569gitlab # [ 297.245087] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:23:06.113Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7cf6036b49de20f3ea4ce060","created_at":"2026-08-17T07:23:05.165Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-737a27e83da14645","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"400c9c62788c0324cbac26deb2944cb1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:23:05.263Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7cf6036b49de20f3ea4ce060: start","job_status":"start","queue_duration_s":0.84965,"scheduling_latency_s":0.849665}1570gitlab # [ 297.258185] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:23:06.129Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7cf6036b49de20f3ea4ce060","created_at":"2026-08-17T07:23:05.165Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-737a27e83da14645","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"400c9c62788c0324cbac26deb2944cb1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:23:05.263Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7cf6036b49de20f3ea4ce060: done: 0.015811 sec","job_status":"done","queue_duration_s":0.84965,"scheduling_latency_s":0.849665,"redis_calls":13,"redis_duration_s":0.002346,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000589,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001757,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010804,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015811,"completed_at":"2026-08-17T07:23:06.129Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1571gitlab # [ 297.298462] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:23:06.130Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e392e09d83b794c3ca8b69d6","created_at":"2026-08-17T07:23:05.165Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-737a27e83da14645","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"400c9c62788c0324cbac26deb2944cb1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:23:05.263Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e392e09d83b794c3ca8b69d6: start","job_status":"start","queue_duration_s":0.866861,"scheduling_latency_s":0.86688}1572gitlab # [ 297.311294] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:23:06.145Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e392e09d83b794c3ca8b69d6","created_at":"2026-08-17T07:23:05.165Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-737a27e83da14645","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"400c9c62788c0324cbac26deb2944cb1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:23:05.263Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e392e09d83b794c3ca8b69d6: done: 0.014787 sec","job_status":"done","queue_duration_s":0.866861,"scheduling_latency_s":0.86688,"redis_calls":13,"redis_duration_s":0.001781,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000784,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000997,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010123,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014787,"completed_at":"2026-08-17T07:23:06.145Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1573gitlab # [ 297.351533] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:23:06.146Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2abdaf651e1b4b1066587dcd","created_at":"2026-08-17T07:23:05.165Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-737a27e83da14645","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"400c9c62788c0324cbac26deb2944cb1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:23:05.263Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2abdaf651e1b4b1066587dcd: start","job_status":"start","queue_duration_s":0.882916,"scheduling_latency_s":0.882952}1574gitlab # [ 297.364209] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:23:06.160Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2abdaf651e1b4b1066587dcd","created_at":"2026-08-17T07:23:05.165Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-737a27e83da14645","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"400c9c62788c0324cbac26deb2944cb1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:23:05.263Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2abdaf651e1b4b1066587dcd: done: 0.014359 sec","job_status":"done","queue_duration_s":0.882916,"scheduling_latency_s":0.882952,"redis_calls":13,"redis_duration_s":0.0015300000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000559,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000971,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009883,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014359,"completed_at":"2026-08-17T07:23:06.160Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1575gitlab # [ 297.404908] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:23:06.162Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"18608d256a798382db208203","created_at":"2026-08-17T07:23:05.165Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-737a27e83da14645","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"400c9c62788c0324cbac26deb2944cb1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:23:05.263Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-18608d256a798382db208203: start","job_status":"start","queue_duration_s":0.898417,"scheduling_latency_s":0.898433}1576gitlab # [ 297.417356] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:23:06.176Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"18608d256a798382db208203","created_at":"2026-08-17T07:23:05.165Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-737a27e83da14645","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"400c9c62788c0324cbac26deb2944cb1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:23:05.263Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-18608d256a798382db208203: done: 0.014033 sec","job_status":"done","queue_duration_s":0.898417,"scheduling_latency_s":0.898433,"redis_calls":13,"redis_duration_s":0.001559,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000564,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000995,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009682,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014033,"completed_at":"2026-08-17T07:23:06.176Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1577gitlab # [ 297.457237] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:23:06.177Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"82912725e076b56eead0665e","created_at":"2026-08-17T07:23:05.165Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-737a27e83da14645","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"400c9c62788c0324cbac26deb2944cb1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:23:05.263Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-82912725e076b56eead0665e: start","job_status":"start","queue_duration_s":0.913494,"scheduling_latency_s":0.913511}1578gitlab # [ 297.469962] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:23:06.191Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"82912725e076b56eead0665e","created_at":"2026-08-17T07:23:05.165Z","trace_propagation_headers":{"sentry-trace":"b707b14eb863417187a5cc1188df5933-737a27e83da14645","baggage":"sentry-trace_id=b707b14eb863417187a5cc1188df5933,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"400c9c62788c0324cbac26deb2944cb1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:23:05.263Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"mapd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-82912725e076b56eead0665e: done: 0.014204 sec","job_status":"done","queue_duration_s":0.913494,"scheduling_latency_s":0.913511,"redis_calls":13,"redis_duration_s":0.001552,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000545,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001007,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009807,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014204,"completed_at":"2026-08-17T07:23:06.191Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1579gitlab # [ 310.261242] postgres[3258]: [3258] ERROR: relation "table_without_models" does not exist1580gitlab # [ 310.268749] postgres[3258]: [3258] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1581gitlab # [ 310.289740] redis[786]: 10 changes in 300 seconds. Saving...1582gitlab # [ 310.292814] redis[786]: Background saving started by pid 32811583gitlab # [ 310.300561] redis[3281]: BGSAVE done, 463 keys saved, 0 keys skipped, 118749 bytes written.1584gitlab # [ 310.305171] redis[3281]: DB saved on disk1585gitlab # [ 310.307398] redis[3281]: Fork CoW for RDB: current 1 MB, peak 1 MB, average 0 MB1586gitlab # [ 310.390915] redis[786]: Background saving terminated with success1587gitlab # [ 312.299582] postgres[860]: [860] LOG: checkpoint starting: time1588gitlab # [ 313.006555] gitaly[913]: time="2026-08-17T07:23:23.779Z" level=info msg="burden monitor stats" pid=9131589gitlab # [ 315.918125] runuser[2928]: pam_unix(runuser:session): session closed for user gitlab1590gitlab # [ 315.919891] setup-gitlab-start[2914]: + systemctl restart gitlab-sidekiq.service1591gitlab # [ 315.960639] systemd[1]: Stopping gitlab-sidekiq.service...1592gitlab # [ 315.966115] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:23:26.739Z","message":"Shutting down"}1593gitlab # [ 315.970505] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:23:26.739Z","message":"Scheduler exiting..."}1594gitlab # [ 315.974920] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:23:26.740Z","message":"Terminating quiet threads for default capsule"}1595gitlab # [ 315.980230] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:23:26.740Z","message":"Scheduler exiting..."}1596gitlab # [ 316.468112] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:23:27.242Z","message":"Pausing to allow jobs to finish..."}1597gitlab # [ 320.973259] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:23:31.746Z","message":"Bye!"}1598gitlab # [ 321.014708] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-17T07:23:31.788Z","message":"stopped","memwd_reason":"background task stopped","memwd_handler_class":"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler","memwd_sleep_time_s":3,"pid":1997,"worker_id":"sidekiq_0","memwd_rss_bytes":929849344,"retry":0}1599gitlab # [ 322.412692] systemd[1]: gitlab-sidekiq.service: Deactivated successfully.1600gitlab # [ 322.413166] systemd[1]: Stopped gitlab-sidekiq.service.1601gitlab # [ 322.413385] systemd[1]: gitlab-sidekiq.service: Consumed 1min 47.131s CPU time over 3min 21.087s wall clock time, 938.4M memory peak, 4.6M read from disk.1602gitlab # [ 322.427004] systemd[1]: Started gitlab-sidekiq.service.1603gitlab # [ 322.431786] setup-gitlab-start[2914]: + mkdir -p /var/lib/secrets1604gitlab # [ 322.438539] setup-gitlab-start[2914]: + echo nixbot-test-token-of-20-chars1605gitlab # [ 322.441861] setup-gitlab-start[2914]: + chmod 644 /var/lib/secrets/gitlab-token1606gitlab # [ 322.445937] setup-gitlab-start[2914]: + curl -fs -X POST -H 'PRIVATE-TOKEN: nixbot-test-token-of-20-chars' -H 'Content-Type: application/json' -d '{"name":"test-flake","visibility":"public","topics":["build-with-buildbot"]}' http://gitlab/api/v4/projects1607gitlab # [ 323.987743] gitaly[913]: time="2026-08-17T07:23:34.761Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M079NBG1ENEWCYNDBRMBG52K error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-17T07:23:44.010" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-17T07:23:34.761" pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1608gitlab # [ 323.998163] gitaly[913]: time="2026-08-17T07:23:34.761Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M079NBG1ENEWCYNDBRMBG52K grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-17T07:23:44.010" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=95 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-17T07:23:34.761" grpc.time_ms=0.602 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1609gitlab # [ 324.256465] gitaly[913]: time="2026-08-17T07:23:35.030Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M079NBG1ENEWCYNDBRMBG52K error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-17T07:23:45.009" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-17T07:23:35.030" pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1610gitlab # [ 324.320272] gitaly[913]: time="2026-08-17T07:23:35.031Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M079NBG1ENEWCYNDBRMBG52K grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-17T07:23:45.009" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-17T07:23:35.030" grpc.time_ms=0.677 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1611gitlab # [ 324.351844] gitaly[913]: time="2026-08-17T07:23:35.101Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M079NBG1ENEWCYNDBRMBG52K diskcache=7eb74588-2c2d-4b51-89a7-bc7de8306b3b grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-08-17T07:23:45.023" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-17T07:23:35.044" pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1612gitlab # [ 324.375202] gitaly[913]: time="2026-08-17T07:23:35.102Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=29 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1439 command.oublock=32 command.real_time_ms=34 command.spawn_token_fork_ms=4 command.system_time_ms=24 command.user_time_ms=5 component=gitaly.UnaryServerInterceptor correlation_id=01M079NBG1ENEWCYNDBRMBG52K grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-08-17T07:23:45.023" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-17T07:23:35.044" grpc.time_ms=57.808 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1613gitlab # [ 324.398933] gitaly[913]: time="2026-08-17T07:23:35.128Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01M079NBG1ENEWCYNDBRMBG52K grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-17T07:23:45.105" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-17T07:23:35.126" pid=913 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root1614gitlab # [ 324.416167] gitaly[913]: time="2026-08-17T07:23:35.128Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M079NBG1ENEWCYNDBRMBG52K grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-17T07:23:45.105" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-17T07:23:35.126" grpc.time_ms=2.215 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1615gitlab # [ 324.431855] gitaly[913]: time="2026-08-17T07:23:35.153Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=12 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M079NBG1ENEWCYNDBRMBG52K grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-17T07:23:45.116" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-17T07:23:35.136" grpc.time_ms=16.73 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1616gitlab # [ 324.488492] gitaly[913]: time="2026-08-17T07:23:35.262Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M079NBG1ENEWCYNDBRMBG52K error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-17T07:23:45.241" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-17T07:23:35.262" pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1617gitlab # [ 324.512811] gitaly[913]: time="2026-08-17T07:23:35.263Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M079NBG1ENEWCYNDBRMBG52K grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-17T07:23:45.241" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-17T07:23:35.262" grpc.time_ms=0.741 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1618gitlab # [ 324.538693] gitaly[913]: time="2026-08-17T07:23:35.309Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M079NBG1ENEWCYNDBRMBG52K diskcache=8f760e40-4bed-4da7-a7b4-09a0641cb76e grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-08-17T07:23:45.245" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-17T07:23:35.266" pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1619gitlab # [ 324.560304] gitaly[913]: time="2026-08-17T07:23:35.310Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=17 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1438 command.oublock=32 command.real_time_ms=22 command.spawn_token_fork_ms=6 command.system_time_ms=14 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M079NBG1ENEWCYNDBRMBG52K grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-08-17T07:23:45.245" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=137 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-17T07:23:35.266" grpc.time_ms=42.989 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1620gitlab # [ 324.582965] gitaly[913]: time="2026-08-17T07:23:35.320Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01M079NBG1ENEWCYNDBRMBG52K grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-17T07:23:45.298" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-17T07:23:35.318" pid=913 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root1621gitlab # [ 324.597211] gitaly[913]: time="2026-08-17T07:23:35.321Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M079NBG1ENEWCYNDBRMBG52K grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-17T07:23:45.298" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-17T07:23:35.318" grpc.time_ms=1.909 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1622gitlab # [ 324.611074] gitaly[913]: time="2026-08-17T07:23:35.337Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=3 command.system_time_ms=4 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M079NBG1ENEWCYNDBRMBG52K grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-17T07:23:45.005" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-17T07:23:35.325" grpc.time_ms=11.348 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1623gitlab # [ 324.628205] gitaly[913]: time="2026-08-17T07:23:35.385Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M079NBG1ENEWCYNDBRMBG52K grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-17T07:23:45.064" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-17T07:23:35.385" grpc.time_ms=0.313 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1624gitlab # [ 324.640522] gitaly[913]: time="2026-08-17T07:23:35.397Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M079NBG1ENEWCYNDBRMBG52K grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-08-17T07:23:45.076" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-17T07:23:35.396" grpc.time_ms=0.575 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1625gitlab # [ 325.624631] gitaly[913]: time="2026-08-17T07:23:36.397Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M079NBG1ENEWCYNDBRMBG52K grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-17T07:23:46.063" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-17T07:23:36.384" grpc.time_ms=13.578 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1626gitlab # [ 326.282213] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/08/17:07:23:37 +0000] "POST /api/v4/projects HTTP/1.1" 201 4828 "" "curl/8.21.0" 38061627gitlab # [ 326.286262] setup-gitlab-start[2914]: + mkdir -p /tmp/test-flake1628gitlab # [ 326.291513] setup-gitlab-start[2914]: + cd /tmp/test-flake1629gitlab # [ 326.292441] setup-gitlab-start[2914]: + git init -b master1630gitlab # [ 326.319692] setup-gitlab-start[3393]: Initialized empty Git repository in /tmp/test-flake/.git/1631gitlab # [ 326.321587] setup-gitlab-start[2914]: + git config user.name test1632gitlab # [ 326.327952] setup-gitlab-start[2914]: + git config user.email test@example.com1633gitlab # [ 326.335457] setup-gitlab-start[2914]: + cat1634gitlab # [ 326.341843] setup-gitlab-start[2914]: + git add flake.nix1635gitlab # [ 326.351023] setup-gitlab-start[2914]: + git commit -m 'initial commit'1636gitlab # [ 326.377825] setup-gitlab-start[3398]: [master (root-commit) 4e3e621] initial commit1637gitlab # [ 326.380554] setup-gitlab-start[3398]: 1 file changed, 10 insertions(+)1638gitlab # [ 326.382764] setup-gitlab-start[3398]: create mode 100644 flake.nix1639gitlab # [ 326.385017] setup-gitlab-start[2914]: + git remote add origin http://oauth2:nixbot-test-token-of-20-chars@gitlab/root/test-flake.git1640gitlab # [ 326.391229] setup-gitlab-start[2914]: + git push -u origin master1641gitlab # [ 326.500818] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/08/17:07:23:37 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.55.0" 651642gitlab # [ 327.122554] gitaly[913]: time="2026-08-17T07:23:37.895Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=581 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=3 command.system_time_ms=7 command.user_time_ms=7 component=gitaly.StreamServerInterceptor correlation_id=01M079NFDWJV9W5XFRDW10GZP2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-17T07:23:37.876" grpc.time_ms=18.941 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1643gitlab # [ 327.160973] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/08/17:07:23:37 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 178 "" "git/2.55.0" 6211644gitlab # [ 327.378316] sidekiq-cluster[3336]: {"severity":"INFO","time":"2026-08-17T07:23:38.123Z","message":"Starting cluster with 1 processes"}1645gitlab # [ 327.638774] gitaly[913]: time="2026-08-17T07:23:38.413Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=1 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M079NG2Z5QZVN0CSZM1X8NAK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-17T07:23:48.075" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=169 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-17T07:23:38.396" grpc.time_ms=16.632 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1646gitlab # [ 327.723914] gitaly[913]: time="2026-08-17T07:23:38.498Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=301 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=9 command.user_time_ms=4 component=gitaly.StreamServerInterceptor correlation_id=01M079NG2Z5QZVN0CSZM1X8NAK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-08-17T07:24:08.079" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-08-17T07:23:38.480" grpc.time_ms=18.002 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1647gitlab # [ 327.766506] gitaly[913]: time="2026-08-17T07:23:38.540Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01M079NG2Z5QZVN0CSZM1X8NAK duration_ms=273ns method=POST pid=913 status=200 url="http://unix/api/v4/internal/allowed"1648gitlab # [ 327.820900] gitaly[913]: time="2026-08-17T07:23:38.595Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01M079NG2Z5QZVN0CSZM1X8NAK duration_ms=52ns method=POST pid=913 status=200 url="http://unix/api/v4/internal/pre_receive"1649gitlab # [ 327.830114] gitaly[913]: time="2026-08-17T07:23:38.595Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M079NG2Z5QZVN0CSZM1X8NAK grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5315 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-17T07:23:38.265" grpc.time_ms=330.174 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1650gitlab # [ 327.892278] gitaly[913]: time="2026-08-17T07:23:38.662Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M079NG2Z5QZVN0CSZM1X8NAK grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4785 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-17T07:23:38.660" grpc.time_ms=1.917 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1651gitlab # [ 327.935764] gitaly[913]: time="2026-08-17T07:23:38.710Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M079NG2Z5QZVN0CSZM1X8NAK grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4784 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-17T07:23:38.708" grpc.time_ms=1.073 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1652gitlab # [ 327.977660] gitaly[913]: time="2026-08-17T07:23:38.752Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M079NG2Z5QZVN0CSZM1X8NAK grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4786 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-17T07:23:38.751" grpc.time_ms=0.867 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1653gitlab # [ 328.276953] gitaly[913]: time="2026-08-17T07:23:39.050Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M079NG2Z5QZVN0CSZM1X8NAK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-17T07:23:49.001" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-17T07:23:39.031" grpc.time_ms=18.074 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1654gitlab # [ 328.367724] gitaly[913]: time="2026-08-17T07:23:39.141Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=30 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1435 command.oublock=0 command.real_time_ms=35 command.spawn_token_fork_ms=5 command.system_time_ms=21 command.user_time_ms=9 component=gitaly.UnaryServerInterceptor correlation_id=01M079NG2Z5QZVN0CSZM1X8NAK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-08-17T07:23:49.068" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-08-17T07:23:39.099" grpc.time_ms=41.944 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1655gitlab # [ 328.411384] gitaly[913]: time="2026-08-17T07:23:39.185Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01M079NG2Z5QZVN0CSZM1X8NAK duration_ms=396ns method=POST pid=913 status=200 url="http://unix/api/v4/internal/post_receive"1656gitlab # [ 328.419171] gitaly[913]: time="2026-08-17T07:23:39.187Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M079NG2Z5QZVN0CSZM1X8NAK grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4809 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-17T07:23:38.787" grpc.time_ms=399.81 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1657gitlab # [ 328.447358] gitaly[913]: time="2026-08-17T07:23:39.199Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01M079NG2Z5QZVN0CSZM1X8NAK diskcache=81de6a65-dfc5-458f-bdef-297db06f5600 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-17T07:23:38.141" pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1658gitlab # [ 328.468740] systemd[1]: Finished setup-gitlab.service.1659gitlab # [ 328.470589] gitlab-workhorse[819]: time="2026-08-17T07:23:39Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=521660gitlab # [ 328.473849] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/08/17:07:23:39 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.55.0" 12481661gitlab # [ 328.477395] setup-gitlab-start[3402]: To http://gitlab/root/test-flake.git1662gitlab # [ 328.478946] setup-gitlab-start[3402]: * [new branch] master -> master1663gitlab # [ 328.480566] setup-gitlab-start[3402]: branch 'master' set up to track 'origin/master'.1664gitlab # [ 328.482346] gitaly[913]: time="2026-08-17T07:23:39.200Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=315 command.inblock=8 command.majflt=0 command.maxrssanon_bytes=856064 command.minflt=13467 command.oublock=32 command.real_time_ms=1050 command.spawn_token_fork_ms=2 command.system_time_ms=185 command.user_time_ms=130 component=gitaly.StreamServerInterceptor correlation_id=01M079NG2Z5QZVN0CSZM1X8NAK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=685 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=56 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-17T07:23:38.141" grpc.time_ms=1058.898 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1665gitlab # [ 328.504178] systemd[1]: Starting nixbot CI service...1666gitlab: (finished: waiting for unit setup-gitlab.service, in 329.59 seconds)1667gitlab: waiting for unit nixbot.service1668gitlab # [ 329.790269] nixbot[3496]: {"ts": "2026-08-17T07:23:40.563Z", "level": "info", "logger": "nixbot.main", "msg": "nixbot starting", "url": "http://localhost:8010", "state_dir": "/var/lib/nixbot"}1669gitlab # [ 329.829166] nixbot[3496]: {"ts": "2026-08-17T07:23:40.603Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 1, "migration": "initial"}1670gitlab # [ 329.869057] nixbot[3496]: {"ts": "2026-08-17T07:23:40.643Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 2, "migration": "scheduled_effects"}1671gitlab # [ 329.875784] nixbot[3496]: {"ts": "2026-08-17T07:23:40.649Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 3, "migration": "gitea_webhook_secrets"}1672gitlab # [ 329.882857] nixbot[3496]: {"ts": "2026-08-17T07:23:40.657Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 4, "migration": "api_tokens"}1673gitlab # [ 329.895207] nixbot[3496]: {"ts": "2026-08-17T07:23:40.669Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 5, "migration": "status_notify"}1674gitlab # [ 329.901940] nixbot[3496]: {"ts": "2026-08-17T07:23:40.676Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 6, "migration": "webhook_secrets"}1675gitlab # [ 329.908555] nixbot[3496]: {"ts": "2026-08-17T07:23:40.679Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 7, "migration": "build_effects"}1676gitlab # [ 329.916678] nixbot[3496]: {"ts": "2026-08-17T07:23:40.690Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 8, "migration": "api_token_groups"}1677gitlab # [ 329.923208] nixbot[3496]: {"ts": "2026-08-17T07:23:40.694Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 9, "migration": "scheduled_effect_runs"}1678gitlab # [ 329.930133] nixbot[3496]: {"ts": "2026-08-17T07:23:40.703Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 10, "migration": "work_queue"}1679gitlab # [ 329.939284] nixbot[3496]: {"ts": "2026-08-17T07:23:40.713Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 11, "migration": "revoked_sessions"}1680gitlab # [ 329.946043] nixbot[3496]: {"ts": "2026-08-17T07:23:40.719Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 12, "migration": "truncate_notify_names"}1681gitlab # [ 329.952913] nixbot[3496]: {"ts": "2026-08-17T07:23:40.722Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 13, "migration": "failed_builds_per_project"}1682gitlab # [ 329.959923] nixbot[3496]: {"ts": "2026-08-17T07:23:40.728Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 14, "migration": "streamed_eval_warnings"}1683gitlab # [ 329.967163] nixbot[3496]: {"ts": "2026-08-17T07:23:40.732Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 15, "migration": "eval_completed"}1684gitlab # [ 329.973367] nixbot[3496]: {"ts": "2026-08-17T07:23:40.734Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 16, "migration": "reconcile_watermark"}1685gitlab # [ 329.979403] nixbot[3496]: {"ts": "2026-08-17T07:23:40.737Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 17, "migration": "check_runs"}1686gitlab # [ 329.984798] nixbot[3496]: {"ts": "2026-08-17T07:23:40.744Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 18, "migration": "effects_commit"}1687gitlab # [ 329.990180] nixbot[3496]: {"ts": "2026-08-17T07:23:40.747Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 19, "migration": "scheduled_run_notify"}1688gitlab # [ 329.996055] nixbot[3496]: {"ts": "2026-08-17T07:23:40.750Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 20, "migration": "log_metadata"}1689gitlab # [ 330.001051] nixbot[3496]: {"ts": "2026-08-17T07:23:40.758Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 21, "migration": "forge_refresh_tokens"}1690gitlab # [ 330.005892] nixbot[3496]: {"ts": "2026-08-17T07:23:40.760Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 22, "migration": "attr_finished_idx"}1691gitlab # [ 330.010270] nixbot[3496]: {"ts": "2026-08-17T07:23:40.765Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 23, "migration": "effect_deps"}1692gitlab # [ 330.014236] nixbot[3496]: {"ts": "2026-08-17T07:23:40.767Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 24, "migration": "drop_forge_tokens"}1693gitlab # [ 330.434527] nixbot[3496]: INFO: Started server process [3496]1694gitlab # [ 330.438363] nixbot[3496]: INFO: Uvicorn running on socket ('::', 8010, 0, 0) (Press CTRL+C to quit)1695gitlab # [ 330.454152] nixbot[3496]: INFO: ::ffff:127.0.0.1:51242 - "GET /health HTTP/1.1" 200 OK1696gitlab # [ 330.465825] systemd[1]: Started nixbot CI service.1697gitlab # [ 330.468796] systemd[1]: Reached target Multi-User System.1698gitlab # [ 330.469596] systemd[1]: Startup finished in 826ms (kernel) + 5.251s (initrd) + 5min 24.390s (userspace) = 5min 30.468s.1699gitlab: (finished: waiting for unit nixbot.service, in 2.14 seconds)1700gitlab: waiting for success: curl --fail -s http://127.0.0.1:8010/health1701gitlab # [ 331.346066] nixbot[3496]: INFO: ::ffff:127.0.0.1:38908 - "GET /health HTTP/1.1" 200 OK1702gitlab: (finished: waiting for success: curl --fail -s http://127.0.0.1:8010/health, in 0.06 seconds)1703subtest: project discovered and webhook registered1704gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks1705gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks, in 0.19 seconds)1706gitlab # [ 331.534329] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/08/17:07:23:42 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 2 "" "curl/8.21.0" 1331707gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks1708gitlab # [ 332.655207] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/08/17:07:23:43 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 2 "" "curl/8.21.0" 671709gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks, in 0.12 seconds)1710gitlab # [ 333.278300] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/08/17:07:23:44 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4909 "" "python-httpx/0.28.1" 28231711gitlab # [ 333.286647] nixbot[3496]: {"ts": "2026-08-17T07:23:44.054Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects?membership=true&archived=false&per_page=100 \"HTTP/1.1 200 OK\""}1712gitlab # [ 333.321014] nixbot[3496]: {"ts": "2026-08-17T07:23:44.095Z", "level": "info", "logger": "nixbot.repos", "msg": "legacy topic import complete", "topics": {"gitlab": "build-with-buildbot"}, "enabled": 1}1713gitlab # [ 333.445539] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/08/17:07:23:44 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 1101714gitlab # [ 333.452278] nixbot[3496]: {"ts": "2026-08-17T07:23:44.221Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 200 OK\""}1715gitlab # [ 333.459201] nixbot[3496]: {"ts": "2026-08-17T07:23:44.225Z", "level": "info", "logger": "nixbot.hook_registration", "msg": "registering webhook", "repo": "root/test-flake"}1716gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks1717gitlab # [ 333.719729] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/08/17:07:23:44 +0000] "POST /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 201 919 "" "python-httpx/0.28.1" 2621718gitlab # [ 333.722292] nixbot[3496]: {"ts": "2026-08-17T07:23:44.496Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 201 Created\""}1719gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks, in 0.25 seconds)1720(finished: subtest: project discovered and webhook registered, in 2.56 seconds)1721subtest: push delivers the webhook1722gitlab: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master1723gitlab # [ 333.906427] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/08/17:07:23:44 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 882 "" "curl/8.21.0" 1951724gitlab # [ 334.013705] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/08/17:07:23:44 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.55.0" 381725gitlab # [ 334.027778] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/08/17:07:23:44 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4909 "" "python-httpx/0.28.1" 2901726gitlab # [ 334.036284] nixbot[3496]: {"ts": "2026-08-17T07:23:44.802Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects?membership=true&archived=false&per_page=100 \"HTTP/1.1 200 OK\""}1727gitlab # [ 334.094136] gitaly[913]: time="2026-08-17T07:23:44.866Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=579 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=1 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M079NPRMEKADQAS7AY0365KT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-17T07:23:44.857" grpc.time_ms=8.808 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1728gitlab # Enumerating objects: 5, done.1729gitlab # [ 334.131380] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/08/17:07:23:44 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 201 "" "git/2.55.0" 781730gitlab # Counting objects: 20% (1/5)Counting objects: 40% (2/5)Counting objects: 60% (3/5)Counting objects: 80% (4/5)Counting objects: 100% (5/5)Counting objects: 100% (5/5), done.1731gitlab # Delta compression using up to 4 threads1732gitlab # Compressing objects: 50% (1/2)Compressing objects: 100% (2/2)Compressing objects: 100% (2/2), done.1733gitlab # Writing objects: 33% (1/3)Writing objects: 66% (2/3)Writing objects: 100% (3/3)Writing objects: 100% (3/3), 273 bytes | 273.00 KiB/s, done.1734gitlab # Total 3 (delta 1), reused 0 (delta 0), pack-reused 0 (from 0)1735gitlab # [ 334.183491] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/08/17:07:23:44 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 882 "" "python-httpx/0.28.1" 1291736gitlab # [ 334.190410] nixbot[3496]: {"ts": "2026-08-17T07:23:44.959Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 200 OK\""}1737gitlab # [ 334.396433] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/08/17:07:23:45 +0000] "PUT /api/v4/projects/root%2Ftest-flake/hooks/1 HTTP/1.1" 200 919 "" "python-httpx/0.28.1" 2051738gitlab # [ 334.404909] nixbot[3496]: {"ts": "2026-08-17T07:23:45.177Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: PUT http://gitlab/api/v4/projects/root%2Ftest-flake/hooks/1 \"HTTP/1.1 200 OK\""}1739gitlab # [ 334.425339] gitaly[913]: time="2026-08-17T07:23:45.199Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=301 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M079NPWSC42JWX5FRRRMB24W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-08-17T07:24:15.086" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-08-17T07:23:45.187" grpc.time_ms=12.097 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1740gitlab # [ 334.463069] gitaly[913]: time="2026-08-17T07:23:45.237Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01M079NPWSC42JWX5FRRRMB24W duration_ms=133ns method=POST pid=913 status=200 url="http://unix/api/v4/internal/allowed"1741gitlab # [ 334.496141] gitaly[913]: time="2026-08-17T07:23:45.270Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01M079NPWSC42JWX5FRRRMB24W duration_ms=31ns method=POST pid=913 status=200 url="http://unix/api/v4/internal/pre_receive"1742gitlab # [ 334.499873] gitaly[913]: time="2026-08-17T07:23:45.274Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M079NPWSC42JWX5FRRRMB24W grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5315 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-17T07:23:45.102" grpc.time_ms=171.174 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1743gitlab # [ 334.514629] gitaly[913]: time="2026-08-17T07:23:45.289Z" level=info msg="finished unary call with code OK" catfile.duration_ms=2 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=2 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=3 command.system_time_ms=9 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M079NQ563KSRQT0WZ03ENHZJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindBranch grpc.request.deadline="2026-08-17T07:24:15.067" grpc.request.fullMethod=/gitaly.RefService/FindBranch grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=215 grpc.service=gitaly.RefService grpc.start_time="2026-08-17T07:23:45.268" grpc.time_ms=20.25 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1744gitlab # [ 334.552646] gitaly[913]: time="2026-08-17T07:23:45.327Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M079NQ563KSRQT0WZ03ENHZJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-17T07:24:15.125" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-17T07:23:45.326" grpc.time_ms=0.696 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1745gitlab # [ 334.567393] gitaly[913]: time="2026-08-17T07:23:45.337Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M079NPWSC42JWX5FRRRMB24W grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4785 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-17T07:23:45.334" grpc.time_ms=2.677 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1746gitlab # [ 334.588712] gitaly[913]: time="2026-08-17T07:23:45.363Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=582 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=7 command.system_time_ms=6 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M079NQ563KSRQT0WZ03ENHZJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitIsAncestor grpc.request.deadline="2026-08-17T07:23:55.004" grpc.request.fullMethod=/gitaly.CommitService/CommitIsAncestor grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-08-17T07:23:45.345" grpc.time_ms=17.88 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1747gitlab # [ 334.621531] gitaly[913]: time="2026-08-17T07:23:45.396Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M079NPWSC42JWX5FRRRMB24W grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4784 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-17T07:23:45.395" grpc.time_ms=0.455 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1748gitlab # [ 334.640277] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/08/17:07:23:45 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/branches/master HTTP/1.1" 200 732 "" "python-httpx/0.28.1" 2241749gitlab # [ 334.642653] nixbot[3496]: {"ts": "2026-08-17T07:23:45.416Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/repository/branches/master \"HTTP/1.1 200 OK\""}1750gitlab # [ 334.660070] gitaly[913]: time="2026-08-17T07:23:45.434Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M079NPWSC42JWX5FRRRMB24W grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4786 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-17T07:23:45.433" grpc.time_ms=0.567 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1751gitlab # [ 334.745748] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/08/17:07:23:45 +0000] "GET /api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 971752gitlab # [ 334.750875] nixbot[3496]: {"ts": "2026-08-17T07:23:45.520Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 \"HTTP/1.1 200 OK\""}1753gitlab # [ 334.757986] nixbot[3496]: {"ts": "2026-08-17T07:23:45.524Z", "level": "info", "logger": "nixbot.reconcile", "msg": "reconciliation: building unbuilt head", "project": "root/test-flake", "branch": "master", "pr": null}1754gitlab # [ 334.763944] gitaly[913]: time="2026-08-17T07:23:45.538Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01M079NPWSC42JWX5FRRRMB24W duration_ms=58ns method=POST pid=913 status=200 url="http://unix/api/v4/internal/post_receive"1755gitlab # [ 334.767305] gitaly[913]: time="2026-08-17T07:23:45.539Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M079NPWSC42JWX5FRRRMB24W grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4809 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-17T07:23:45.479" grpc.time_ms=59.989 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1756gitlab # To http://gitlab/root/test-flake.git1757gitlab # [ 334.779582] gitaly[913]: time="2026-08-17T07:23:45.549Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01M079NPWSC42JWX5FRRRMB24W diskcache=53ef6860-0d88-4798-8d53-c4ea53a7753b grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-17T07:23:45.026" pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1758gitlab # 4e3e621..2b5870f [ 334.790309] gitlab-workhorse[819]: time="2026-08-17T07:23:45Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=521759gitlab # master -> master[ 334.792386] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/08/17:07:23:45 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.55.0" 6291760gitlab # 1761gitlab # [ 334.794491] gitaly[913]: time="2026-08-17T07:23:45.553Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=227 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=847872 command.minflt=13159 command.oublock=32 command.real_time_ms=515 command.spawn_token_fork_ms=2 command.system_time_ms=134 command.user_time_ms=93 component=gitaly.StreamServerInterceptor correlation_id=01M079NPWSC42JWX5FRRRMB24W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=605 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=56 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-17T07:23:45.026" grpc.time_ms=524.099 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1762gitlab: (finished: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master, in 0.90 seconds)1763gitlab: must succeed: git -C /tmp/test-flake rev-parse master1764gitlab: (finished: must succeed: git -C /tmp/test-flake rev-parse master, in 0.02 seconds)1765gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea'1766gitlab # [ 334.865284] gitaly[913]: time="2026-08-17T07:23:45.639Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=579 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=1 command.system_time_ms=0 command.user_time_ms=6 component=gitaly.StreamServerInterceptor correlation_id=01M079NQH5MVCYM2ZE559KXDFC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-17T07:23:45.629" grpc.time_ms=9.969 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc1767gitlab # [ 334.880419] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/08/17:07:23:45 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 671768gitlab # [ 334.939430] nixbot[3496]: INFO: ::ffff:127.0.0.1:38912 - "GET /api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea HTTP/1.1" 200 OK1769gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea', in 0.11 seconds)1770gitlab # [ 334.964113] gitaly[913]: time="2026-08-17T07:23:45.738Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M079NQKBBPAJNJ9XHMRAEAXH grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-17T07:23:45.723" pid=913 remote_ip="2001:db8:1::1" request_sha=cbf4cb85c7b4a4aa26c72509fcce4a61c2433abb response_bytes=113 span.kind=server system=grpc1771gitlab # [ 334.986579] gitaly[913]: time="2026-08-17T07:23:45.738Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=6 component=gitaly.UnaryServerInterceptor correlation_id=01M079NQKBBPAJNJ9XHMRAEAXH grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-17T07:23:45.723" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc1772gitlab # [ 335.008790] gitlab-workhorse[819]: time="2026-08-17T07:23:45Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=1131773gitlab # [ 335.012241] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/08/17:07:23:45 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 113 "" "git/2.55.0" 961774gitlab # [ 335.014374] gitaly[913]: time="2026-08-17T07:23:45.738Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=6 component=gitaly.UnaryServerInterceptor correlation_id=01M079NQKBBPAJNJ9XHMRAEAXH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=7 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-17T07:23:45.723" grpc.time_ms=15.069 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc1775gitlab # [ 335.127037] gitaly[913]: time="2026-08-17T07:23:45.900Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M079NQQ012DS8PB2E77MAPV8 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-17T07:23:45.867" pid=913 remote_ip="2001:db8:1::1" request_sha=a09f85cff68241b272749f3b101eb301f6d3ca0f response_bytes=418 span.kind=server system=grpc1776gitlab # [ 335.158798] gitaly[913]: time="2026-08-17T07:23:45.900Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=28 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1134 command.oublock=0 command.real_time_ms=29 command.spawn_token_fork_ms=2 command.system_time_ms=21 command.user_time_ms=7 component=gitaly.UnaryServerInterceptor correlation_id=01M079NQQ012DS8PB2E77MAPV8 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-17T07:23:45.867" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc1777gitlab # [ 335.193750] gitlab-workhorse[819]: time="2026-08-17T07:23:45Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=4181778gitlab # [ 335.197303] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/08/17:07:23:45 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 418 "" "git/2.55.0" 1401779gitlab # [ 335.200996] gitaly[913]: time="2026-08-17T07:23:45.901Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=28 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1134 command.oublock=0 command.real_time_ms=29 command.spawn_token_fork_ms=2 command.system_time_ms=21 command.user_time_ms=7 component=gitaly.UnaryServerInterceptor correlation_id=01M079NQQ012DS8PB2E77MAPV8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-17T07:23:45.867" grpc.time_ms=32.908 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc1780gitlab # [ 335.301337] gitaly[913]: time="2026-08-17T07:23:46.075Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=578 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M079NQX575BQJZZKQ28C8DDN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=190 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-17T07:23:46.057" grpc.time_ms=17.433 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc1781gitlab # [ 335.336829] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/08/17:07:23:46 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 1191782gitlab # [ 335.434336] gitaly[913]: time="2026-08-17T07:23:46.208Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M079NR0ZWE3VG7D5N1HAV1HD grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-17T07:23:46.189" pid=913 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc1783gitlab # [ 335.462051] gitaly[913]: time="2026-08-17T07:23:46.208Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=1 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M079NR0ZWE3VG7D5N1HAV1HD grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-17T07:23:46.189" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc1784gitlab # [ 335.485047] gitlab-workhorse[819]: time="2026-08-17T07:23:46Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671785gitlab # [ 335.487698] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/08/17:07:23:46 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 1301786gitlab # [ 335.490571] gitaly[913]: time="2026-08-17T07:23:46.209Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=1 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M079NR0ZWE3VG7D5N1HAV1HD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-17T07:23:46.189" grpc.time_ms=19.416 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc1787gitlab # [ 335.744099] gitaly[913]: time="2026-08-17T07:23:46.518Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=579 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=1 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M079NR7Q6SWJ9BSMETZA16DV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-17T07:23:46.501" grpc.time_ms=16.768 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc1788gitlab # [ 335.759595] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/08/17:07:23:46 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 2241789gitlab # [ 335.894168] gitaly[913]: time="2026-08-17T07:23:46.668Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M079NREVZET2462FK31GEQVS grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-17T07:23:46.635" pid=913 remote_ip="2001:db8:1::1" request_sha=fb62c37b60b550dd367e34acce88d0d3e3444d95 response_bytes=209 span.kind=server system=grpc1790gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea'1791gitlab # [ 335.925671] gitaly[913]: time="2026-08-17T07:23:46.668Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=28 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1101 command.oublock=0 command.real_time_ms=29 command.spawn_token_fork_ms=2 command.system_time_ms=25 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M079NREVZET2462FK31GEQVS grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-17T07:23:46.635" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc1792gitlab # [ 335.966093] gitlab-workhorse[819]: time="2026-08-17T07:23:46Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2091793gitlab # [ 335.970681] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/08/17:07:23:46 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 209 "" "git/2.55.0" 1461794gitlab # [ 335.975064] gitaly[913]: time="2026-08-17T07:23:46.669Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=28 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1101 command.oublock=0 command.real_time_ms=29 command.spawn_token_fork_ms=2 command.system_time_ms=25 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M079NREVZET2462FK31GEQVS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-17T07:23:46.635" grpc.time_ms=33.638 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc1795gitlab # [ 336.010754] nixbot[3496]: INFO: ::ffff:127.0.0.1:38914 - "GET /api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea HTTP/1.1" 200 OK1796gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea', in 0.07 seconds)1797gitlab # [ 336.103058] gitaly[913]: time="2026-08-17T07:23:46.877Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M079NRPJBKWT4AEE0M5HHC4R grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-17T07:24:16.675" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-17T07:23:46.875" grpc.time_ms=1.268 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1798gitlab # [ 336.207225] gitaly[913]: time="2026-08-17T07:23:46.980Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=591 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=2 command.system_time_ms=11 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M079NRPJBKWT4AEE0M5HHC4R grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-08-17T07:24:16.758" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-08-17T07:23:46.959" grpc.time_ms=20.765 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1799gitlab # [ 336.251760] gitaly[913]: time="2026-08-17T07:23:47.026Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=2 command.system_time_ms=7 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M079NRPJBKWT4AEE0M5HHC4R grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-17T07:23:57.009" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-17T07:23:47.010" grpc.time_ms=15.632 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1800gitlab # [ 336.286157] gitaly[913]: time="2026-08-17T07:23:47.060Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=8 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M079NRPJBKWT4AEE0M5HHC4R grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-17T07:23:57.013" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-08-17T07:23:47.043" grpc.time_ms=16.626 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1801gitlab # [ 336.435044] gitaly[913]: time="2026-08-17T07:23:47.209Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M079NRPJBKWT4AEE0M5HHC4R grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-08-17T07:23:57.177" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-17T07:23:47.208" grpc.time_ms=0.696 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1802gitlab # [ 336.467457] gitaly[913]: time="2026-08-17T07:23:47.241Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=12 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M079NRPJBKWT4AEE0M5HHC4R grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-08-17T07:23:57.193" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-17T07:23:47.224" grpc.time_ms=16.742 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1803gitlab # [ 336.542126] gitaly[913]: time="2026-08-17T07:23:47.316Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M079NRPJBKWT4AEE0M5HHC4R grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4153 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-17T07:23:47.315" grpc.time_ms=0.993 pid=913 span.kind=server system=grpc1804gitlab # [ 336.617871] gitaly[913]: time="2026-08-17T07:23:47.392Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M079NRPJBKWT4AEE0M5HHC4R grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4155 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-17T07:23:47.391" grpc.time_ms=0.709 pid=913 span.kind=server system=grpc1805gitlab # [ 336.647802] gitaly[913]: time="2026-08-17T07:23:47.405Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M079NRPJBKWT4AEE0M5HHC4R diskcache=40ecd58b-7b72-4a3b-bbc6-1e99b5a830bd grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-17T07:23:57.215" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-17T07:23:47.246" pid=913 ref=refs/keep-around/4e3e621ff53dd96f25cf46cfa8633c0472c0ba33 remote_ip="2001:db8:1::1" revision=4e3e621ff53dd96f25cf46cfa8633c0472c0ba33 span.kind=server system=grpc username=root1806gitlab # [ 336.673113] gitaly[913]: time="2026-08-17T07:23:47.406Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=137 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5435 command.oublock=8 command.real_time_ms=151 command.spawn_token_fork_ms=2 command.system_time_ms=58 command.user_time_ms=79 component=gitaly.UnaryServerInterceptor correlation_id=01M079NRPJBKWT4AEE0M5HHC4R grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-17T07:23:57.215" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-17T07:23:47.246" grpc.time_ms=159.45 pid=913 ref=refs/keep-around/4e3e621ff53dd96f25cf46cfa8633c0472c0ba33 remote_ip="2001:db8:1::1" revision=4e3e621ff53dd96f25cf46cfa8633c0472c0ba33 span.kind=server system=grpc username=root1807gitlab # [ 336.696209] gitaly[913]: time="2026-08-17T07:23:47.412Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M079NRPJBKWT4AEE0M5HHC4R grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-17T07:24:17.211" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-17T07:23:47.411" grpc.time_ms=0.798 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1808gitlab # [ 336.873622] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/08/17:07:23:47 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/4e3e621ff53dd96f25cf46cfa8633c0472c0ba33 HTTP/1.1" 201 631 "" "python-httpx/0.28.1" 8751809gitlab # [ 336.877133] nixbot[3496]: {"ts": "2026-08-17T07:23:47.648Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/4e3e621ff53dd96f25cf46cfa8633c0472c0ba33 \"HTTP/1.1 201 Created\""}1810gitlab # [ 336.888282] nixbot[3496]: {"ts": "2026-08-17T07:23:47.662Z", "level": "info", "logger": "nixbot.flake_prefetch", "msg": "prefetching flake inputs", "flake_dir": "/var/lib/nixbot/worktrees/1-4e3e621ff53d-0"}1811gitlab # [ 337.010918] systemd[1]: Started Nix Daemon.1812gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea'1813gitlab # [ 337.074355] nixbot[3496]: INFO: ::ffff:127.0.0.1:38924 - "GET /api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea HTTP/1.1" 200 OK1814gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea', in 0.07 seconds)1815gitlab # [ 337.116247] nix-daemon[3720]: accepted connection from pid 3714, user nixbot1816gitlab # [ 337.254632] nix-daemon[3720]: accepted connection from pid 3730, user nixbot1817gitlab # [ 337.280472] nixbot[3496]: {"ts": "2026-08-17T07:23:48.054Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-4e3e621ff53d-0", "argv0": "bwrap"}1818gitlab # [ 337.495441] nix-daemon[3720]: accepted connection from pid 3740, user nixbot1819gitlab # [ 337.614493] nix-daemon[3720]: accepted connection from pid 3750, user nixbot1820gitlab # [ 337.646370] nix-daemon[3720]: accepted connection from pid 3740, user nixbot1821gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea'1822gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea', in 0.06 seconds)1823gitlab # [ 338.137032] nixbot[3496]: INFO: ::ffff:127.0.0.1:38928 - "GET /api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea HTTP/1.1" 200 OK1824gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea'1825gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea', in 0.05 seconds)1826gitlab # [ 339.190618] nixbot[3496]: INFO: ::ffff:127.0.0.1:38938 - "GET /api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea HTTP/1.1" 200 OK1827gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea'1828gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea', in 0.05 seconds)1829gitlab # [ 340.244941] nixbot[3496]: INFO: ::ffff:127.0.0.1:38940 - "GET /api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea HTTP/1.1" 200 OK1830gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea'1831gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea', in 0.05 seconds)1832gitlab # [ 341.297583] nixbot[3496]: INFO: ::ffff:127.0.0.1:41836 - "GET /api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea HTTP/1.1" 200 OK1833gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea'1834gitlab # [ 342.350092] nixbot[3496]: INFO: ::ffff:127.0.0.1:41852 - "GET /api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea HTTP/1.1" 200 OK1835gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea', in 0.06 seconds)1836gitlab # [ 342.904356] gitaly[913]: time="2026-08-17T07:23:53.678Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M079NZAD5YN1B5YJWJ5FJJ46 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-17T07:24:23.275" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-17T07:23:53.676" grpc.time_ms=1.03 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1837gitlab # [ 343.122852] gitaly[913]: time="2026-08-17T07:23:53.897Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=7 command.user_time_ms=7 component=gitaly.StreamServerInterceptor correlation_id=01M079NZAD5YN1B5YJWJ5FJJ46 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-17T07:24:03.127" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-17T07:23:53.878" grpc.time_ms=18.091 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1838gitlab # [ 343.283690] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/08/17:07:23:54 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/4e3e621ff53dd96f25cf46cfa8633c0472c0ba33 HTTP/1.1" 201 669 "" "python-httpx/0.28.1" 5071839gitlab # [ 343.287087] nixbot[3496]: {"ts": "2026-08-17T07:23:54.060Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/4e3e621ff53dd96f25cf46cfa8633c0472c0ba33 \"HTTP/1.1 201 Created\""}1840gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea'1841gitlab # [ 343.358823] gitaly[913]: time="2026-08-17T07:23:54.133Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M079NZTMVPJ12BJNG1QHZH7E grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-17T07:24:24.031" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-17T07:23:54.131" grpc.time_ms=1.101 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1842gitlab # [ 343.404878] nixbot[3496]: INFO: ::ffff:127.0.0.1:41854 - "GET /api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea HTTP/1.1" 200 OK1843gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea', in 0.05 seconds)1844gitlab # [ 343.462721] gitaly[913]: time="2026-08-17T07:23:54.237Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M079NZTMVPJ12BJNG1QHZH7E grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-17T07:24:04.189" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-17T07:23:54.219" grpc.time_ms=17.223 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1845gitlab # [ 343.592078] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/08/17:07:23:54 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/4e3e621ff53dd96f25cf46cfa8633c0472c0ba33 HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 2971846gitlab # [ 343.600225] nixbot[3496]: {"ts": "2026-08-17T07:23:54.368Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/4e3e621ff53dd96f25cf46cfa8633c0472c0ba33 \"HTTP/1.1 201 Created\""}1847gitlab # [ 343.734587] gitaly[913]: time="2026-08-17T07:23:54.508Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M079P04R51SR8T50H2HR6NRR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-17T07:24:24.306" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-17T07:23:54.507" grpc.time_ms=1.195 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1848gitlab # [ 343.792496] gitaly[913]: time="2026-08-17T07:23:54.566Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=2 command.system_time_ms=5 command.user_time_ms=7 component=gitaly.StreamServerInterceptor correlation_id=01M079P04R51SR8T50H2HR6NRR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-17T07:24:04.210" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-17T07:23:54.551" grpc.time_ms=15.534 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1849gitlab # [ 343.866220] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/08/17:07:23:54 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/4e3e621ff53dd96f25cf46cfa8633c0472c0ba33 HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 2481850gitlab # [ 343.870420] nixbot[3496]: {"ts": "2026-08-17T07:23:54.642Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/4e3e621ff53dd96f25cf46cfa8633c0472c0ba33 \"HTTP/1.1 201 Created\""}1851gitlab # [ 344.022213] nix-daemon[3720]: accepted connection from pid 3795, user nixbot1852gitlab # [ 344.363204] gitaly[913]: time="2026-08-17T07:23:55.136Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=578 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=2 command.system_time_ms=7 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M079P0M4N1ZPAS99KXV3JEW2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=192 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-17T07:23:55.121" grpc.time_ms=14.957 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc1853gitlab # [ 344.403254] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/08/17:07:23:55 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 2521854gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea'1855gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea', in 0.06 seconds)1856gitlab # [ 344.453098] gitaly[913]: time="2026-08-17T07:23:55.227Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M079P0W22NRN755JJ20K231Q grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-17T07:23:55.212" pid=913 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc1857gitlab # [ 344.475610] gitaly[913]: time="2026-08-17T07:23:55.227Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=2 command.system_time_ms=6 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M079P0W22NRN755JJ20K231Q grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-17T07:23:55.212" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc1858gitlab # [ 344.500321] nixbot[3496]: INFO: ::ffff:127.0.0.1:41862 - "GET /api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea HTTP/1.1" 200 OK1859gitlab # [ 344.503291] gitlab-workhorse[819]: time="2026-08-17T07:23:55Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671860gitlab # [ 344.506062] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/08/17:07:23:55 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 891861gitlab # [ 344.508809] gitaly[913]: time="2026-08-17T07:23:55.227Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=2 command.system_time_ms=6 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M079P0W22NRN755JJ20K231Q grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-17T07:23:55.212" grpc.time_ms=15.583 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc1862gitlab # [ 344.614322] nix-daemon[3720]: accepted connection from pid 3823, user nixbot1863gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea'1864gitlab # [ 345.515861] nixbot[3496]: INFO: ::ffff:127.0.0.1:41876 - "GET /api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea HTTP/1.1" 200 OK1865gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea', in 0.06 seconds)1866gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea'1867gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea', in 0.05 seconds)1868gitlab # [ 346.570183] nixbot[3496]: INFO: ::ffff:127.0.0.1:41890 - "GET /api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea HTTP/1.1" 200 OK1869gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea'1870gitlab # [ 347.623492] nixbot[3496]: INFO: ::ffff:127.0.0.1:41904 - "GET /api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea HTTP/1.1" 200 OK1871gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea', in 0.06 seconds)1872gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea'1873gitlab # [ 348.678253] nixbot[3496]: INFO: ::ffff:127.0.0.1:41912 - "GET /api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea HTTP/1.1" 200 OK1874gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea', in 0.05 seconds)1875gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea'1876gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea', in 0.05 seconds)1877gitlab # [ 349.734027] nixbot[3496]: INFO: ::ffff:127.0.0.1:41920 - "GET /api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea HTTP/1.1" 200 OK1878gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea'1879gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea', in 0.05 seconds)1880gitlab # [ 350.787794] nixbot[3496]: INFO: ::ffff:127.0.0.1:41934 - "GET /api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea HTTP/1.1" 200 OK1881gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea'1882gitlab # [ 351.842018] nixbot[3496]: INFO: ::ffff:127.0.0.1:50744 - "GET /api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea HTTP/1.1" 200 OK1883gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea', in 0.06 seconds)1884gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea'1885gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea', in 0.05 seconds)1886gitlab # [ 352.897187] nixbot[3496]: INFO: ::ffff:127.0.0.1:50756 - "GET /api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea HTTP/1.1" 200 OK1887gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea'1888gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea', in 0.05 seconds)1889gitlab # [ 353.951088] nixbot[3496]: INFO: ::ffff:127.0.0.1:50770 - "GET /api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea HTTP/1.1" 200 OK1890gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea'1891gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea', in 0.05 seconds)1892gitlab # [ 355.004921] nixbot[3496]: INFO: ::ffff:127.0.0.1:50780 - "GET /api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea HTTP/1.1" 200 OK1893gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea'1894gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea', in 0.05 seconds)1895gitlab # [ 356.057776] nixbot[3496]: INFO: ::ffff:127.0.0.1:50790 - "GET /api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea HTTP/1.1" 200 OK1896gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea'1897gitlab # [ 357.110691] nixbot[3496]: INFO: ::ffff:127.0.0.1:50802 - "GET /api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea HTTP/1.1" 200 OK1898gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea', in 0.05 seconds)1899gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea'1900gitlab # [ 358.165405] nixbot[3496]: INFO: ::ffff:127.0.0.1:50808 - "GET /api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea HTTP/1.1" 200 OK1901gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea', in 0.05 seconds)1902gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea'1903gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea', in 0.05 seconds)1904gitlab # [ 359.221042] nixbot[3496]: INFO: ::ffff:127.0.0.1:50822 - "GET /api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea HTTP/1.1" 200 OK1905gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea'1906gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea', in 0.05 seconds)1907gitlab # [ 360.274948] nixbot[3496]: INFO: ::ffff:127.0.0.1:50824 - "GET /api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea HTTP/1.1" 200 OK1908gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea'1909gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea', in 0.05 seconds)1910gitlab # [ 361.327209] nixbot[3496]: INFO: ::ffff:127.0.0.1:46438 - "GET /api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea HTTP/1.1" 200 OK1911gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea'1912gitlab # [ 362.378819] nixbot[3496]: INFO: ::ffff:127.0.0.1:46446 - "GET /api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea HTTP/1.1" 200 OK1913gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea', in 0.05 seconds)1914gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea'1915gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea', in 0.05 seconds)1916gitlab # [ 363.434202] nixbot[3496]: INFO: ::ffff:127.0.0.1:46462 - "GET /api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea HTTP/1.1" 200 OK1917gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea'1918gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea', in 0.05 seconds)1919gitlab # [ 364.488444] nixbot[3496]: INFO: ::ffff:127.0.0.1:46470 - "GET /api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea HTTP/1.1" 200 OK1920gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea'1921gitlab # [ 365.540686] nixbot[3496]: INFO: ::ffff:127.0.0.1:46476 - "GET /api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea HTTP/1.1" 200 OK1922gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea', in 0.06 seconds)1923gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea'1924gitlab # [ 366.596200] nixbot[3496]: INFO: ::ffff:127.0.0.1:46486 - "GET /api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea HTTP/1.1" 200 OK1925gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea', in 0.05 seconds)1926gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea'1927gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea', in 0.05 seconds)1928gitlab # [ 367.650959] nixbot[3496]: INFO: ::ffff:127.0.0.1:46498 - "GET /api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea HTTP/1.1" 200 OK1929gitlab # [ 368.082096] sidekiq-cluster[3421]: 2026-08-17T07:24:18.855Z pid=3421 tid=yr9 INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>3421, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>434405376}1930gitlab # [ 368.362875] sidekiq-cluster[3421]: W, [2026-08-17T07:24:19.137080 #3421] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1931gitlab # [ 368.426413] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-17T07:24:19.200Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"}1932gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea'1933gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea', in 0.05 seconds)1934gitlab # [ 368.702866] nixbot[3496]: INFO: ::ffff:127.0.0.1:46512 - "GET /api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea HTTP/1.1" 200 OK1935gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea'1936gitlab # [ 369.751489] nixbot[3496]: INFO: ::ffff:127.0.0.1:46526 - "GET /api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea HTTP/1.1" 200 OK1937gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea', in 0.05 seconds)1938gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea'1939gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea', in 0.05 seconds)1940gitlab # [ 370.806226] nixbot[3496]: INFO: ::ffff:127.0.0.1:46536 - "GET /api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea HTTP/1.1" 200 OK1941gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea'1942gitlab # [ 371.858684] nixbot[3496]: INFO: ::ffff:127.0.0.1:50600 - "GET /api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea HTTP/1.1" 200 OK1943gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea', in 0.06 seconds)1944gitlab # [ 371.942675] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-17T07:24:22.715Z","message":"GitLab reliable fetch activated!"}1945gitlab # [ 371.947850] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-17T07:24:22.716Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1946gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea'1947gitlab # [ 372.914799] nixbot[3496]: INFO: ::ffff:127.0.0.1:50612 - "GET /api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea HTTP/1.1" 200 OK1948gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea', in 0.06 seconds)1949gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea'1950gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea', in 0.05 seconds)1951gitlab # [ 373.970700] nixbot[3496]: INFO: ::ffff:127.0.0.1:50622 - "GET /api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea HTTP/1.1" 200 OK1952gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea'1953gitlab # [ 375.023172] nixbot[3496]: INFO: ::ffff:127.0.0.1:50634 - "GET /api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea HTTP/1.1" 200 OK1954gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea', in 0.06 seconds)1955gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea'1956gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea', in 0.05 seconds)1957gitlab # [ 376.078950] nixbot[3496]: INFO: ::ffff:127.0.0.1:50638 - "GET /api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea HTTP/1.1" 200 OK1958gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea'1959gitlab # [ 377.130738] nixbot[3496]: INFO: ::ffff:127.0.0.1:50648 - "GET /api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea HTTP/1.1" 200 OK1960gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea', in 0.05 seconds)1961gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea'1962gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea', in 0.05 seconds)1963gitlab # [ 378.186436] nixbot[3496]: INFO: ::ffff:127.0.0.1:50654 - "GET /api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea HTTP/1.1" 200 OK1964gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea'1965gitlab # [ 379.238733] nixbot[3496]: INFO: ::ffff:127.0.0.1:50668 - "GET /api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea HTTP/1.1" 200 OK1966gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea', in 0.05 seconds)1967gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea'1968gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea', in 0.05 seconds)1969gitlab # [ 380.293797] nixbot[3496]: INFO: ::ffff:127.0.0.1:50680 - "GET /api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea HTTP/1.1" 200 OK1970gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea'1971gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea', in 0.05 seconds)1972gitlab # [ 381.346303] nixbot[3496]: INFO: ::ffff:127.0.0.1:45732 - "GET /api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea HTTP/1.1" 200 OK1973gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea'1974gitlab # [ 382.398690] nixbot[3496]: INFO: ::ffff:127.0.0.1:45736 - "GET /api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea HTTP/1.1" 200 OK1975gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea', in 0.05 seconds)1976gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea'1977gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea', in 0.05 seconds)1978gitlab # [ 383.453966] nixbot[3496]: INFO: ::ffff:127.0.0.1:45746 - "GET /api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea HTTP/1.1" 200 OK1979gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea'1980gitlab # [ 384.506941] nixbot[3496]: INFO: ::ffff:127.0.0.1:45754 - "GET /api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea HTTP/1.1" 200 OK1981gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea', in 0.05 seconds)1982gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea'1983gitlab # [ 385.561973] nixbot[3496]: INFO: ::ffff:127.0.0.1:45762 - "GET /api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea HTTP/1.1" 200 OK1984gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea', in 0.06 seconds)1985gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea'1986gitlab # [ 386.617903] nixbot[3496]: INFO: ::ffff:127.0.0.1:45772 - "GET /api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea HTTP/1.1" 200 OK1987gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea', in 0.06 seconds)1988gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea'1989gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea', in 0.05 seconds)1990gitlab # [ 387.673367] nixbot[3496]: INFO: ::ffff:127.0.0.1:45786 - "GET /api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea HTTP/1.1" 200 OK1991gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea'1992gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea', in 0.05 seconds)1993gitlab # [ 388.726031] nixbot[3496]: INFO: ::ffff:127.0.0.1:45800 - "GET /api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea HTTP/1.1" 200 OK1994gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea'1995gitlab # [ 389.778538] nixbot[3496]: INFO: ::ffff:127.0.0.1:45808 - "GET /api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea HTTP/1.1" 200 OK1996gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea', in 0.05 seconds)1997gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea'1998gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea', in 0.05 seconds)1999gitlab # [ 390.834450] nixbot[3496]: INFO: ::ffff:127.0.0.1:47640 - "GET /api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea HTTP/1.1" 200 OK2000gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea'2001gitlab # [ 391.887953] nixbot[3496]: INFO: ::ffff:127.0.0.1:47646 - "GET /api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea HTTP/1.1" 200 OK2002gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea', in 0.06 seconds)2003gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea'2004gitlab # [ 392.943181] nixbot[3496]: INFO: ::ffff:127.0.0.1:47658 - "GET /api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea HTTP/1.1" 200 OK2005gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea', in 0.06 seconds)2006gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea'2007gitlab # [ 393.998889] nixbot[3496]: INFO: ::ffff:127.0.0.1:47670 - "GET /api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea HTTP/1.1" 200 OK2008gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea', in 0.05 seconds)2009gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea'2010gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea', in 0.05 seconds)2011gitlab # [ 395.054410] nixbot[3496]: INFO: ::ffff:127.0.0.1:47680 - "GET /api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea HTTP/1.1" 200 OK2012gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea'2013gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea', in 0.05 seconds)2014gitlab # [ 396.107238] nixbot[3496]: INFO: ::ffff:127.0.0.1:47690 - "GET /api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea HTTP/1.1" 200 OK2015gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea'2016gitlab # [ 397.158624] nixbot[3496]: INFO: ::ffff:127.0.0.1:47702 - "GET /api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea HTTP/1.1" 200 OK2017gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea', in 0.05 seconds)2018gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea'2019gitlab # [ 398.214240] nixbot[3496]: INFO: ::ffff:127.0.0.1:47706 - "GET /api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea HTTP/1.1" 200 OK2020gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea', in 0.06 seconds)2021gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea'2022gitlab # [ 399.269413] nixbot[3496]: INFO: ::ffff:127.0.0.1:47714 - "GET /api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea HTTP/1.1" 200 OK2023gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea', in 0.06 seconds)2024gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea'2025gitlab # [ 400.324922] nixbot[3496]: INFO: ::ffff:127.0.0.1:47728 - "GET /api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea HTTP/1.1" 200 OK2026gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea', in 0.06 seconds)2027gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea'2028gitlab # [ 401.381077] nixbot[3496]: INFO: ::ffff:127.0.0.1:33806 - "GET /api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea HTTP/1.1" 200 OK2029gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea', in 0.06 seconds)2030gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea'2031gitlab # [ 402.438074] nixbot[3496]: INFO: ::ffff:127.0.0.1:33822 - "GET /api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea HTTP/1.1" 200 OK2032gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea', in 0.06 seconds)2033gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea'2034gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea', in 0.05 seconds)2035gitlab # [ 403.493110] nixbot[3496]: INFO: ::ffff:127.0.0.1:33834 - "GET /api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea HTTP/1.1" 200 OK2036gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea'2037gitlab # [ 404.547683] nixbot[3496]: INFO: ::ffff:127.0.0.1:33846 - "GET /api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea HTTP/1.1" 200 OK2038gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea', in 0.06 seconds)2039gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea'2040gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea', in 0.05 seconds)2041gitlab # [ 405.602593] nixbot[3496]: INFO: ::ffff:127.0.0.1:33850 - "GET /api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea HTTP/1.1" 200 OK2042gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea'2043gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea', in 0.05 seconds)2044gitlab # [ 406.657200] nixbot[3496]: INFO: ::ffff:127.0.0.1:33860 - "GET /api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea HTTP/1.1" 200 OK2045gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea'2046gitlab # [ 407.711038] nixbot[3496]: INFO: ::ffff:127.0.0.1:33874 - "GET /api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea HTTP/1.1" 200 OK2047gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea', in 0.06 seconds)2048gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea'2049gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea', in 0.05 seconds)2050gitlab # [ 408.766605] nixbot[3496]: INFO: ::ffff:127.0.0.1:33884 - "GET /api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea HTTP/1.1" 200 OK2051gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea'2052gitlab # [ 409.822233] nixbot[3496]: INFO: ::ffff:127.0.0.1:33888 - "GET /api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea HTTP/1.1" 200 OK2053gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea', in 0.06 seconds)2054gitlab # [ 410.146079] postgres[4030]: [4030] ERROR: relation "table_without_models" does not exist2055gitlab # [ 410.149702] postgres[4030]: [4030] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')2056gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea'2057gitlab # [ 410.878981] nixbot[3496]: INFO: ::ffff:127.0.0.1:42878 - "GET /api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea HTTP/1.1" 200 OK2058gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea', in 0.06 seconds)2059gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea'2060gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea', in 0.05 seconds)2061gitlab # [ 411.933320] nixbot[3496]: INFO: ::ffff:127.0.0.1:42892 - "GET /api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea HTTP/1.1" 200 OK2062gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea'2063gitlab # [ 412.985944] nixbot[3496]: INFO: ::ffff:127.0.0.1:42898 - "GET /api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea HTTP/1.1" 200 OK2064gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea', in 0.05 seconds)2065gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea'2066gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea', in 0.05 seconds)2067gitlab # [ 414.041143] nixbot[3496]: INFO: ::ffff:127.0.0.1:42900 - "GET /api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea HTTP/1.1" 200 OK2068gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea'2069gitlab # [ 415.071476] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-17T07:25:05.844Z","message":"Booted Rails 7.2.3.1 application in production environment"}2070gitlab # [ 415.072113] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-17T07:25:05.844Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [aarch64-linux]"}2071gitlab # [ 415.072284] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-17T07:25:05.845Z","message":"See LICENSE and the LGPL-3.0 for licensing details."}2072gitlab # [ 415.072387] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-17T07:25:05.845Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"}2073gitlab # [ 415.072522] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-17T07:25:05.846Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}2074gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea', in 0.07 seconds)2075gitlab # [ 415.095288] nixbot[3496]: INFO: ::ffff:127.0.0.1:42904 - "GET /api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea HTTP/1.1" 200 OK2076gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea'2077gitlab # [ 416.161646] nixbot[3496]: INFO: ::ffff:127.0.0.1:42920 - "GET /api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea HTTP/1.1" 200 OK2078gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea', in 0.06 seconds)2079gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea'2080gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea', in 0.05 seconds)2081gitlab # [ 417.216641] nixbot[3496]: INFO: ::ffff:127.0.0.1:42930 - "GET /api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea HTTP/1.1" 200 OK2082gitlab # [ 417.729853] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-17T07:25:08.502Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"4eb26d922753cff8d8fbe6b6","created_at":"2026-08-17T07:23:35.173Z","trace_propagation_headers":{"sentry-trace":"8e7b00baa85749f4aee3de37beb0237a-0f4e112461584a47","baggage":"sentry-trace_id=8e7b00baa85749f4aee3de37beb0237a,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M079NBG1ENEWCYNDBRMBG52K","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-08-17T07:23:35.228Z","job_size_bytes":2,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-4eb26d922753cff8d8fbe6b6: start","job_status":"start","queue_duration_s":93.273821,"scheduling_latency_s":93.273875}2083gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea'2084gitlab # [ 418.129681] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-17T07:25:08.902Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"4eb26d922753cff8d8fbe6b6","created_at":"2026-08-17T07:23:35.173Z","trace_propagation_headers":{"sentry-trace":"8e7b00baa85749f4aee3de37beb0237a-0f4e112461584a47","baggage":"sentry-trace_id=8e7b00baa85749f4aee3de37beb0237a,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M079NBG1ENEWCYNDBRMBG52K","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-08-17T07:23:35.228Z","job_size_bytes":2,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-4eb26d922753cff8d8fbe6b6: done: 0.400263 sec","job_status":"done","queue_duration_s":93.273821,"scheduling_latency_s":93.273875,"redis_calls":23,"redis_duration_s":0.010588,"redis_read_bytes":910,"redis_write_bytes":2540,"redis_feature_flag_calls":13,"redis_feature_flag_duration_s":0.005518,"redis_feature_flag_read_bytes":902,"redis_feature_flag_write_bytes":1375,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003018,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":606,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002052,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":559,"db_count":10,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":10,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.023,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":9,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.019,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.214297,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.2134186,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.400263,"completed_at":"2026-08-17T07:25:08.902Z","load_balancing_strategy":"primary","db_duration_s":0.10694,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2085gitlab # [ 418.233261] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-17T07:25:08.906Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"d58c7d04373b01a63ada6fb3","created_at":"2026-08-17T07:23:35.246Z","trace_propagation_headers":{"sentry-trace":"8e7b00baa85749f4aee3de37beb0237a-0f4e112461584a47","baggage":"sentry-trace_id=8e7b00baa85749f4aee3de37beb0237a,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M079NBG1ENEWCYNDBRMBG52K","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-08-17T07:23:35.254Z","job_size_bytes":2,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-d58c7d04373b01a63ada6fb3: start","job_status":"start","queue_duration_s":93.651677,"scheduling_latency_s":93.651719}2086gitlab # [ 418.271166] nixbot[3496]: INFO: ::ffff:127.0.0.1:42932 - "GET /api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea HTTP/1.1" 200 OK2087gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea', in 0.06 seconds)2088gitlab # [ 418.326948] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-17T07:25:09.100Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"d58c7d04373b01a63ada6fb3","created_at":"2026-08-17T07:23:35.246Z","trace_propagation_headers":{"sentry-trace":"8e7b00baa85749f4aee3de37beb0237a-0f4e112461584a47","baggage":"sentry-trace_id=8e7b00baa85749f4aee3de37beb0237a,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M079NBG1ENEWCYNDBRMBG52K","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-08-17T07:23:35.254Z","job_size_bytes":2,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-d58c7d04373b01a63ada6fb3: done: 0.194463 sec","job_status":"done","queue_duration_s":93.651677,"scheduling_latency_s":93.651719,"redis_calls":14,"redis_duration_s":0.005718,"redis_read_bytes":140,"redis_write_bytes":1653,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.001042,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":422,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002985,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":680,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001691,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":551,"db_count":8,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.018,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.015,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.145958,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.14932672,"extra.projects_process_sync_events_worker.estimated_total_events":1,"extra.projects_process_sync_events_worker.consumable_events":1,"extra.projects_process_sync_events_worker.processed_events":1,"duration_s":0.194463,"completed_at":"2026-08-17T07:25:09.100Z","load_balancing_strategy":"primary","db_duration_s":0.036982,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2089gitlab # [ 418.417649] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-17T07:25:09.103Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"3dbdb18767d2fc523af262be","created_at":"2026-08-17T07:23:36.210Z","trace_propagation_headers":{"sentry-trace":"8e7b00baa85749f4aee3de37beb0237a-0f4e112461584a47","baggage":"sentry-trace_id=8e7b00baa85749f4aee3de37beb0237a,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M079NBG1ENEWCYNDBRMBG52K","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-08-17T07:23:36.219Z","job_size_bytes":5,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-3dbdb18767d2fc523af262be: start","job_status":"start","queue_duration_s":92.883883,"scheduling_latency_s":92.883914}2090gitlab # [ 418.562042] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-17T07:25:09.335Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"3dbdb18767d2fc523af262be","created_at":"2026-08-17T07:23:36.210Z","trace_propagation_headers":{"sentry-trace":"8e7b00baa85749f4aee3de37beb0237a-0f4e112461584a47","baggage":"sentry-trace_id=8e7b00baa85749f4aee3de37beb0237a,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M079NBG1ENEWCYNDBRMBG52K","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-08-17T07:23:36.219Z","job_size_bytes":5,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-3dbdb18767d2fc523af262be: done: 0.232734 sec","job_status":"done","queue_duration_s":92.883883,"scheduling_latency_s":92.883914,"redis_calls":12,"redis_duration_s":0.003844,"redis_read_bytes":138,"redis_write_bytes":1541,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.001034,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":491,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002215,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":784,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000595,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":14,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":14,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.024,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.024,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.183628,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00050528,"duration_s":0.232734,"completed_at":"2026-08-17T07:25:09.335Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.041494,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2091gitlab # [ 418.667705] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-17T07:25:09.337Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"d827b3dd7bd1d2d70b9cbf51","created_at":"2026-08-17T07:23:36.258Z","trace_propagation_headers":{"sentry-trace":"8e7b00baa85749f4aee3de37beb0237a-0f4e112461584a47","baggage":"sentry-trace_id=8e7b00baa85749f4aee3de37beb0237a,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M079NBG1ENEWCYNDBRMBG52K","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-08-17T07:23:36.266Z","job_size_bytes":3,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-d827b3dd7bd1d2d70b9cbf51: start","job_status":"start","queue_duration_s":93.071348,"scheduling_latency_s":93.071368}2092gitlab # [ 418.845087] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-17T07:25:09.617Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"d827b3dd7bd1d2d70b9cbf51","created_at":"2026-08-17T07:23:36.258Z","trace_propagation_headers":{"sentry-trace":"8e7b00baa85749f4aee3de37beb0237a-0f4e112461584a47","baggage":"sentry-trace_id=8e7b00baa85749f4aee3de37beb0237a,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M079NBG1ENEWCYNDBRMBG52K","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-08-17T07:23:36.266Z","job_size_bytes":3,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-d827b3dd7bd1d2d70b9cbf51: done: 0.280241 sec","job_status":"done","queue_duration_s":93.071348,"scheduling_latency_s":93.071368,"redis_calls":11,"redis_duration_s":0.003105,"redis_read_bytes":137,"redis_write_bytes":1147,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000719,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":407,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001822,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":538,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000564,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":202,"db_count":35,"db_write_count":6,"db_cached_count":2,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":35,"db_replica_write_count":0,"db_primary_write_count":6,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.041,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":34,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":6,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":2,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.236,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.236,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.04,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.178373,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00059968,"duration_s":0.280241,"completed_at":"2026-08-17T07:25:09.617Z","load_balancing_strategy":"primary","db_duration_s":0.105428,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2093gitlab # [ 418.940083] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-17T07:25:09.620Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"d4eef9f2241ce8da033df688","created_at":"2026-08-17T07:23:36.271Z","trace_propagation_headers":{"sentry-trace":"8e7b00baa85749f4aee3de37beb0237a-0f4e112461584a47","baggage":"sentry-trace_id=8e7b00baa85749f4aee3de37beb0237a,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M079NBG1ENEWCYNDBRMBG52K","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-08-17T07:23:36.278Z","job_size_bytes":89,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-d4eef9f2241ce8da033df688: start","job_status":"start","queue_duration_s":93.342063,"scheduling_latency_s":93.342089}2094gitlab # [ 418.960511] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-17T07:25:09.669Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"d4eef9f2241ce8da033df688","created_at":"2026-08-17T07:23:36.271Z","trace_propagation_headers":{"sentry-trace":"8e7b00baa85749f4aee3de37beb0237a-0f4e112461584a47","baggage":"sentry-trace_id=8e7b00baa85749f4aee3de37beb0237a,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M079NBG1ENEWCYNDBRMBG52K","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-08-17T07:23:36.278Z","job_size_bytes":89,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-d4eef9f2241ce8da033df688: done: 0.049243 sec","job_status":"done","queue_duration_s":93.342063,"scheduling_latency_s":93.342089,"redis_calls":11,"redis_duration_s":0.002987,"redis_read_bytes":137,"redis_write_bytes":1267,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000749,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":443,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001694,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":594,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000544,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":230,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.032118,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00051318,"duration_s":0.049243,"completed_at":"2026-08-17T07:25:09.669Z","load_balancing_strategy":"primary","db_duration_s":0.00809,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2095gitlab # [ 419.006156] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-17T07:25:09.671Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 4e3e621ff53dd96f25cf46cfa8633c0472c0ba33 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"08d74075ee1fca5678e3b088","created_at":"2026-08-17T07:23:38.900Z","trace_propagation_headers":{"sentry-trace":"e3c3cf4272ad43299b705d9df675c8bb-dd0f9f6561754c07","baggage":"sentry-trace_id=e3c3cf4272ad43299b705d9df675c8bb,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M079NG2Z5QZVN0CSZM1X8NAK","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:23:38.963Z","job_size_bytes":185,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-08d74075ee1fca5678e3b088: start","job_status":"start","queue_duration_s":90.707613,"scheduling_latency_s":90.707637}2096gitlab # [ 419.023104] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-17T07:25:09.691Z","message":"changes: \"0000000000000000000000000000000000000000 4e3e621ff53dd96f25cf46cfa8633c0472c0ba33 refs/heads/master\\n\""}2097gitlab # [ 419.025884] gitaly[913]: time="2026-08-17T07:25:09.742Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=1 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M079NG2Z5QZVN0CSZM1X8NAK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-17T07:25:19.005" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-08-17T07:25:09.725" grpc.time_ms=16.668 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2098gitlab # [ 419.038808] gitaly[913]: time="2026-08-17T07:25:09.765Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=1 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M079NG2Z5QZVN0CSZM1X8NAK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-17T07:25:19.027" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-17T07:25:09.748" grpc.time_ms=16.67 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2099gitlab # [ 419.063482] gitaly[913]: time="2026-08-17T07:25:09.837Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=583 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=1 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M079NG2Z5QZVN0CSZM1X8NAK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-08-17T07:25:19.104" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=266 grpc.service=gitaly.RefService grpc.start_time="2026-08-17T07:25:09.824" grpc.time_ms=12.782 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2100gitlab # [ 419.133362] gitaly[913]: time="2026-08-17T07:25:09.907Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M079NG2Z5QZVN0CSZM1X8NAK grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3936 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-17T07:25:09.907" grpc.time_ms=0.58 pid=913 span.kind=server system=grpc2101gitlab # [ 419.199880] gitaly[913]: time="2026-08-17T07:25:09.974Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M079NG2Z5QZVN0CSZM1X8NAK grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3938 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-17T07:25:09.973" grpc.time_ms=0.744 pid=913 span.kind=server system=grpc2102gitlab # [ 419.226551] gitaly[913]: time="2026-08-17T07:25:09.988Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M079NG2Z5QZVN0CSZM1X8NAK diskcache=2002df10-ce6a-4d30-b5bd-5c337f97c94b grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-17T07:25:19.130" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-17T07:25:09.850" pid=913 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root2103gitlab # [ 419.248650] gitaly[913]: time="2026-08-17T07:25:09.988Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=141 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5028 command.oublock=8 command.real_time_ms=130 command.spawn_token_fork_ms=1 command.system_time_ms=95 command.user_time_ms=46 component=gitaly.UnaryServerInterceptor correlation_id=01M079NG2Z5QZVN0CSZM1X8NAK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-17T07:25:19.130" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=148 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-17T07:25:09.850" grpc.time_ms=137.563 pid=913 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root2104gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea'2105gitlab # [ 419.273758] gitaly[913]: time="2026-08-17T07:25:10.018Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M079NG2Z5QZVN0CSZM1X8NAK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-17T07:25:20.007" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-17T07:25:10.018" grpc.time_ms=0.394 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2106gitlab # [ 419.288897] gitaly[913]: time="2026-08-17T07:25:10.051Z" level=info msg="finished unary call with code OK" command.count=3 command.cpu_time_ms=21 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=858 command.oublock=0 command.real_time_ms=21 command.spawn_token_fork_ms=3 command.system_time_ms=7 command.user_time_ms=14 component=gitaly.UnaryServerInterceptor correlation_id=01M079NG2Z5QZVN0CSZM1X8NAK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-08-17T07:25:20.014" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-08-17T07:25:10.025" grpc.time_ms=25.591 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2107gitlab # [ 419.335478] nixbot[3496]: INFO: ::ffff:127.0.0.1:42948 - "GET /api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea HTTP/1.1" 200 OK2108gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea', in 0.06 seconds)2109gitlab # [ 419.464114] gitaly[913]: time="2026-08-17T07:25:10.238Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=312 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=1 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M079NG2Z5QZVN0CSZM1X8NAK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindCommits grpc.request.deadline="2026-08-17T07:25:40.025" grpc.request.fullMethod=/gitaly.CommitService/FindCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=173 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-17T07:25:10.225" grpc.time_ms=12.136 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2110gitlab # [ 419.528820] gitaly[913]: time="2026-08-17T07:25:10.303Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M079NG2Z5QZVN0CSZM1X8NAK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-08-17T07:25:20.291" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-17T07:25:10.302" grpc.time_ms=0.663 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2111gitlab # [ 419.557423] gitaly[913]: time="2026-08-17T07:25:10.319Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=316 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=1 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M079NG2Z5QZVN0CSZM1X8NAK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-08-17T07:25:20.297" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=112 grpc.service=gitaly.DiffService grpc.start_time="2026-08-17T07:25:10.307" grpc.time_ms=11.169 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2112gitlab # [ 419.591459] gitaly[913]: time="2026-08-17T07:25:10.365Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=9 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M079NG2Z5QZVN0CSZM1X8NAK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-17T07:25:20.007" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-17T07:25:10.348" grpc.time_ms=17.288 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2113gitlab # [ 419.629224] gitaly[913]: time="2026-08-17T07:25:10.394Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=6 command.user_time_ms=6 component=gitaly.StreamServerInterceptor correlation_id=01M079NG2Z5QZVN0CSZM1X8NAK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-17T07:25:20.036" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-08-17T07:25:10.376" grpc.time_ms=17.843 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2114gitlab # [ 419.672342] gitaly[913]: time="2026-08-17T07:25:10.446Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=20 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=881 command.oublock=0 command.real_time_ms=23 command.spawn_token_fork_ms=3 command.system_time_ms=13 command.user_time_ms=7 component=gitaly.StreamServerInterceptor correlation_id=01M079NG2Z5QZVN0CSZM1X8NAK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-08-17T07:25:40.218" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=155 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=80 grpc.service=gitaly.CommitService grpc.start_time="2026-08-17T07:25:10.418" grpc.time_ms=27.99 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2115gitlab # [ 420.254307] gitaly[913]: time="2026-08-17T07:25:11.027Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M079NG2Z5QZVN0CSZM1X8NAK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-08-17T07:25:21.015" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-17T07:25:11.025" grpc.time_ms=1.79 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2116gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea'2117gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea', in 0.05 seconds)2118gitlab # [ 420.297366] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-17T07:25:11.069Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 4e3e621ff53dd96f25cf46cfa8633c0472c0ba33 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"08d74075ee1fca5678e3b088","created_at":"2026-08-17T07:23:38.900Z","trace_propagation_headers":{"sentry-trace":"e3c3cf4272ad43299b705d9df675c8bb-dd0f9f6561754c07","baggage":"sentry-trace_id=e3c3cf4272ad43299b705d9df675c8bb,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M079NG2Z5QZVN0CSZM1X8NAK","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:23:38.963Z","job_size_bytes":185,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-08d74075ee1fca5678e3b088: done: 1.398091 sec","job_status":"done","queue_duration_s":90.707613,"scheduling_latency_s":90.707637,"gitaly_calls":13,"gitaly_duration_s":0.353051,"redis_calls":198,"redis_allowed_cross_slot_calls":6,"redis_duration_s":0.064718,"redis_read_bytes":2103,"redis_write_bytes":21747,"redis_cache_calls":15,"redis_cache_duration_s":0.006803,"redis_cache_read_bytes":20,"redis_cache_write_bytes":991,"redis_feature_flag_calls":27,"redis_feature_flag_duration_s":0.009097,"redis_feature_flag_read_bytes":1678,"redis_feature_flag_write_bytes":3082,"redis_queues_calls":10,"redis_queues_duration_s":0.002136,"redis_queues_read_bytes":10,"redis_queues_write_bytes":7835,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.006699,"redis_queues_metadata_read_bytes":13,"redis_queues_metadata_write_bytes":1467,"redis_repository_cache_calls":90,"redis_repository_cache_allowed_cross_slot_calls":6,"redis_repository_cache_duration_s":0.02605,"redis_repository_cache_read_bytes":249,"redis_repository_cache_write_bytes":6237,"redis_shared_state_calls":46,"redis_shared_state_duration_s":0.013933,"redis_shared_state_read_bytes":133,"redis_shared_state_write_bytes":2135,"db_count":47,"db_write_count":8,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":47,"db_replica_write_count":0,"db_primary_write_count":8,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.086,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":47,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":8,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.311,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.359,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.086,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.889238,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00079902,"exclusive_lock_hold_duration_s":0.0391416,"duration_s":1.398091,"completed_at":"2026-08-17T07:25:11.069Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.158395,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2119gitlab # [ 420.400109] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-17T07:25:11.073Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","4e3e621ff53dd96f25cf46cfa8633c0472c0ba33 2b5870faf44f4f50eae55d42e55a8040db7166ea refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"b8013d59db207391cf4130b7","created_at":"2026-08-17T07:23:45.517Z","trace_propagation_headers":{"sentry-trace":"64f74885bc764cd0b8767595e10cfa5e-589100b02bf24597","baggage":"sentry-trace_id=64f74885bc764cd0b8767595e10cfa5e,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M079NPWSC42JWX5FRRRMB24W","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:23:45.519Z","job_size_bytes":185,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-b8013d59db207391cf4130b7: start","job_status":"start","queue_duration_s":85.5534,"scheduling_latency_s":85.553449}2120gitlab # [ 420.424082] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-17T07:25:11.102Z","message":"changes: \"4e3e621ff53dd96f25cf46cfa8633c0472c0ba33 2b5870faf44f4f50eae55d42e55a8040db7166ea refs/heads/master\\n\""}2121gitlab # [ 420.427375] gitaly[913]: time="2026-08-17T07:25:11.168Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=4 command.system_time_ms=12 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M079NPWSC42JWX5FRRRMB24W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-17T07:25:21.139" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-08-17T07:25:11.150" grpc.time_ms=17.324 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2122gitlab # [ 420.444401] nixbot[3496]: INFO: ::ffff:127.0.0.1:42964 - "GET /api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea HTTP/1.1" 200 OK2123gitlab # [ 420.446659] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-17T07:25:11.200Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"2ea6640b1bf8dc333870a5d3","created_at":"2026-08-17T07:25:11.197Z","trace_propagation_headers":{"sentry-trace":"64f74885bc764cd0b8767595e10cfa5e-7bb0a49177bd4557","baggage":"sentry-trace_id=64f74885bc764cd0b8767595e10cfa5e,sentry-release=Unknown"},"correlation_id":"01M079NPWSC42JWX5FRRRMB24W","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","duplicate-of":"e75ef262d924fe2f123de11a","job_size_bytes":46,"pid":3421,"job_status":"deduplicated","message":"ProjectCacheWorker JID-2ea6640b1bf8dc333870a5d3: deduplicated: until executing","deduplication.type":"until executing"}2124gitlab # [ 420.462928] gitaly[913]: time="2026-08-17T07:25:11.192Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=575 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=0 command.system_time_ms=12 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M079NPWSC42JWX5FRRRMB24W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-17T07:25:21.166" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-17T07:25:11.177" grpc.time_ms=15.587 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2125gitlab # [ 420.476374] gitaly[913]: time="2026-08-17T07:25:11.243Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=582 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M079NPWSC42JWX5FRRRMB24W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-08-17T07:25:21.217" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=266 grpc.service=gitaly.RefService grpc.start_time="2026-08-17T07:25:11.227" grpc.time_ms=16.317 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2126gitlab # [ 420.497382] gitaly[913]: time="2026-08-17T07:25:11.271Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=596 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M079NPWSC42JWX5FRRRMB24W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommits grpc.request.deadline="2026-08-17T07:25:41.052" grpc.request.fullMethod=/gitaly.CommitService/ListCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=212 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-17T07:25:11.252" grpc.time_ms=18.947 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2127gitlab # [ 420.534883] gitaly[913]: time="2026-08-17T07:25:11.302Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=319 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=1 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M079NPWSC42JWX5FRRRMB24W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-08-17T07:25:21.281" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=116 grpc.service=gitaly.DiffService grpc.start_time="2026-08-17T07:25:11.292" grpc.time_ms=10.275 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2128gitlab # [ 420.562268] gitaly[913]: time="2026-08-17T07:25:11.336Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M079NPWSC42JWX5FRRRMB24W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-17T07:25:21.009" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-17T07:25:11.320" grpc.time_ms=16.202 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2129gitlab # [ 420.880750] gitaly[913]: time="2026-08-17T07:25:11.655Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M079NPWSC42JWX5FRRRMB24W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-08-17T07:25:21.170" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-17T07:25:11.510" grpc.time_ms=144.233 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2130gitlab # [ 420.923034] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-17T07:25:11.696Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","4e3e621ff53dd96f25cf46cfa8633c0472c0ba33 2b5870faf44f4f50eae55d42e55a8040db7166ea refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"b8013d59db207391cf4130b7","created_at":"2026-08-17T07:23:45.517Z","trace_propagation_headers":{"sentry-trace":"64f74885bc764cd0b8767595e10cfa5e-589100b02bf24597","baggage":"sentry-trace_id=64f74885bc764cd0b8767595e10cfa5e,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M079NPWSC42JWX5FRRRMB24W","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:23:45.519Z","job_size_bytes":185,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-b8013d59db207391cf4130b7: done: 0.623594 sec","job_status":"done","queue_duration_s":85.5534,"scheduling_latency_s":85.553449,"gitaly_calls":7,"gitaly_duration_s":0.268463,"redis_calls":110,"redis_allowed_cross_slot_calls":4,"redis_duration_s":0.043303,"redis_read_bytes":500,"redis_write_bytes":11940,"redis_cache_calls":9,"redis_cache_duration_s":0.004797,"redis_cache_read_bytes":14,"redis_cache_write_bytes":593,"redis_queues_calls":6,"redis_queues_duration_s":0.001562,"redis_queues_read_bytes":8,"redis_queues_write_bytes":5717,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.006213,"redis_queues_metadata_read_bytes":163,"redis_queues_metadata_write_bytes":1428,"redis_repository_cache_calls":41,"redis_repository_cache_allowed_cross_slot_calls":4,"redis_repository_cache_duration_s":0.012918,"redis_repository_cache_read_bytes":176,"redis_repository_cache_write_bytes":2193,"redis_shared_state_calls":44,"redis_shared_state_duration_s":0.017813,"redis_shared_state_read_bytes":139,"redis_shared_state_write_bytes":2009,"db_count":28,"db_write_count":3,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":28,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.043,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":28,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.045,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.045,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.043,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.444381,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00430604,"exclusive_lock_hold_duration_s":0.04064264,"duration_s":0.623594,"completed_at":"2026-08-17T07:25:11.696Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.045246,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2131gitlab # [ 421.025388] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-17T07:25:11.698Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"ce97b2f30e1bd05af1e4c1d3","created_at":"2026-08-17T07:23:47.424Z","trace_propagation_headers":{"sentry-trace":"6f216aadb69f41e7819c164892b86bed-e28f0e43f0874876","baggage":"sentry-trace_id=6f216aadb69f41e7819c164892b86bed,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M079NRPJBKWT4AEE0M5HHC4R","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-08-17T07:23:47.435Z","job_size_bytes":65,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-ce97b2f30e1bd05af1e4c1d3: start","job_status":"start","queue_duration_s":84.263144,"scheduling_latency_s":84.263169}2132gitlab # [ 421.051763] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-17T07:25:11.824Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"ce97b2f30e1bd05af1e4c1d3","created_at":"2026-08-17T07:23:47.424Z","trace_propagation_headers":{"sentry-trace":"6f216aadb69f41e7819c164892b86bed-e28f0e43f0874876","baggage":"sentry-trace_id=6f216aadb69f41e7819c164892b86bed,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M079NRPJBKWT4AEE0M5HHC4R","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-08-17T07:23:47.435Z","job_size_bytes":65,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-ce97b2f30e1bd05af1e4c1d3: done: 0.125732 sec","job_status":"done","queue_duration_s":84.263144,"scheduling_latency_s":84.263169,"redis_calls":16,"redis_duration_s":0.005397,"redis_read_bytes":269,"redis_write_bytes":1850,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.002733,"redis_feature_flag_read_bytes":262,"redis_feature_flag_write_bytes":1032,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002023,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":590,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000641,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":228,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.022,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.013,"db_ci_duration_s":0.009,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.078665,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00070682,"duration_s":0.125732,"completed_at":"2026-08-17T07:25:11.824Z","load_balancing_strategy":"primary","db_duration_s":0.037417,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2133gitlab # [ 421.100373] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-17T07:25:11.828Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"392ddde8e4a1de3b103936d0","created_at":"2026-08-17T07:23:47.436Z","trace_propagation_headers":{"sentry-trace":"6f216aadb69f41e7819c164892b86bed-e28f0e43f0874876","baggage":"sentry-trace_id=6f216aadb69f41e7819c164892b86bed,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M079NRPJBKWT4AEE0M5HHC4R","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-08-17T07:23:47.445Z","job_size_bytes":65,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-392ddde8e4a1de3b103936d0: start","job_status":"start","queue_duration_s":84.38306,"scheduling_latency_s":84.383098}2134gitlab # [ 421.277992] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-17T07:25:12.051Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"392ddde8e4a1de3b103936d0","created_at":"2026-08-17T07:23:47.436Z","trace_propagation_headers":{"sentry-trace":"6f216aadb69f41e7819c164892b86bed-e28f0e43f0874876","baggage":"sentry-trace_id=6f216aadb69f41e7819c164892b86bed,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M079NRPJBKWT4AEE0M5HHC4R","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-08-17T07:23:47.445Z","job_size_bytes":65,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-392ddde8e4a1de3b103936d0: done: 0.222702 sec","job_status":"done","queue_duration_s":84.38306,"scheduling_latency_s":84.383098,"redis_calls":21,"redis_duration_s":0.009778,"redis_read_bytes":148,"redis_write_bytes":2264,"redis_feature_flag_calls":9,"redis_feature_flag_duration_s":0.004985,"redis_feature_flag_read_bytes":136,"redis_feature_flag_write_bytes":1264,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002571,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":578,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.002222,"redis_shared_state_read_bytes":8,"redis_shared_state_write_bytes":422,"db_count":15,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.046,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.034,"db_ci_duration_s":0.012,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.150487,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00094078,"duration_s":0.222702,"completed_at":"2026-08-17T07:25:12.051Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.055093,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2135gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea'2136gitlab # [ 421.384741] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-17T07:25:12.055Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"5395b0ba53fdfb72f175a399","created_at":"2026-08-17T07:23:47.614Z","trace_propagation_headers":{"sentry-trace":"6f216aadb69f41e7819c164892b86bed-e28f0e43f0874876","baggage":"sentry-trace_id=6f216aadb69f41e7819c164892b86bed,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M079NRPJBKWT4AEE0M5HHC4R","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-17T07:23:47.622Z","job_size_bytes":3,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-5395b0ba53fdfb72f175a399: start","job_status":"start","queue_duration_s":84.43194,"scheduling_latency_s":84.431986}2137gitlab # [ 421.449766] nixbot[3496]: INFO: ::ffff:127.0.0.1:40852 - "GET /api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea HTTP/1.1" 200 OK2138gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea', in 0.06 seconds)2139gitlab # [ 421.655163] gitaly[913]: time="2026-08-17T07:25:12.428Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M079NRPJBKWT4AEE0M5HHC4R grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3897 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-17T07:25:12.427" grpc.time_ms=0.943 pid=913 span.kind=server system=grpc2140gitlab # [ 421.715212] gitaly[913]: time="2026-08-17T07:25:12.489Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M079NRPJBKWT4AEE0M5HHC4R grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3895 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-17T07:25:12.488" grpc.time_ms=1.268 pid=913 span.kind=server system=grpc2141gitlab # [ 421.774557] gitaly[913]: time="2026-08-17T07:25:12.548Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M079NRPJBKWT4AEE0M5HHC4R grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3897 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-17T07:25:12.547" grpc.time_ms=0.873 pid=913 span.kind=server system=grpc2142gitlab # [ 421.799895] gitaly[913]: time="2026-08-17T07:25:12.561Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M079NRPJBKWT4AEE0M5HHC4R diskcache=af173e2a-d64a-4aea-bb27-ad1b91286131 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-17T07:25:42.164" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-17T07:25:12.365" pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2143gitlab # [ 421.819206] gitaly[913]: time="2026-08-17T07:25:12.562Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=215 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7522 command.oublock=0 command.real_time_ms=189 command.spawn_token_fork_ms=1 command.system_time_ms=125 command.user_time_ms=90 component=gitaly.UnaryServerInterceptor correlation_id=01M079NRPJBKWT4AEE0M5HHC4R grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-17T07:25:42.164" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-17T07:25:12.365" grpc.time_ms=196.732 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2144gitlab # [ 422.003327] gitaly[913]: time="2026-08-17T07:25:12.777Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M079NRPJBKWT4AEE0M5HHC4R grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-17T07:25:42.575" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-17T07:25:12.775" grpc.time_ms=1.707 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2145gitlab # [ 422.064451] gitaly[913]: time="2026-08-17T07:25:12.838Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M079NRPJBKWT4AEE0M5HHC4R grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-17T07:25:42.636" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-17T07:25:12.837" grpc.time_ms=1.075 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2146gitlab # [ 422.101836] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-17T07:25:12.866Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"5395b0ba53fdfb72f175a399","created_at":"2026-08-17T07:23:47.614Z","trace_propagation_headers":{"sentry-trace":"6f216aadb69f41e7819c164892b86bed-e28f0e43f0874876","baggage":"sentry-trace_id=6f216aadb69f41e7819c164892b86bed,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M079NRPJBKWT4AEE0M5HHC4R","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-17T07:23:47.622Z","job_size_bytes":3,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-5395b0ba53fdfb72f175a399: done: 0.811607 sec","job_status":"done","queue_duration_s":84.43194,"scheduling_latency_s":84.431986,"gitaly_calls":3,"gitaly_duration_s":0.210727,"redis_calls":117,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.042504,"redis_read_bytes":457,"redis_write_bytes":27998,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.002421,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.001908,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_feature_flag_calls":40,"redis_feature_flag_duration_s":0.01567,"redis_feature_flag_read_bytes":294,"redis_feature_flag_write_bytes":6581,"redis_queues_calls":25,"redis_queues_duration_s":0.005828,"redis_queues_read_bytes":36,"redis_queues_write_bytes":14492,"redis_queues_metadata_calls":21,"redis_queues_metadata_duration_s":0.009124,"redis_queues_metadata_read_bytes":32,"redis_queues_metadata_write_bytes":3370,"redis_rate_limiting_calls":2,"redis_rate_limiting_duration_s":0.001197,"redis_rate_limiting_read_bytes":2,"redis_rate_limiting_write_bytes":166,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000832,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003103,"redis_shared_state_read_bytes":11,"redis_shared_state_write_bytes":851,"db_count":52,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":52,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.102,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":35,"db_ci_count":17,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.046,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.052,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.049,"db_ci_duration_s":0.053,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.466818,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.69006116,"duration_s":0.811607,"completed_at":"2026-08-17T07:25:12.866Z","load_balancing_strategy":"primary","db_duration_s":0.12245,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2147gitlab # [ 422.189231] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-17T07:25:12.868Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"e75ef262d924fe2f123de11a","created_at":"2026-08-17T07:25:09.768Z","trace_propagation_headers":{"sentry-trace":"e3c3cf4272ad43299b705d9df675c8bb-ff9cd3a118d64f06","baggage":"sentry-trace_id=e3c3cf4272ad43299b705d9df675c8bb,sentry-release=Unknown"},"correlation_id":"01M079NG2Z5QZVN0CSZM1X8NAK","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-08-17T07:25:09.789Z","job_size_bytes":46,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-e75ef262d924fe2f123de11a: start","job_status":"start","queue_duration_s":3.078735,"scheduling_latency_s":3.07876}2148gitlab # [ 422.211214] gitaly[913]: time="2026-08-17T07:25:12.940Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M079NG2Z5QZVN0CSZM1X8NAK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryInfo grpc.request.deadline="2026-08-17T13:25:12.929" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryInfo grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-17T07:25:12.929" grpc.time_ms=10.175 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2149gitlab # [ 422.226169] gitaly[913]: time="2026-08-17T07:25:12.965Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=595 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=2 command.system_time_ms=11 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M079NG2Z5QZVN0CSZM1X8NAK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-08-17T07:25:42.750" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-08-17T07:25:12.950" grpc.time_ms=14.77 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2150gitlab # [ 422.242937] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-17T07:25:13.000Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"e75ef262d924fe2f123de11a","created_at":"2026-08-17T07:25:09.768Z","trace_propagation_headers":{"sentry-trace":"e3c3cf4272ad43299b705d9df675c8bb-ff9cd3a118d64f06","baggage":"sentry-trace_id=e3c3cf4272ad43299b705d9df675c8bb,sentry-release=Unknown"},"correlation_id":"01M079NG2Z5QZVN0CSZM1X8NAK","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-08-17T07:25:09.789Z","job_size_bytes":46,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-e75ef262d924fe2f123de11a: done: 0.131554 sec","job_status":"done","queue_duration_s":3.078735,"scheduling_latency_s":3.07876,"gitaly_calls":2,"gitaly_duration_s":0.031174,"redis_calls":30,"redis_allowed_cross_slot_calls":2,"redis_duration_s":0.00859,"redis_read_bytes":69,"redis_write_bytes":4881,"redis_feature_flag_calls":6,"redis_feature_flag_duration_s":0.001575,"redis_feature_flag_read_bytes":6,"redis_feature_flag_write_bytes":1005,"redis_queues_calls":3,"redis_queues_duration_s":0.000676,"redis_queues_read_bytes":4,"redis_queues_write_bytes":2114,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002199,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":710,"redis_repository_cache_calls":11,"redis_repository_cache_allowed_cross_slot_calls":2,"redis_repository_cache_duration_s":0.003308,"redis_repository_cache_read_bytes":48,"redis_repository_cache_write_bytes":748,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000832,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":304,"db_count":10,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":10,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":2,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.011,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.074601,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00040312,"duration_s":0.131554,"completed_at":"2026-08-17T07:25:13.000Z","load_balancing_strategy":"primary","db_duration_s":0.016546,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2151gitlab # [ 422.294244] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-17T07:25:13.002Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"966fc6576097ab7d492ae150","created_at":"2026-08-17T07:25:09.812Z","trace_propagation_headers":{"sentry-trace":"e3c3cf4272ad43299b705d9df675c8bb-ff9cd3a118d64f06","baggage":"sentry-trace_id=e3c3cf4272ad43299b705d9df675c8bb,sentry-release=Unknown"},"correlation_id":"01M079NG2Z5QZVN0CSZM1X8NAK","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-08-17T07:25:09.819Z","job_size_bytes":3,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-966fc6576097ab7d492ae150: start","job_status":"start","queue_duration_s":3.182708,"scheduling_latency_s":3.18273}2152gitlab # [ 422.311128] gitaly[913]: time="2026-08-17T07:25:13.066Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M079NG2Z5QZVN0CSZM1X8NAK diskcache=d2db01b9-2ca5-4e2f-a742-297dba967aa4 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-08-17T13:25:13.029" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-08-17T07:25:13.029" pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2153gitlab # [ 422.321430] gitaly[913]: time="2026-08-17T07:25:13.067Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=4 command.cpu_time_ms=24 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1173 command.oublock=0 command.real_time_ms=45 command.spawn_token_fork_ms=3 command.system_time_ms=24 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M079NG2Z5QZVN0CSZM1X8NAK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-08-17T13:25:13.029" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-08-17T07:25:13.029" grpc.time_ms=37.192 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2154gitlab # [ 422.345886] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-17T07:25:13.119Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"966fc6576097ab7d492ae150","created_at":"2026-08-17T07:25:09.812Z","trace_propagation_headers":{"sentry-trace":"e3c3cf4272ad43299b705d9df675c8bb-ff9cd3a118d64f06","baggage":"sentry-trace_id=e3c3cf4272ad43299b705d9df675c8bb,sentry-release=Unknown"},"correlation_id":"01M079NG2Z5QZVN0CSZM1X8NAK","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-08-17T07:25:09.819Z","job_size_bytes":3,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-966fc6576097ab7d492ae150: done: 0.117629 sec","job_status":"done","queue_duration_s":3.182708,"scheduling_latency_s":3.18273,"gitaly_calls":1,"gitaly_duration_s":0.040161,"redis_calls":15,"redis_duration_s":0.004132,"redis_read_bytes":68,"redis_write_bytes":1520,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000478,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.0016,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":558,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000656,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001398,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":520,"db_count":12,"db_write_count":4,"db_cached_count":0,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":4,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.014,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":4,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.015,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.029,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.014,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.048355,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.08929804,"duration_s":0.117629,"completed_at":"2026-08-17T07:25:13.119Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.02412,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2155gitlab # [ 422.394229] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-17T07:25:13.121Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"0b1cf838623ca76b904bb786","created_at":"2026-08-17T07:25:10.009Z","trace_propagation_headers":{"sentry-trace":"e3c3cf4272ad43299b705d9df675c8bb-ff9cd3a118d64f06","baggage":"sentry-trace_id=e3c3cf4272ad43299b705d9df675c8bb,sentry-release=Unknown"},"correlation_id":"01M079NG2Z5QZVN0CSZM1X8NAK","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-08-17T07:25:10.013Z","job_size_bytes":23,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-0b1cf838623ca76b904bb786: start","job_status":"start","queue_duration_s":3.108101,"scheduling_latency_s":3.108122}2156gitlab # [ 422.410062] gitaly[913]: time="2026-08-17T07:25:13.173Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=596 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=7 command.user_time_ms=6 component=gitaly.UnaryServerInterceptor correlation_id=01M079NG2Z5QZVN0CSZM1X8NAK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-08-17T07:25:43.055" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-08-17T07:25:13.156" grpc.time_ms=17.404 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2157gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea'2158gitlab # [ 422.423404] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-17T07:25:13.195Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"0b1cf838623ca76b904bb786","created_at":"2026-08-17T07:25:10.009Z","trace_propagation_headers":{"sentry-trace":"e3c3cf4272ad43299b705d9df675c8bb-ff9cd3a118d64f06","baggage":"sentry-trace_id=e3c3cf4272ad43299b705d9df675c8bb,sentry-release=Unknown"},"correlation_id":"01M079NG2Z5QZVN0CSZM1X8NAK","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-08-17T07:25:10.013Z","job_size_bytes":23,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-0b1cf838623ca76b904bb786: done: 0.074095 sec","job_status":"done","queue_duration_s":3.108101,"scheduling_latency_s":3.108122,"gitaly_calls":1,"gitaly_duration_s":0.020116,"redis_calls":16,"redis_duration_s":0.005739,"redis_read_bytes":52,"redis_write_bytes":2049,"redis_queues_calls":1,"redis_queues_duration_s":0.000675,"redis_queues_read_bytes":1,"redis_queues_write_bytes":980,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001737,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":437,"redis_repository_cache_calls":7,"redis_repository_cache_duration_s":0.002242,"redis_repository_cache_read_bytes":44,"redis_repository_cache_write_bytes":344,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.001085,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":288,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.042031,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.074095,"completed_at":"2026-08-17T07:25:13.195Z","load_balancing_strategy":"primary","db_duration_s":0.00439,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2159gitlab # [ 422.468301] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-17T07:25:13.199Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"fdda9aeb451b6d5c96be8fb3","created_at":"2026-08-17T07:25:10.831Z","trace_propagation_headers":{"sentry-trace":"e3c3cf4272ad43299b705d9df675c8bb-ff9cd3a118d64f06","baggage":"sentry-trace_id=e3c3cf4272ad43299b705d9df675c8bb,sentry-release=Unknown"},"correlation_id":"01M079NG2Z5QZVN0CSZM1X8NAK","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7daf2ba80ce91d9a4656d207b54d301f17be6f7e80cffd0aa59699477e8adac6","size_limiter":"validated","enqueued_at":"2026-08-17T07:25:10.839Z","job_size_bytes":467,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-fdda9aeb451b6d5c96be8fb3: start","job_status":"start","queue_duration_s":2.360292,"scheduling_latency_s":2.360338}2160gitlab # [ 422.485694] gitaly[913]: time="2026-08-17T07:25:13.259Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M079NG2Z5QZVN0CSZM1X8NAK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-17T07:25:43.157" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-17T07:25:13.257" grpc.time_ms=1.102 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2161gitlab # [ 422.510453] gitaly[913]: time="2026-08-17T07:25:13.284Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=6 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M079NG2Z5QZVN0CSZM1X8NAK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-08-17T07:25:23.004" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-08-17T07:25:13.264" grpc.time_ms=19.654 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2162gitlab # [ 422.524283] nixbot[3496]: INFO: ::ffff:127.0.0.1:40858 - "GET /api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea HTTP/1.1" 200 OK2163gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea', in 0.07 seconds)2164gitlab # [ 422.714590] gitaly[913]: time="2026-08-17T07:25:13.488Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M079NG2Z5QZVN0CSZM1X8NAK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-17T07:25:43.386" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-17T07:25:13.486" grpc.time_ms=1.266 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2165gitlab # [ 422.752440] gitaly[913]: time="2026-08-17T07:25:13.499Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=35 command.oublock=0 command.real_time_ms=2 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M079NG2Z5QZVN0CSZM1X8NAK error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-08-17T07:25:43.395" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-17T07:25:13.495" grpc.time_ms=3.359 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2166gitlab # [ 422.909677] gitaly[913]: time="2026-08-17T07:25:13.684Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M079NG2Z5QZVN0CSZM1X8NAK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-17T07:25:23.006" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-17T07:25:13.666" grpc.time_ms=17.185 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2167gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea'2168gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea', in 0.05 seconds)2169gitlab # [ 423.577167] nixbot[3496]: INFO: ::ffff:127.0.0.1:40870 - "GET /api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea HTTP/1.1" 200 OK2170gitlab # [ 423.605625] gitaly[913]: time="2026-08-17T07:25:14.379Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=20 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=881 command.oublock=0 command.real_time_ms=21 command.spawn_token_fork_ms=1 command.system_time_ms=17 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M079NG2Z5QZVN0CSZM1X8NAK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-08-17T07:25:44.253" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-08-17T07:25:14.354" grpc.time_ms=25.669 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2171gitlab # [ 423.646391] gitaly[913]: time="2026-08-17T07:25:14.407Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=1 command.system_time_ms=10 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M079NG2Z5QZVN0CSZM1X8NAK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-08-17T07:25:44.286" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-08-17T07:25:14.386" grpc.time_ms=20.779 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2172gitlab # [ 423.697631] sidekiq-cluster[3421]: {"severity":"WARN","time":"2026-08-17T07:25:14.470Z","class":"CreatePipelineWorker","correlation_id":"01M079NG2Z5QZVN0CSZM1X8NAK","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"0000000000000000000000000000000000000000","after":"4e3e621ff53dd96f25cf46cfa8633c0472c0ba33","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"4e3e621ff53dd96f25cf46cfa8633c0472c0ba33","ref":"refs/heads/master"},"retry":0}2173gitlab # [ 423.718060] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-17T07:25:14.486Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"fdda9aeb451b6d5c96be8fb3","created_at":"2026-08-17T07:25:10.831Z","trace_propagation_headers":{"sentry-trace":"e3c3cf4272ad43299b705d9df675c8bb-ff9cd3a118d64f06","baggage":"sentry-trace_id=e3c3cf4272ad43299b705d9df675c8bb,sentry-release=Unknown"},"correlation_id":"01M079NG2Z5QZVN0CSZM1X8NAK","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7daf2ba80ce91d9a4656d207b54d301f17be6f7e80cffd0aa59699477e8adac6","size_limiter":"validated","enqueued_at":"2026-08-17T07:25:10.839Z","job_size_bytes":467,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-fdda9aeb451b6d5c96be8fb3: done: 1.287063 sec","job_status":"done","queue_duration_s":2.360292,"scheduling_latency_s":2.360338,"gitaly_calls":7,"gitaly_duration_s":0.118044,"redis_calls":51,"redis_duration_s":0.016203,"redis_read_bytes":169,"redis_write_bytes":4168,"redis_cache_calls":4,"redis_cache_duration_s":0.001638,"redis_cache_read_bytes":10,"redis_cache_write_bytes":343,"redis_feature_flag_calls":16,"redis_feature_flag_duration_s":0.006513,"redis_feature_flag_read_bytes":16,"redis_feature_flag_write_bytes":2174,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002329,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":510,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.004017,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001706,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":513,"db_count":36,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":36,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.048,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":32,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.041,"db_ci_duration_s":0.007,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":1.092433,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00056414,"duration_s":1.287063,"completed_at":"2026-08-17T07:25:14.486Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0859,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2174gitlab # [ 423.796640] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-17T07:25:14.489Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{\"idempotency_key\"=\u003e\"b245fafc-20e4-444f-a280-6819e508d151\"}"],"class":"WebHookWorker","jid":"379e783f7a3a7674735d0d29","created_at":"2026-08-17T07:25:10.988Z","trace_propagation_headers":{"sentry-trace":"e3c3cf4272ad43299b705d9df675c8bb-ff9cd3a118d64f06","baggage":"sentry-trace_id=e3c3cf4272ad43299b705d9df675c8bb,sentry-release=Unknown"},"correlation_id":"01M079NG2Z5QZVN0CSZM1X8NAK","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6cfb9594fc90b003d5ab50e9a8a19aed36633ead57fa8b5d876a4d12b1a329c0","size_limiter":"validated","enqueued_at":"2026-08-17T07:25:10.994Z","job_size_bytes":1751,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-379e783f7a3a7674735d0d29: start","job_status":"start","queue_duration_s":3.494801,"scheduling_latency_s":3.494839}2175gitlab # [ 423.916446] nixbot[3496]: INFO: ::ffff:127.0.0.1:40884 - "POST /webhooks/gitlab HTTP/1.1" 202 Accepted2176gitlab # [ 423.960432] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-17T07:25:14.733Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{:idempotency_key=\u003e\"b245fafc-20e4-444f-a280-6819e508d151\"}"],"class":"WebHookWorker","jid":"379e783f7a3a7674735d0d29","created_at":"2026-08-17T07:25:10.988Z","trace_propagation_headers":{"sentry-trace":"e3c3cf4272ad43299b705d9df675c8bb-ff9cd3a118d64f06","baggage":"sentry-trace_id=e3c3cf4272ad43299b705d9df675c8bb,sentry-release=Unknown"},"correlation_id":"01M079NG2Z5QZVN0CSZM1X8NAK","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6cfb9594fc90b003d5ab50e9a8a19aed36633ead57fa8b5d876a4d12b1a329c0","size_limiter":"validated","enqueued_at":"2026-08-17T07:25:10.994Z","job_size_bytes":1751,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-379e783f7a3a7674735d0d29: done: 0.243708 sec","job_status":"done","queue_duration_s":3.494801,"scheduling_latency_s":3.494839,"redis_calls":19,"redis_duration_s":0.00734,"redis_read_bytes":32,"redis_write_bytes":5367,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001687,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":622,"redis_queues_calls":2,"redis_queues_duration_s":0.000915,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3729,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.003259,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":690,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001479,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":326,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"external_http_count":1,"external_http_duration_s":0.0881348199999934,"cpu_s":0.130873,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00079902,"extra.web_hook_worker.response_status":"success","extra.web_hook_worker.http_status":"ok","extra.web_hook_worker.signing_token_present":false,"duration_s":0.243708,"completed_at":"2026-08-17T07:25:14.733Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005383,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2177gitlab # [ 424.062904] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-17T07:25:14.737Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"123f3305fcb27ebc00123b9a","created_at":"2026-08-17T07:25:11.213Z","trace_propagation_headers":{"sentry-trace":"64f74885bc764cd0b8767595e10cfa5e-7bb0a49177bd4557","baggage":"sentry-trace_id=64f74885bc764cd0b8767595e10cfa5e,sentry-release=Unknown"},"correlation_id":"01M079NPWSC42JWX5FRRRMB24W","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","duplicate-of":"966fc6576097ab7d492ae150","size_limiter":"validated","enqueued_at":"2026-08-17T07:25:11.219Z","job_size_bytes":3,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-123f3305fcb27ebc00123b9a: start","job_status":"start","queue_duration_s":3.517365,"scheduling_latency_s":3.517409}2178gitlab # [ 424.083214] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-17T07:25:14.822Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"123f3305fcb27ebc00123b9a","created_at":"2026-08-17T07:25:11.213Z","trace_propagation_headers":{"sentry-trace":"64f74885bc764cd0b8767595e10cfa5e-7bb0a49177bd4557","baggage":"sentry-trace_id=64f74885bc764cd0b8767595e10cfa5e,sentry-release=Unknown"},"correlation_id":"01M079NPWSC42JWX5FRRRMB24W","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","duplicate-of":"966fc6576097ab7d492ae150","size_limiter":"validated","enqueued_at":"2026-08-17T07:25:11.219Z","job_size_bytes":3,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-123f3305fcb27ebc00123b9a: done: 0.085112 sec","job_status":"done","queue_duration_s":3.517365,"scheduling_latency_s":3.517409,"gitaly_calls":1,"gitaly_duration_s":0.018167,"redis_calls":12,"redis_duration_s":0.004676,"redis_read_bytes":64,"redis_write_bytes":1136,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001773,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":479,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.001152,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001751,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":520,"db_count":8,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.011,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.011,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.050664,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.04752034,"duration_s":0.085112,"completed_at":"2026-08-17T07:25:14.822Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.009847,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2179gitlab # [ 424.129905] gitaly[913]: time="2026-08-17T07:25:14.789Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M079NPWSC42JWX5FRRRMB24W diskcache=43b360d5-239a-4e52-b649-ae5b799e187f grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-08-17T13:25:14.775" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-08-17T07:25:14.775" pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2180gitlab # [ 424.139869] gitaly[913]: time="2026-08-17T07:25:14.790Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=289 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=1 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M079NPWSC42JWX5FRRRMB24W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-08-17T13:25:14.775" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-08-17T07:25:14.775" grpc.time_ms=14.1 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2181gitlab # [ 424.153559] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/08/17:07:25:14 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 1422182gitlab # [ 424.155621] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-17T07:25:14.825Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"e62cda18926882f941af3f48","created_at":"2026-08-17T07:25:11.443Z","trace_propagation_headers":{"sentry-trace":"64f74885bc764cd0b8767595e10cfa5e-7bb0a49177bd4557","baggage":"sentry-trace_id=64f74885bc764cd0b8767595e10cfa5e,sentry-release=Unknown"},"correlation_id":"01M079NPWSC42JWX5FRRRMB24W","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:94b1a1387267d5d1dd40584580e6673d8f119cf7da113ddd19491a0f112e951e","size_limiter":"validated","enqueued_at":"2026-08-17T07:25:11.448Z","job_size_bytes":467,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-e62cda18926882f941af3f48: start","job_status":"start","queue_duration_s":3.376886,"scheduling_latency_s":3.376919}2183gitlab # [ 424.173224] gitaly[913]: time="2026-08-17T07:25:14.867Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M079NPWSC42JWX5FRRRMB24W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-17T07:25:44.765" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-17T07:25:14.866" grpc.time_ms=0.966 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2184gitlab # [ 424.185658] gitaly[913]: time="2026-08-17T07:25:14.880Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=580 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=5 command.system_time_ms=9 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M079REKN3Y35S5TPGWJMVTP3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=186 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-17T07:25:14.864" grpc.time_ms=16.219 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc2185gitlab # [ 424.198808] gitaly[913]: time="2026-08-17T07:25:14.883Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=2 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M079NPWSC42JWX5FRRRMB24W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-08-17T07:25:24.210" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-08-17T07:25:14.871" grpc.time_ms=11.514 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2186gitlab # [ 424.211773] gitaly[913]: time="2026-08-17T07:25:14.932Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M079NPWSC42JWX5FRRRMB24W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-17T07:25:44.830" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-17T07:25:14.930" grpc.time_ms=1.353 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2187gitlab # [ 424.225924] gitaly[913]: time="2026-08-17T07:25:14.940Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=89 command.oublock=0 command.real_time_ms=2 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M079NPWSC42JWX5FRRRMB24W error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-08-17T07:25:44.836" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-17T07:25:14.936" grpc.time_ms=3.718 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2188gitlab # [ 424.242138] gitaly[913]: time="2026-08-17T07:25:14.987Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=2 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M079NPWSC42JWX5FRRRMB24W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-17T07:25:24.004" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-17T07:25:14.976" grpc.time_ms=11.043 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2189gitlab # [ 424.255312] gitaly[913]: time="2026-08-17T07:25:15.022Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M079RER65DC5779B4PYWWJN1 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-17T07:25:15.011" pid=913 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2190gitlab # [ 424.265733] gitlab-workhorse[819]: time="2026-08-17T07:25:15Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672191gitlab # [ 424.267535] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/08/17:07:25:15 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 1372192gitlab # [ 424.269540] gitaly[913]: time="2026-08-17T07:25:15.022Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=2 command.system_time_ms=2 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M079RER65DC5779B4PYWWJN1 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-17T07:25:15.011" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc2193gitlab # [ 424.283030] gitaly[913]: time="2026-08-17T07:25:15.023Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=2 command.system_time_ms=2 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M079RER65DC5779B4PYWWJN1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-17T07:25:15.011" grpc.time_ms=11.374 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc2194gitlab # [ 424.298252] nixbot[3496]: {"ts": "2026-08-17T07:25:15.072Z", "level": "info", "logger": "nixbot.build_reuse", "msg": "reusing build for tree hash", "build_id": 1, "tree_hash": "a8c90de643fa3b1e78fc9dc27f18f04a936ba912"}2195gitlab # [ 424.442165] gitaly[913]: time="2026-08-17T07:25:15.216Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M079REYPKV2XEAYQFXMNCPGS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-17T07:25:45.114" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-17T07:25:15.214" grpc.time_ms=1.321 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2196gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea'2197gitlab # [ 424.567155] gitaly[913]: time="2026-08-17T07:25:15.341Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M079REYPKV2XEAYQFXMNCPGS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-17T07:25:25.002" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-17T07:25:15.323" grpc.time_ms=18.061 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2198gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea', in 0.07 seconds)2199gitlab # [ 424.645210] nixbot[3496]: INFO: ::ffff:127.0.0.1:40886 - "GET /api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea HTTP/1.1" 200 OK2200gitlab # [ 424.684121] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/08/17:07:25:15 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/4e3e621ff53dd96f25cf46cfa8633c0472c0ba33 HTTP/1.1" 201 657 "" "python-httpx/0.28.1" 3632201gitlab # [ 424.689881] nixbot[3496]: {"ts": "2026-08-17T07:25:15.460Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/4e3e621ff53dd96f25cf46cfa8633c0472c0ba33 \"HTTP/1.1 201 Created\""}2202gitlab # [ 424.815045] gitaly[913]: time="2026-08-17T07:25:15.589Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M079RFACAAC3Z8NJEGX3QWQ3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-17T07:25:45.387" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-17T07:25:15.587" grpc.time_ms=1.207 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2203gitlab # [ 424.910131] gitaly[913]: time="2026-08-17T07:25:15.684Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=22 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=880 command.oublock=0 command.real_time_ms=23 command.spawn_token_fork_ms=3 command.system_time_ms=18 command.user_time_ms=4 component=gitaly.StreamServerInterceptor correlation_id=01M079NPWSC42JWX5FRRRMB24W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-08-17T07:25:45.555" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-08-17T07:25:15.655" grpc.time_ms=28.714 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2204gitlab # [ 424.954144] gitaly[913]: time="2026-08-17T07:25:15.711Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=575 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=3 command.system_time_ms=7 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M079NPWSC42JWX5FRRRMB24W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-08-17T07:25:45.592" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-08-17T07:25:15.693" grpc.time_ms=18.202 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2205gitlab # [ 424.979647] gitaly[913]: time="2026-08-17T07:25:15.711Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=4 command.system_time_ms=3 command.user_time_ms=6 component=gitaly.StreamServerInterceptor correlation_id=01M079RFACAAC3Z8NJEGX3QWQ3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-17T07:25:25.007" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-17T07:25:15.697" grpc.time_ms=13.844 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2206gitlab # [ 425.003679] sidekiq-cluster[3421]: {"severity":"WARN","time":"2026-08-17T07:25:15.738Z","class":"CreatePipelineWorker","correlation_id":"01M079NPWSC42JWX5FRRRMB24W","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"4e3e621ff53dd96f25cf46cfa8633c0472c0ba33","after":"2b5870faf44f4f50eae55d42e55a8040db7166ea","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"2b5870faf44f4f50eae55d42e55a8040db7166ea","ref":"refs/heads/master"},"retry":0}2207gitlab # [ 425.015685] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-17T07:25:15.751Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"e62cda18926882f941af3f48","created_at":"2026-08-17T07:25:11.443Z","trace_propagation_headers":{"sentry-trace":"64f74885bc764cd0b8767595e10cfa5e-7bb0a49177bd4557","baggage":"sentry-trace_id=64f74885bc764cd0b8767595e10cfa5e,sentry-release=Unknown"},"correlation_id":"01M079NPWSC42JWX5FRRRMB24W","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:94b1a1387267d5d1dd40584580e6673d8f119cf7da113ddd19491a0f112e951e","size_limiter":"validated","enqueued_at":"2026-08-17T07:25:11.448Z","job_size_bytes":467,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-e62cda18926882f941af3f48: done: 0.925899 sec","job_status":"done","queue_duration_s":3.376886,"scheduling_latency_s":3.376919,"gitaly_calls":7,"gitaly_duration_s":0.103269,"redis_calls":33,"redis_duration_s":0.008197,"redis_read_bytes":186,"redis_write_bytes":1839,"redis_cache_calls":3,"redis_cache_duration_s":0.000426,"redis_cache_read_bytes":45,"redis_cache_write_bytes":255,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.003037,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":443,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.003152,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001582,"redis_shared_state_read_bytes":17,"redis_shared_state_write_bytes":513,"db_count":27,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":27,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.03,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":24,"db_ci_count":3,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.025,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.792724,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.925899,"completed_at":"2026-08-17T07:25:15.751Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.029611,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2208gitlab # [ 425.079101] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/08/17:07:25:15 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/4e3e621ff53dd96f25cf46cfa8633c0472c0ba33 HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 3002209gitlab # [ 425.082269] nixbot[3496]: {"ts": "2026-08-17T07:25:15.772Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/4e3e621ff53dd96f25cf46cfa8633c0472c0ba33 \"HTTP/1.1 201 Created\""}2210gitlab # [ 425.085532] nixbot[3496]: INFO: ::ffff:127.0.0.1:40892 - "POST /webhooks/gitlab HTTP/1.1" 202 Accepted2211gitlab # [ 425.086965] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-17T07:25:15.755Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{\"idempotency_key\"=\u003e\"851bd535-dfda-4ae9-9efe-22d0b39f83d2\"}"],"class":"WebHookWorker","jid":"8e337b29caba7a1aafeaba70","created_at":"2026-08-17T07:25:11.480Z","trace_propagation_headers":{"sentry-trace":"64f74885bc764cd0b8767595e10cfa5e-7bb0a49177bd4557","baggage":"sentry-trace_id=64f74885bc764cd0b8767595e10cfa5e,sentry-release=Unknown"},"correlation_id":"01M079NPWSC42JWX5FRRRMB24W","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c7afc981b7939cdf9fa443fd1dc1856a57b11a8170897b805c026df9af8c885","size_limiter":"validated","enqueued_at":"2026-08-17T07:25:11.485Z","job_size_bytes":1749,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-8e337b29caba7a1aafeaba70: start","job_status":"start","queue_duration_s":4.269486,"scheduling_latency_s":4.269529}2212gitlab # [ 425.105846] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-17T07:25:15.827Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{:idempotency_key=\u003e\"851bd535-dfda-4ae9-9efe-22d0b39f83d2\"}"],"class":"WebHookWorker","jid":"8e337b29caba7a1aafeaba70","created_at":"2026-08-17T07:25:11.480Z","trace_propagation_headers":{"sentry-trace":"64f74885bc764cd0b8767595e10cfa5e-7bb0a49177bd4557","baggage":"sentry-trace_id=64f74885bc764cd0b8767595e10cfa5e,sentry-release=Unknown"},"correlation_id":"01M079NPWSC42JWX5FRRRMB24W","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c7afc981b7939cdf9fa443fd1dc1856a57b11a8170897b805c026df9af8c885","size_limiter":"validated","enqueued_at":"2026-08-17T07:25:11.485Z","job_size_bytes":1749,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-8e337b29caba7a1aafeaba70: done: 0.072659 sec","job_status":"done","queue_duration_s":4.269486,"scheduling_latency_s":4.269529,"redis_calls":14,"redis_duration_s":0.003272,"redis_read_bytes":26,"redis_write_bytes":4684,"redis_queues_calls":2,"redis_queues_duration_s":0.000452,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3728,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001768,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":630,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001052,"redis_shared_state_read_bytes":17,"redis_shared_state_write_bytes":326,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"external_http_count":1,"external_http_duration_s":0.013136499999973239,"cpu_s":0.044149,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.web_hook_worker.response_status":"success","extra.web_hook_worker.http_status":"ok","extra.web_hook_worker.signing_token_present":false,"duration_s":0.072659,"completed_at":"2026-08-17T07:25:15.827Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006374,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2213gitlab # [ 425.152569] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-17T07:25:15.829Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"1921b851b3c5571c62291111","created_at":"2026-08-17T07:25:12.332Z","trace_propagation_headers":{"sentry-trace":"6f216aadb69f41e7819c164892b86bed-9f694cd46c4e4daf","baggage":"sentry-trace_id=6f216aadb69f41e7819c164892b86bed,sentry-release=Unknown"},"correlation_id":"01M079NRPJBKWT4AEE0M5HHC4R","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-08-17T07:25:12.342Z","job_size_bytes":23,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-1921b851b3c5571c62291111: start","job_status":"start","queue_duration_s":3.487235,"scheduling_latency_s":3.487264}2214gitlab # [ 425.169287] gitaly[913]: time="2026-08-17T07:25:15.867Z" level=info msg="finished unary call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M079RFM9CJB0GJ85WV2N7CK0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-17T07:25:45.664" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-17T07:25:15.865" grpc.time_ms=1.754 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2215gitlab # [ 425.182485] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/08/17:07:25:15 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 722216gitlab # [ 425.184660] gitaly[913]: time="2026-08-17T07:25:15.928Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=0 command.user_time_ms=5 component=gitaly.StreamServerInterceptor correlation_id=01M079RFM9CJB0GJ85WV2N7CK0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-17T07:25:25.228" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-17T07:25:15.918" grpc.time_ms=9.334 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2217gitlab # [ 425.198229] gitaly[913]: time="2026-08-17T07:25:15.931Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=577 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=5 command.system_time_ms=2 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M079RFPJ9G92NX971NX3Q759 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=186 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-17T07:25:15.920" grpc.time_ms=11.401 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc2218gitlab # [ 425.211253] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-17T07:25:15.975Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"1921b851b3c5571c62291111","created_at":"2026-08-17T07:25:12.332Z","trace_propagation_headers":{"sentry-trace":"6f216aadb69f41e7819c164892b86bed-9f694cd46c4e4daf","baggage":"sentry-trace_id=6f216aadb69f41e7819c164892b86bed,sentry-release=Unknown"},"correlation_id":"01M079NRPJBKWT4AEE0M5HHC4R","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-08-17T07:25:12.342Z","job_size_bytes":23,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-1921b851b3c5571c62291111: done: 0.14605 sec","job_status":"done","queue_duration_s":3.487235,"scheduling_latency_s":3.487264,"redis_calls":10,"redis_duration_s":0.003264,"redis_read_bytes":9,"redis_write_bytes":1029,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000466,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001612,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":534,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001186,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":200,"db_count":15,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.023,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":11,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.005,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.005,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.02,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.108049,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00063228,"duration_s":0.14605,"completed_at":"2026-08-17T07:25:15.975Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.028714,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2219gitlab # [ 425.255662] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-17T07:25:15.978Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"be7dbe2541d1e4a5499ad859","created_at":"2026-08-17T07:25:12.574Z","trace_propagation_headers":{"sentry-trace":"6f216aadb69f41e7819c164892b86bed-9f694cd46c4e4daf","baggage":"sentry-trace_id=6f216aadb69f41e7819c164892b86bed,sentry-release=Unknown"},"correlation_id":"01M079NRPJBKWT4AEE0M5HHC4R","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-08-17T07:25:12.586Z","job_size_bytes":3,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-be7dbe2541d1e4a5499ad859: start","job_status":"start","queue_duration_s":3.392393,"scheduling_latency_s":3.392429}2220gitlab # [ 425.273735] nixbot[3496]: {"ts": "2026-08-17T07:25:15.980Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/4e3e621ff53dd96f25cf46cfa8633c0472c0ba33 \"HTTP/1.1 201 Created\""}2221gitlab # [ 425.276525] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/08/17:07:25:15 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/4e3e621ff53dd96f25cf46cfa8633c0472c0ba33 HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 1932222gitlab # [ 425.278966] gitlab-workhorse[819]: time="2026-08-17T07:25:16Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672223gitlab # [ 425.280861] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/08/17:07:25:16 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 762224gitlab # [ 425.282719] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-17T07:25:16.027Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"be7dbe2541d1e4a5499ad859","created_at":"2026-08-17T07:25:12.574Z","trace_propagation_headers":{"sentry-trace":"6f216aadb69f41e7819c164892b86bed-9f694cd46c4e4daf","baggage":"sentry-trace_id=6f216aadb69f41e7819c164892b86bed,sentry-release=Unknown"},"correlation_id":"01M079NRPJBKWT4AEE0M5HHC4R","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-08-17T07:25:12.586Z","job_size_bytes":3,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-be7dbe2541d1e4a5499ad859: done: 0.049343 sec","job_status":"done","queue_duration_s":3.392393,"scheduling_latency_s":3.392429,"redis_calls":10,"redis_duration_s":0.005042,"redis_read_bytes":9,"redis_write_bytes":1165,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000971,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002411,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00166,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":234,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.030959,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00039402,"duration_s":0.049343,"completed_at":"2026-08-17T07:25:16.027Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004798,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2225gitlab # [ 425.326934] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-17T07:25:16.029Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"758cc0082ccced7e501d97f2","created_at":"2026-08-17T07:25:12.611Z","trace_propagation_headers":{"sentry-trace":"6f216aadb69f41e7819c164892b86bed-9f694cd46c4e4daf","baggage":"sentry-trace_id=6f216aadb69f41e7819c164892b86bed,sentry-release=Unknown"},"correlation_id":"01M079NRPJBKWT4AEE0M5HHC4R","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-08-17T07:25:12.626Z","job_size_bytes":3,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-758cc0082ccced7e501d97f2: start","job_status":"start","queue_duration_s":3.402855,"scheduling_latency_s":3.402878}2226gitlab # [ 425.342904] gitaly[913]: time="2026-08-17T07:25:16.011Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M079RFRZEF9Z0Q0H43JTF5QE grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-17T07:25:16.002" pid=913 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2227gitlab # [ 425.353250] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/08/17:07:25:16 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 602228gitlab # [ 425.355309] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-17T07:25:16.083Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"758cc0082ccced7e501d97f2","created_at":"2026-08-17T07:25:12.611Z","trace_propagation_headers":{"sentry-trace":"6f216aadb69f41e7819c164892b86bed-9f694cd46c4e4daf","baggage":"sentry-trace_id=6f216aadb69f41e7819c164892b86bed,sentry-release=Unknown"},"correlation_id":"01M079NRPJBKWT4AEE0M5HHC4R","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-08-17T07:25:12.626Z","job_size_bytes":3,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-758cc0082ccced7e501d97f2: done: 0.054206 sec","job_status":"done","queue_duration_s":3.402855,"scheduling_latency_s":3.402878,"redis_calls":10,"redis_duration_s":0.002023,"redis_read_bytes":9,"redis_write_bytes":1205,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000506,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001148,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000369,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.007,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.037161,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00031124,"duration_s":0.054206,"completed_at":"2026-08-17T07:25:16.083Z","load_balancing_strategy":"primary","db_duration_s":0.006882,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2229gitlab # [ 425.399368] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-17T07:25:16.084Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"e38981004068f00e8a0b9c57","created_at":"2026-08-17T07:25:12.657Z","trace_propagation_headers":{"sentry-trace":"6f216aadb69f41e7819c164892b86bed-9f694cd46c4e4daf","baggage":"sentry-trace_id=6f216aadb69f41e7819c164892b86bed,sentry-release=Unknown"},"correlation_id":"01M079NRPJBKWT4AEE0M5HHC4R","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-08-17T07:25:12.667Z","job_size_bytes":3,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-e38981004068f00e8a0b9c57: start","job_status":"start","queue_duration_s":3.417401,"scheduling_latency_s":3.417427}2230gitlab # [ 425.415191] gitaly[913]: time="2026-08-17T07:25:16.011Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M079RFRZEF9Z0Q0H43JTF5QE grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-17T07:25:16.002" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc2231gitlab # [ 425.429209] nix-daemon[3720]: accepted connection from pid 4279, user nixbot2232gitlab # [ 425.430213] gitlab-workhorse[819]: time="2026-08-17T07:25:16Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672233gitlab # [ 425.432057] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/08/17:07:25:16 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 742234gitlab # [ 425.433939] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-17T07:25:16.133Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"e38981004068f00e8a0b9c57","created_at":"2026-08-17T07:25:12.657Z","trace_propagation_headers":{"sentry-trace":"6f216aadb69f41e7819c164892b86bed-9f694cd46c4e4daf","baggage":"sentry-trace_id=6f216aadb69f41e7819c164892b86bed,sentry-release=Unknown"},"correlation_id":"01M079NRPJBKWT4AEE0M5HHC4R","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-08-17T07:25:12.667Z","job_size_bytes":3,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-e38981004068f00e8a0b9c57: done: 0.048439 sec","job_status":"done","queue_duration_s":3.417401,"scheduling_latency_s":3.417427,"redis_calls":13,"redis_duration_s":0.0024820000000000003,"redis_read_bytes":66,"redis_write_bytes":1182,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000473,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001183,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000515,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000311,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.030946,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00026556,"duration_s":0.048439,"completed_at":"2026-08-17T07:25:16.133Z","load_balancing_strategy":"primary","db_duration_s":0.005176,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2235gitlab # [ 425.479974] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-17T07:25:16.135Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"3ecf40e59946394d54982e6a","created_at":"2026-08-17T07:25:12.668Z","trace_propagation_headers":{"sentry-trace":"6f216aadb69f41e7819c164892b86bed-9f694cd46c4e4daf","baggage":"sentry-trace_id=6f216aadb69f41e7819c164892b86bed,sentry-release=Unknown"},"correlation_id":"01M079NRPJBKWT4AEE0M5HHC4R","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-08-17T07:25:12.678Z","job_size_bytes":3,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-3ecf40e59946394d54982e6a: start","job_status":"start","queue_duration_s":3.456375,"scheduling_latency_s":3.456403}2236gitlab # [ 425.496783] gitaly[913]: time="2026-08-17T07:25:16.011Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M079RFRZEF9Z0Q0H43JTF5QE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-17T07:25:16.002" grpc.time_ms=9.394 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc2237gitlab # [ 425.511093] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-17T07:25:16.178Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"3ecf40e59946394d54982e6a","created_at":"2026-08-17T07:25:12.668Z","trace_propagation_headers":{"sentry-trace":"6f216aadb69f41e7819c164892b86bed-9f694cd46c4e4daf","baggage":"sentry-trace_id=6f216aadb69f41e7819c164892b86bed,sentry-release=Unknown"},"correlation_id":"01M079NRPJBKWT4AEE0M5HHC4R","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-08-17T07:25:12.678Z","job_size_bytes":3,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-3ecf40e59946394d54982e6a: done: 0.042852 sec","job_status":"done","queue_duration_s":3.456375,"scheduling_latency_s":3.456403,"redis_calls":10,"redis_duration_s":0.004684,"redis_read_bytes":9,"redis_write_bytes":1159,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000658,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003623,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000403,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.027806,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0003182,"duration_s":0.042852,"completed_at":"2026-08-17T07:25:16.178Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004538,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2238gitlab # [ 425.555280] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-17T07:25:16.179Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"c8ed0fc583790cb1285392ea","created_at":"2026-08-17T07:25:12.681Z","trace_propagation_headers":{"sentry-trace":"6f216aadb69f41e7819c164892b86bed-9f694cd46c4e4daf","baggage":"sentry-trace_id=6f216aadb69f41e7819c164892b86bed,sentry-release=Unknown"},"correlation_id":"01M079NRPJBKWT4AEE0M5HHC4R","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-08-17T07:25:12.691Z","job_size_bytes":19,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-c8ed0fc583790cb1285392ea: start","job_status":"start","queue_duration_s":3.488446,"scheduling_latency_s":3.488486}2239gitlab # [ 425.571704] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/08/17:07:25:16 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 632240gitlab # [ 425.573876] gitaly[913]: time="2026-08-17T07:25:16.099Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=578 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=0 command.user_time_ms=4 component=gitaly.StreamServerInterceptor correlation_id=01M079RFW750WXX72Z5KMHTG5G grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-17T07:25:16.091" grpc.time_ms=7.516 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc2241gitlab # [ 425.586814] gitaly[913]: time="2026-08-17T07:25:16.174Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M079RFY56S5MCKPW3MC7NNVS grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-17T07:25:16.164" pid=913 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2242gitlab # [ 425.597912] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-17T07:25:16.214Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"c8ed0fc583790cb1285392ea","created_at":"2026-08-17T07:25:12.681Z","trace_propagation_headers":{"sentry-trace":"6f216aadb69f41e7819c164892b86bed-9f694cd46c4e4daf","baggage":"sentry-trace_id=6f216aadb69f41e7819c164892b86bed,sentry-release=Unknown"},"correlation_id":"01M079NRPJBKWT4AEE0M5HHC4R","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-08-17T07:25:12.691Z","job_size_bytes":19,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-c8ed0fc583790cb1285392ea: done: 0.034824 sec","job_status":"done","queue_duration_s":3.488446,"scheduling_latency_s":3.488486,"redis_calls":11,"redis_duration_s":0.002147,"redis_read_bytes":10,"redis_write_bytes":1121,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000269,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":287,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001496,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":640,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000382,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":194,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00053472,"duration_s":0.034824,"completed_at":"2026-08-17T07:25:16.214Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004272,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2243gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea'2244gitlab # [ 425.642058] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-17T07:25:16.215Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"a13a13c8565d20c5589bf0d9","created_at":"2026-08-17T07:25:12.696Z","trace_propagation_headers":{"sentry-trace":"6f216aadb69f41e7819c164892b86bed-9f694cd46c4e4daf","baggage":"sentry-trace_id=6f216aadb69f41e7819c164892b86bed,sentry-release=Unknown"},"correlation_id":"01M079NRPJBKWT4AEE0M5HHC4R","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-08-17T07:25:12.703Z","job_size_bytes":66,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-a13a13c8565d20c5589bf0d9: start","job_status":"start","queue_duration_s":3.512139,"scheduling_latency_s":3.51216}2245gitlab # [ 425.658755] gitlab-workhorse[819]: time="2026-08-17T07:25:16Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2162246gitlab # [ 425.660480] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/08/17:07:25:16 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 216 "" "git/2.55.0" 842247gitlab # [ 425.662172] gitaly[913]: time="2026-08-17T07:25:16.174Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=583 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M079RFY56S5MCKPW3MC7NNVS grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-17T07:25:16.164" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc2248gitlab # [ 425.675579] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-17T07:25:16.250Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"a13a13c8565d20c5589bf0d9","created_at":"2026-08-17T07:25:12.696Z","trace_propagation_headers":{"sentry-trace":"6f216aadb69f41e7819c164892b86bed-9f694cd46c4e4daf","baggage":"sentry-trace_id=6f216aadb69f41e7819c164892b86bed,sentry-release=Unknown"},"correlation_id":"01M079NRPJBKWT4AEE0M5HHC4R","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-08-17T07:25:12.703Z","job_size_bytes":66,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-a13a13c8565d20c5589bf0d9: done: 0.034959 sec","job_status":"done","queue_duration_s":3.512139,"scheduling_latency_s":3.51216,"redis_calls":10,"redis_duration_s":0.0013670000000000002,"redis_read_bytes":9,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000262,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":335,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00083,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000275,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":240,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024041,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0002721,"duration_s":0.034959,"completed_at":"2026-08-17T07:25:16.250Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00475,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2249gitlab # [ 425.720612] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-17T07:25:16.252Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"eef48bd781dafbca20dd33e0","created_at":"2026-08-17T07:25:12.705Z","trace_propagation_headers":{"sentry-trace":"6f216aadb69f41e7819c164892b86bed-9f694cd46c4e4daf","baggage":"sentry-trace_id=6f216aadb69f41e7819c164892b86bed,sentry-release=Unknown"},"correlation_id":"01M079NRPJBKWT4AEE0M5HHC4R","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-08-17T07:25:12.712Z","job_size_bytes":3,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-eef48bd781dafbca20dd33e0: start","job_status":"start","queue_duration_s":3.540202,"scheduling_latency_s":3.540224}2250gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea', in 0.09 seconds)2251(finished: subtest: push delivers the webhook, in 91.83 seconds)2252subtest: eval and build post commit statuses2253gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/2b5870faf44f4f50eae55d42e55a8040db7166ea/statuses2254gitlab # [ 425.736734] gitaly[913]: time="2026-08-17T07:25:16.175Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=583 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M079RFY56S5MCKPW3MC7NNVS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-17T07:25:16.164" grpc.time_ms=10.08 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc2255gitlab # [ 425.752922] nixbot[3496]: INFO: ::ffff:127.0.0.1:40898 - "GET /api/repos/gitlab/root/test-flake/builds?commit=2b5870faf44f4f50eae55d42e55a8040db7166ea HTTP/1.1" 200 OK2256gitlab # [ 425.755019] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-17T07:25:16.300Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"eef48bd781dafbca20dd33e0","created_at":"2026-08-17T07:25:12.705Z","trace_propagation_headers":{"sentry-trace":"6f216aadb69f41e7819c164892b86bed-9f694cd46c4e4daf","baggage":"sentry-trace_id=6f216aadb69f41e7819c164892b86bed,sentry-release=Unknown"},"correlation_id":"01M079NRPJBKWT4AEE0M5HHC4R","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-08-17T07:25:12.712Z","job_size_bytes":3,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-eef48bd781dafbca20dd33e0: done: 0.047952 sec","job_status":"done","queue_duration_s":3.540202,"scheduling_latency_s":3.540224,"redis_calls":10,"redis_duration_s":0.002029,"redis_read_bytes":9,"redis_write_bytes":973,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000917,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":281,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.0008,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":506,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000312,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":186,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.032749,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00022818,"duration_s":0.047952,"completed_at":"2026-08-17T07:25:16.300Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.008311,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2257gitlab # [ 425.800407] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-17T07:25:16.301Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"5f35254d6e8bcff92acf7cb6","created_at":"2026-08-17T07:25:12.722Z","trace_propagation_headers":{"sentry-trace":"6f216aadb69f41e7819c164892b86bed-9f694cd46c4e4daf","baggage":"sentry-trace_id=6f216aadb69f41e7819c164892b86bed,sentry-release=Unknown"},"correlation_id":"01M079NRPJBKWT4AEE0M5HHC4R","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-08-17T07:25:12.728Z","job_size_bytes":3,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-5f35254d6e8bcff92acf7cb6: start","job_status":"start","queue_duration_s":3.572945,"scheduling_latency_s":3.572963}2258gitlab # [ 425.816748] gitaly[913]: time="2026-08-17T07:25:16.272Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=578 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=4 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M079RG1HKMDNQACKMK6Q9F5D grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=187 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-17T07:25:16.259" grpc.time_ms=12.945 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc2259gitlab # [ 425.830136] gitaly[913]: time="2026-08-17T07:25:16.357Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M079RG3KFPZD904JEXXSS1FF grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-17T07:25:16.332" pid=913 remote_ip="2001:db8:1::1" request_sha=22300437632a556c435888000544c7c9bb3428e9 response_bytes=216 span.kind=server system=grpc2260gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/2b5870faf44f4f50eae55d42e55a8040db7166ea/statuses, in 0.14 seconds)2261gitlab # [ 425.840564] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-17T07:25:16.340Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"5f35254d6e8bcff92acf7cb6","created_at":"2026-08-17T07:25:12.722Z","trace_propagation_headers":{"sentry-trace":"6f216aadb69f41e7819c164892b86bed-9f694cd46c4e4daf","baggage":"sentry-trace_id=6f216aadb69f41e7819c164892b86bed,sentry-release=Unknown"},"correlation_id":"01M079NRPJBKWT4AEE0M5HHC4R","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-08-17T07:25:12.728Z","job_size_bytes":3,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-5f35254d6e8bcff92acf7cb6: done: 0.038534 sec","job_status":"done","queue_duration_s":3.572945,"scheduling_latency_s":3.572963,"redis_calls":10,"redis_duration_s":0.0013700000000000001,"redis_read_bytes":9,"redis_write_bytes":1023,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000282,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000798,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00029,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":198,"db_count":7,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024036,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00028624,"duration_s":0.038534,"completed_at":"2026-08-17T07:25:16.339Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.008954,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2262gitlab # [ 425.886610] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-17T07:25:16.341Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"1a6871d9799e1da3f3f1ee34","created_at":"2026-08-17T07:25:12.729Z","trace_propagation_headers":{"sentry-trace":"6f216aadb69f41e7819c164892b86bed-9f694cd46c4e4daf","baggage":"sentry-trace_id=6f216aadb69f41e7819c164892b86bed,sentry-release=Unknown"},"correlation_id":"01M079NRPJBKWT4AEE0M5HHC4R","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-17T07:25:12.737Z","job_size_bytes":6,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-1a6871d9799e1da3f3f1ee34: start","job_status":"start","queue_duration_s":3.604204,"scheduling_latency_s":3.604224}2263gitlab # [ 425.902857] gitaly[913]: time="2026-08-17T07:25:16.357Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=18 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1100 command.oublock=0 command.real_time_ms=22 command.spawn_token_fork_ms=2 command.system_time_ms=15 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M079RG3KFPZD904JEXXSS1FF grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-17T07:25:16.332" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc2264gitlab # [ 425.916351] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/08/17:07:25:16 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/2b5870faf44f4f50eae55d42e55a8040db7166ea/statuses HTTP/1.1" 200 2 "" "curl/8.21.0" 942265gitlab # [ 425.918863] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-17T07:25:16.369Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"1a6871d9799e1da3f3f1ee34","created_at":"2026-08-17T07:25:12.729Z","trace_propagation_headers":{"sentry-trace":"6f216aadb69f41e7819c164892b86bed-9f694cd46c4e4daf","baggage":"sentry-trace_id=6f216aadb69f41e7819c164892b86bed,sentry-release=Unknown"},"correlation_id":"01M079NRPJBKWT4AEE0M5HHC4R","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-17T07:25:12.737Z","job_size_bytes":6,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-1a6871d9799e1da3f3f1ee34: done: 0.028138 sec","job_status":"done","queue_duration_s":3.604204,"scheduling_latency_s":3.604224,"redis_calls":10,"redis_duration_s":0.001429,"redis_read_bytes":9,"redis_write_bytes":1127,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.0003,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":321,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000837,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000292,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":224,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015389,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0002412,"duration_s":0.028138,"completed_at":"2026-08-17T07:25:16.369Z","load_balancing_strategy":"primary","db_duration_s":0.005928,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2266gitlab # [ 425.962753] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-17T07:25:16.371Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"b93e14a49ed4441c94628812","created_at":"2026-08-17T07:25:12.738Z","trace_propagation_headers":{"sentry-trace":"6f216aadb69f41e7819c164892b86bed-9f694cd46c4e4daf","baggage":"sentry-trace_id=6f216aadb69f41e7819c164892b86bed,sentry-release=Unknown"},"correlation_id":"01M079NRPJBKWT4AEE0M5HHC4R","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-08-17T07:25:12.743Z","job_size_bytes":3,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-b93e14a49ed4441c94628812: start","job_status":"start","queue_duration_s":3.627978,"scheduling_latency_s":3.627998}2267gitlab # [ 425.978004] gitaly[913]: time="2026-08-17T07:25:16.358Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=18 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1100 command.oublock=0 command.real_time_ms=22 command.spawn_token_fork_ms=2 command.system_time_ms=15 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M079RG3KFPZD904JEXXSS1FF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-17T07:25:16.332" grpc.time_ms=26.334 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc2268gitlab # [ 425.992790] nixbot[3496]: {"ts": "2026-08-17T07:25:16.747Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/2b5870faf44f4f50eae55d42e55a8040db7166ea \"HTTP/1.1 201 Created\""}2269gitlab # [ 425.995458] nixbot[3496]: {"ts": "2026-08-17T07:25:16.755Z", "level": "info", "logger": "nixbot.flake_prefetch", "msg": "prefetching flake inputs", "flake_dir": "/var/lib/nixbot/worktrees/1-2b5870faf44f-4"}2270gitlab # [ 425.997892] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-17T07:25:16.416Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"b93e14a49ed4441c94628812","created_at":"2026-08-17T07:25:12.738Z","trace_propagation_headers":{"sentry-trace":"6f216aadb69f41e7819c164892b86bed-9f694cd46c4e4daf","baggage":"sentry-trace_id=6f216aadb69f41e7819c164892b86bed,sentry-release=Unknown"},"correlation_id":"01M079NRPJBKWT4AEE0M5HHC4R","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-08-17T07:25:12.743Z","job_size_bytes":3,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-b93e14a49ed4441c94628812: done: 0.045274 sec","job_status":"done","queue_duration_s":3.627978,"scheduling_latency_s":3.627998,"redis_calls":10,"redis_duration_s":0.002354,"redis_read_bytes":9,"redis_write_bytes":989,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000349,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":285,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001353,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":514,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000652,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":190,"db_count":7,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026138,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0005877,"duration_s":0.045274,"completed_at":"2026-08-17T07:25:16.416Z","load_balancing_strategy":"primary","db_duration_s":0.008299,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2271gitlab # [ 426.040829] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-17T07:25:16.418Z","retry":25,"queue":"default","version":0,"store":null,"args":["1"],"class":"Ci::TrackFirstPipelineSucceededWorker","jid":"b207c45f37ec88718c786448","created_at":"2026-08-17T07:25:12.752Z","trace_propagation_headers":{"sentry-trace":"6f216aadb69f41e7819c164892b86bed-9f694cd46c4e4daf","baggage":"sentry-trace_id=6f216aadb69f41e7819c164892b86bed,sentry-release=Unknown"},"correlation_id":"01M079NRPJBKWT4AEE0M5HHC4R","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c5d2c9faee55896683425d4b50feeb49f6074c2dda34904072dea18e4eda0a9b","size_limiter":"validated","enqueued_at":"2026-08-17T07:25:12.759Z","job_size_bytes":3,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackFirstPipelineSucceededWorker JID-b207c45f37ec88718c786448: start","job_status":"start","queue_duration_s":3.659461,"scheduling_latency_s":3.659485}2272gitlab # [ 426.057527] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/08/17:07:25:16 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/2b5870faf44f4f50eae55d42e55a8040db7166ea HTTP/1.1" 201 631 "" "python-httpx/0.28.1" 3402273gitlab # [ 426.059963] gitaly[913]: time="2026-08-17T07:25:16.467Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M079RG7N29MYMESVRXTZ1EVW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-17T07:25:46.266" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-17T07:25:16.467" grpc.time_ms=0.449 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2274gitlab # [ 426.072855] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-17T07:25:16.522Z","retry":25,"queue":"default","version":0,"store":null,"args":["1"],"class":"Ci::TrackFirstPipelineSucceededWorker","jid":"b207c45f37ec88718c786448","created_at":"2026-08-17T07:25:12.752Z","trace_propagation_headers":{"sentry-trace":"6f216aadb69f41e7819c164892b86bed-9f694cd46c4e4daf","baggage":"sentry-trace_id=6f216aadb69f41e7819c164892b86bed,sentry-release=Unknown"},"correlation_id":"01M079NRPJBKWT4AEE0M5HHC4R","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c5d2c9faee55896683425d4b50feeb49f6074c2dda34904072dea18e4eda0a9b","size_limiter":"validated","enqueued_at":"2026-08-17T07:25:12.759Z","job_size_bytes":3,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackFirstPipelineSucceededWorker JID-b207c45f37ec88718c786448: done: 0.104029 sec","job_status":"done","queue_duration_s":3.659461,"scheduling_latency_s":3.659485,"redis_calls":14,"redis_duration_s":0.005201,"redis_read_bytes":14,"redis_write_bytes":1335,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000336,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":317,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003133,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001732,"redis_shared_state_read_bytes":8,"redis_shared_state_write_bytes":436,"db_count":13,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":13,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.026,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.021,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.067723,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0007941,"duration_s":0.104029,"completed_at":"2026-08-17T07:25:16.522Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.027229,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2275gitlab # [ 426.117948] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-17T07:25:16.526Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"d33ebf99437b4d8d7b755161","created_at":"2026-08-17T07:25:12.978Z","trace_propagation_headers":{"sentry-trace":"e3c3cf4272ad43299b705d9df675c8bb-bd83cbb116964780","baggage":"sentry-trace_id=e3c3cf4272ad43299b705d9df675c8bb,sentry-release=Unknown"},"correlation_id":"01M079NG2Z5QZVN0CSZM1X8NAK","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-08-17T07:25:12.984Z","job_size_bytes":3,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-d33ebf99437b4d8d7b755161: start","job_status":"start","queue_duration_s":3.541611,"scheduling_latency_s":3.541648}2276gitlab # [ 426.133727] nix-daemon[3720]: accepted connection from pid 4353, user nixbot2277gitlab # [ 426.134651] nix-daemon[3720]: accepted connection from pid 4379, user nixbot2278gitlab # [ 426.135560] gitaly[913]: time="2026-08-17T07:25:16.487Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=591 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=6 command.system_time_ms=0 command.user_time_ms=5 component=gitaly.StreamServerInterceptor correlation_id=01M079RG7N29MYMESVRXTZ1EVW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-08-17T07:25:46.276" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-08-17T07:25:16.476" grpc.time_ms=10.373 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2279gitlab # [ 426.149976] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-17T07:25:16.589Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"d33ebf99437b4d8d7b755161","created_at":"2026-08-17T07:25:12.978Z","trace_propagation_headers":{"sentry-trace":"e3c3cf4272ad43299b705d9df675c8bb-bd83cbb116964780","baggage":"sentry-trace_id=e3c3cf4272ad43299b705d9df675c8bb,sentry-release=Unknown"},"correlation_id":"01M079NG2Z5QZVN0CSZM1X8NAK","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-08-17T07:25:12.984Z","job_size_bytes":3,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-d33ebf99437b4d8d7b755161: done: 0.063032 sec","job_status":"done","queue_duration_s":3.541611,"scheduling_latency_s":3.541648,"redis_calls":19,"redis_duration_s":0.005217,"redis_read_bytes":21,"redis_write_bytes":4290,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000782,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":678,"redis_queues_calls":3,"redis_queues_duration_s":0.000438,"redis_queues_read_bytes":3,"redis_queues_write_bytes":2261,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.002536,"redis_queues_metadata_read_bytes":9,"redis_queues_metadata_write_bytes":1024,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.001461,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":327,"db_count":7,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.005,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.005,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.043388,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00942116,"duration_s":0.063032,"completed_at":"2026-08-17T07:25:16.589Z","load_balancing_strategy":"primary","db_duration_s":0.009776,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2280gitlab # [ 426.194943] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-17T07:25:16.590Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","379e783f7a3a7674735d0d29"],"class":"WebHooks::LogExecutionWorker","jid":"163bc05b9e6f1fe87f2e9766","created_at":"2026-08-17T07:25:14.695Z","trace_propagation_headers":{"sentry-trace":"e3c3cf4272ad43299b705d9df675c8bb-0c4a496f9f7448a5","baggage":"sentry-trace_id=e3c3cf4272ad43299b705d9df675c8bb,sentry-release=Unknown"},"correlation_id":"01M079NG2Z5QZVN0CSZM1X8NAK","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f642952149e47690fd4e4501445c1e5f334d5eec17db33fce633b97fb0233d8b","size_limiter":"validated","enqueued_at":"2026-08-17T07:25:14.710Z","job_size_bytes":2592,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-163bc05b9e6f1fe87f2e9766: start","job_status":"start","queue_duration_s":1.879662,"scheduling_latency_s":1.879683}2281gitlab # [ 426.212343] nixbot[3496]: {"ts": "2026-08-17T07:25:16.901Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-2b5870faf44f-4", "argv0": "bwrap"}2282gitlab # [ 426.215020] gitaly[913]: time="2026-08-17T07:25:16.500Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M079RG7N29MYMESVRXTZ1EVW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-17T07:25:26.153" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-17T07:25:16.493" grpc.time_ms=6.921 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2283gitlab # [ 426.228916] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-17T07:25:16.641Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","379e783f7a3a7674735d0d29"],"class":"WebHooks::LogExecutionWorker","jid":"163bc05b9e6f1fe87f2e9766","created_at":"2026-08-17T07:25:14.695Z","trace_propagation_headers":{"sentry-trace":"e3c3cf4272ad43299b705d9df675c8bb-0c4a496f9f7448a5","baggage":"sentry-trace_id=e3c3cf4272ad43299b705d9df675c8bb,sentry-release=Unknown"},"correlation_id":"01M079NG2Z5QZVN0CSZM1X8NAK","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f642952149e47690fd4e4501445c1e5f334d5eec17db33fce633b97fb0233d8b","size_limiter":"validated","enqueued_at":"2026-08-17T07:25:14.710Z","job_size_bytes":2592,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-163bc05b9e6f1fe87f2e9766: done: 0.051278 sec","job_status":"done","queue_duration_s":1.879662,"scheduling_latency_s":1.879683,"redis_calls":10,"redis_duration_s":0.0025009999999999998,"redis_read_bytes":9,"redis_write_bytes":1045,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000967,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00122,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000314,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":4,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.005,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.005,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.034228,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00028376,"duration_s":0.051278,"completed_at":"2026-08-17T07:25:16.641Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007467,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2284gitlab # [ 426.274337] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-17T07:25:16.643Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"6ca99b34063aa29a238b1b08","created_at":"2026-08-17T07:25:15.415Z","trace_propagation_headers":{"sentry-trace":"c85d3e5382094c2eb35f851befdbc22f-ff7bb475a2d2420b","baggage":"sentry-trace_id=c85d3e5382094c2eb35f851befdbc22f,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M079REYPKV2XEAYQFXMNCPGS","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-17T07:25:15.427Z","job_size_bytes":3,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-6ca99b34063aa29a238b1b08: start","job_status":"start","queue_duration_s":1.215895,"scheduling_latency_s":1.215917}2285gitlab # [ 426.290788] gitaly[913]: time="2026-08-17T07:25:16.520Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M079RG7N29MYMESVRXTZ1EVW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-08-17T07:25:26.179" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-17T07:25:16.519" grpc.time_ms=0.32 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2286gitlab # [ 426.303227] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-17T07:25:16.933Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"6ca99b34063aa29a238b1b08","created_at":"2026-08-17T07:25:15.415Z","trace_propagation_headers":{"sentry-trace":"c85d3e5382094c2eb35f851befdbc22f-ff7bb475a2d2420b","baggage":"sentry-trace_id=c85d3e5382094c2eb35f851befdbc22f,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M079REYPKV2XEAYQFXMNCPGS","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-17T07:25:15.427Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":3421,"job_status":"rescheduled","message":"PipelineProcessWorker JID-6ca99b34063aa29a238b1b08: rescheduled"}2287gitlab # [ 426.318661] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-17T07:25:16.940Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"6ca99b34063aa29a238b1b08","created_at":"2026-08-17T07:25:15.415Z","trace_propagation_headers":{"sentry-trace":"c85d3e5382094c2eb35f851befdbc22f-ff7bb475a2d2420b","baggage":"sentry-trace_id=c85d3e5382094c2eb35f851befdbc22f,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M079REYPKV2XEAYQFXMNCPGS","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-17T07:25:15.427Z","job_size_bytes":3,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-6ca99b34063aa29a238b1b08: done: 0.297429 sec","job_status":"done","queue_duration_s":1.215895,"scheduling_latency_s":1.215917,"gitaly_calls":3,"gitaly_duration_s":0.100326,"redis_calls":66,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.011838999999999999,"redis_read_bytes":151,"redis_write_bytes":18014,"redis_action_cable_calls":2,"redis_action_cable_duration_s":0.000707,"redis_action_cable_read_bytes":2,"redis_action_cable_write_bytes":407,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.000811,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_queues_calls":22,"redis_queues_duration_s":0.002581,"redis_queues_read_bytes":29,"redis_queues_write_bytes":12313,"redis_queues_metadata_calls":19,"redis_queues_metadata_duration_s":0.004769,"redis_queues_metadata_read_bytes":30,"redis_queues_metadata_write_bytes":3093,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000332,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000435,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.001497,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":30,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":30,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.039,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":16,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":2,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.009,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.009,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.018,"db_ci_duration_s":0.021,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.155905,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.25199882,"duration_s":0.297429,"completed_at":"2026-08-17T07:25:16.940Z","load_balancing_strategy":"primary","db_duration_s":0.039682,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2288gitlab # [ 426.371404] gitaly[913]: time="2026-08-17T07:25:16.538Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=570 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=7 command.system_time_ms=0 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M079RG7N29MYMESVRXTZ1EVW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-08-17T07:25:26.186" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-17T07:25:16.526" grpc.time_ms=11.231 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2289gitlab # [ 426.385169] gitaly[913]: time="2026-08-17T07:25:16.611Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M079RG7N29MYMESVRXTZ1EVW grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4153 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-17T07:25:16.608" grpc.time_ms=2.595 pid=913 span.kind=server system=grpc2290gitlab # [ 426.394754] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-17T07:25:16.942Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","8e337b29caba7a1aafeaba70"],"class":"WebHooks::LogExecutionWorker","jid":"2762dccc8ffa11fed7610424","created_at":"2026-08-17T07:25:15.814Z","trace_propagation_headers":{"sentry-trace":"64f74885bc764cd0b8767595e10cfa5e-20628578c8c84ce8","baggage":"sentry-trace_id=64f74885bc764cd0b8767595e10cfa5e,sentry-release=Unknown"},"correlation_id":"01M079NPWSC42JWX5FRRRMB24W","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:123034b0cd7786548158c51d6f81b10a55ccc49d6c262d50189bf3c3320a3017","size_limiter":"validated","enqueued_at":"2026-08-17T07:25:15.818Z","job_size_bytes":2591,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-2762dccc8ffa11fed7610424: start","job_status":"start","queue_duration_s":1.124496,"scheduling_latency_s":1.124529}2291gitlab # [ 426.412436] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-17T07:25:16.971Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","8e337b29caba7a1aafeaba70"],"class":"WebHooks::LogExecutionWorker","jid":"2762dccc8ffa11fed7610424","created_at":"2026-08-17T07:25:15.814Z","trace_propagation_headers":{"sentry-trace":"64f74885bc764cd0b8767595e10cfa5e-20628578c8c84ce8","baggage":"sentry-trace_id=64f74885bc764cd0b8767595e10cfa5e,sentry-release=Unknown"},"correlation_id":"01M079NPWSC42JWX5FRRRMB24W","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:123034b0cd7786548158c51d6f81b10a55ccc49d6c262d50189bf3c3320a3017","size_limiter":"validated","enqueued_at":"2026-08-17T07:25:15.818Z","job_size_bytes":2591,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-2762dccc8ffa11fed7610424: done: 0.028434 sec","job_status":"done","queue_duration_s":1.124496,"scheduling_latency_s":1.124529,"redis_calls":7,"redis_duration_s":0.0017900000000000001,"redis_read_bytes":5,"redis_write_bytes":671,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001275,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000515,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":3,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.004,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.004,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018791,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.028434,"completed_at":"2026-08-17T07:25:16.971Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005049,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2292gitlab # [ 426.455845] gitaly[913]: time="2026-08-17T07:25:16.619Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M079RGCFC94PF2AY5XGYN91D grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-17T07:25:46.218" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-17T07:25:16.619" grpc.time_ms=0.484 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2293gitlab # [ 426.468452] gitaly[913]: time="2026-08-17T07:25:16.653Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M079RG7N29MYMESVRXTZ1EVW grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4155 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-17T07:25:16.653" grpc.time_ms=0.541 pid=913 span.kind=server system=grpc2294gitlab # [ 426.477968] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-17T07:25:16.972Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"ca120e2138d575a97242c3cd","created_at":"2026-08-17T07:25:16.573Z","trace_propagation_headers":{"sentry-trace":"e3c3cf4272ad43299b705d9df675c8bb-475b3ea0764c42f3","baggage":"sentry-trace_id=e3c3cf4272ad43299b705d9df675c8bb,sentry-release=Unknown"},"correlation_id":"01M079NG2Z5QZVN0CSZM1X8NAK","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-08-17T07:25:16.579Z","job_size_bytes":3,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-ca120e2138d575a97242c3cd: start","job_status":"start","queue_duration_s":0.392979,"scheduling_latency_s":0.393002}2295gitlab # [ 426.495055] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-17T07:25:17.072Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"ca120e2138d575a97242c3cd","created_at":"2026-08-17T07:25:16.573Z","trace_propagation_headers":{"sentry-trace":"e3c3cf4272ad43299b705d9df675c8bb-475b3ea0764c42f3","baggage":"sentry-trace_id=e3c3cf4272ad43299b705d9df675c8bb,sentry-release=Unknown"},"correlation_id":"01M079NG2Z5QZVN0CSZM1X8NAK","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-08-17T07:25:16.579Z","job_size_bytes":3,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-ca120e2138d575a97242c3cd: done: 0.099953 sec","job_status":"done","queue_duration_s":0.392979,"scheduling_latency_s":0.393002,"redis_calls":11,"redis_duration_s":0.002878,"redis_read_bytes":10,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00054,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001861,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":672,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000477,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":210,"db_count":12,"db_write_count":3,"db_cached_count":0,"db_txn_count":3,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.019,"db_main_txn_count":3,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.004,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.008,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.019,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.065645,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00033988,"duration_s":0.099953,"completed_at":"2026-08-17T07:25:17.072Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.030119,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2296gitlab # [ 426.542532] gitaly[913]: time="2026-08-17T07:25:16.662Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M079RG7N29MYMESVRXTZ1EVW diskcache=fbb58a89-76e5-4d75-9aa3-c5d3ff0319ad grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-17T07:25:26.199" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-17T07:25:16.540" pid=913 ref=refs/keep-around/2b5870faf44f4f50eae55d42e55a8040db7166ea remote_ip="2001:db8:1::1" revision=2b5870faf44f4f50eae55d42e55a8040db7166ea span.kind=server system=grpc username=root2297gitlab # [ 426.554622] nix-daemon[3720]: accepted connection from pid 4390, user nixbot2298gitlab # [ 426.555584] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-17T07:25:17.074Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"636d474e2ac061747992752d","created_at":"2026-08-17T07:25:16.667Z","trace_propagation_headers":{"sentry-trace":"1617c4bc6619401997bf87770baf7e5b-dd9f9cdc3c9e4309","baggage":"sentry-trace_id=1617c4bc6619401997bf87770baf7e5b,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M079RG7N29MYMESVRXTZ1EVW","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-08-17T07:25:16.672Z","job_size_bytes":65,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-636d474e2ac061747992752d: start","job_status":"start","queue_duration_s":0.402414,"scheduling_latency_s":0.402437}2299gitlab # [ 426.572415] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-17T07:25:17.109Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"636d474e2ac061747992752d","created_at":"2026-08-17T07:25:16.667Z","trace_propagation_headers":{"sentry-trace":"1617c4bc6619401997bf87770baf7e5b-dd9f9cdc3c9e4309","baggage":"sentry-trace_id=1617c4bc6619401997bf87770baf7e5b,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M079RG7N29MYMESVRXTZ1EVW","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-08-17T07:25:16.672Z","job_size_bytes":65,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-636d474e2ac061747992752d: done: 0.035522 sec","job_status":"done","queue_duration_s":0.402414,"scheduling_latency_s":0.402437,"redis_calls":7,"redis_duration_s":0.0026839999999999998,"redis_read_bytes":5,"redis_write_bytes":731,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00208,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":503,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000604,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":228,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022117,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.035522,"completed_at":"2026-08-17T07:25:17.109Z","load_balancing_strategy":"primary","db_duration_s":0.007929,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2300gitlab # [ 426.615863] gitaly[913]: time="2026-08-17T07:25:16.662Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=92 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5421 command.oublock=8 command.real_time_ms=115 command.spawn_token_fork_ms=6 command.system_time_ms=48 command.user_time_ms=44 component=gitaly.UnaryServerInterceptor correlation_id=01M079RG7N29MYMESVRXTZ1EVW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-17T07:25:26.199" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-17T07:25:16.540" grpc.time_ms=122.262 pid=913 ref=refs/keep-around/2b5870faf44f4f50eae55d42e55a8040db7166ea remote_ip="2001:db8:1::1" revision=2b5870faf44f4f50eae55d42e55a8040db7166ea span.kind=server system=grpc username=root2301gitlab # [ 426.630814] nix-daemon[3720]: accepted connection from pid 4401, user nixbot2302gitlab # [ 426.631727] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-17T07:25:17.111Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"e0d49f0efab461d5b0a26326","created_at":"2026-08-17T07:25:16.672Z","trace_propagation_headers":{"sentry-trace":"1617c4bc6619401997bf87770baf7e5b-dd9f9cdc3c9e4309","baggage":"sentry-trace_id=1617c4bc6619401997bf87770baf7e5b,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M079RG7N29MYMESVRXTZ1EVW","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-08-17T07:25:16.676Z","job_size_bytes":65,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-e0d49f0efab461d5b0a26326: start","job_status":"start","queue_duration_s":0.43537,"scheduling_latency_s":0.435388}2303gitlab # [ 426.649032] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-17T07:25:17.187Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"e0d49f0efab461d5b0a26326","created_at":"2026-08-17T07:25:16.672Z","trace_propagation_headers":{"sentry-trace":"1617c4bc6619401997bf87770baf7e5b-dd9f9cdc3c9e4309","baggage":"sentry-trace_id=1617c4bc6619401997bf87770baf7e5b,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M079RG7N29MYMESVRXTZ1EVW","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-08-17T07:25:16.676Z","job_size_bytes":65,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-e0d49f0efab461d5b0a26326: done: 0.076344 sec","job_status":"done","queue_duration_s":0.43537,"scheduling_latency_s":0.435388,"redis_calls":10,"redis_duration_s":0.0041069999999999995,"redis_read_bytes":14,"redis_write_bytes":857,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001741,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":494,"redis_shared_state_calls":5,"redis_shared_state_duration_s":0.002366,"redis_shared_state_read_bytes":10,"redis_shared_state_write_bytes":363,"db_count":11,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":11,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.03,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.02,"db_ci_duration_s":0.01,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.039425,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.076344,"completed_at":"2026-08-17T07:25:17.187Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.031038,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2304gitlab # [ 426.692870] gitaly[913]: time="2026-08-17T07:25:16.666Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M079RG7N29MYMESVRXTZ1EVW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-17T07:25:46.465" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-17T07:25:16.666" grpc.time_ms=0.313 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2305gitlab # [ 426.706941] gitaly[913]: time="2026-08-17T07:25:16.771Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M079REYPKV2XEAYQFXMNCPGS grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3897 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-17T07:25:16.769" grpc.time_ms=2.398 pid=913 span.kind=server system=grpc2306gitlab # [ 426.716629] nix-daemon[3720]: accepted connection from pid 4390, user nixbot2307gitlab # [ 426.717554] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-17T07:25:17.191Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"c917eb28d518de5d959de288","created_at":"2026-08-17T07:25:16.726Z","trace_propagation_headers":{"sentry-trace":"c85d3e5382094c2eb35f851befdbc22f-4b30415cae69460e","baggage":"sentry-trace_id=c85d3e5382094c2eb35f851befdbc22f,sentry-release=Unknown"},"correlation_id":"01M079REYPKV2XEAYQFXMNCPGS","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-08-17T07:25:16.729Z","job_size_bytes":23,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-c917eb28d518de5d959de288: start","job_status":"start","queue_duration_s":0.462158,"scheduling_latency_s":0.462178}2308gitlab # [ 426.733662] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-17T07:25:17.240Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"c917eb28d518de5d959de288","created_at":"2026-08-17T07:25:16.726Z","trace_propagation_headers":{"sentry-trace":"c85d3e5382094c2eb35f851befdbc22f-4b30415cae69460e","baggage":"sentry-trace_id=c85d3e5382094c2eb35f851befdbc22f,sentry-release=Unknown"},"correlation_id":"01M079REYPKV2XEAYQFXMNCPGS","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-08-17T07:25:16.729Z","job_size_bytes":23,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-c917eb28d518de5d959de288: done: 0.048951 sec","job_status":"done","queue_duration_s":0.462158,"scheduling_latency_s":0.462178,"redis_calls":7,"redis_duration_s":0.0034270000000000004,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.0022,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001227,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.03254,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.048951,"completed_at":"2026-08-17T07:25:17.240Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.011147,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2309gitlab # [ 426.775903] gitaly[913]: time="2026-08-17T07:25:16.795Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M079REYPKV2XEAYQFXMNCPGS grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3895 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-17T07:25:16.795" grpc.time_ms=0.535 pid=913 span.kind=server system=grpc2310gitlab # [ 426.785669] gitaly[913]: time="2026-08-17T07:25:16.821Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M079REYPKV2XEAYQFXMNCPGS grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3897 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-17T07:25:16.819" grpc.time_ms=1.495 pid=913 span.kind=server system=grpc2311gitlab # [ 426.795306] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-17T07:25:17.242Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"6d0fdd976c3d08ddbe4d8cc0","created_at":"2026-08-17T07:25:16.727Z","trace_propagation_headers":{"sentry-trace":"1617c4bc6619401997bf87770baf7e5b-dd9f9cdc3c9e4309","baggage":"sentry-trace_id=1617c4bc6619401997bf87770baf7e5b,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M079RG7N29MYMESVRXTZ1EVW","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-17T07:25:16.731Z","job_size_bytes":3,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-6d0fdd976c3d08ddbe4d8cc0: start","job_status":"start","queue_duration_s":0.511032,"scheduling_latency_s":0.511052}2312gitlab # [ 426.811236] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-17T07:25:17.379Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"6d0fdd976c3d08ddbe4d8cc0","created_at":"2026-08-17T07:25:16.727Z","trace_propagation_headers":{"sentry-trace":"1617c4bc6619401997bf87770baf7e5b-dd9f9cdc3c9e4309","baggage":"sentry-trace_id=1617c4bc6619401997bf87770baf7e5b,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M079RG7N29MYMESVRXTZ1EVW","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-17T07:25:16.731Z","job_size_bytes":3,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-6d0fdd976c3d08ddbe4d8cc0: done: 0.137307 sec","job_status":"done","queue_duration_s":0.511032,"scheduling_latency_s":0.511052,"gitaly_calls":2,"gitaly_duration_s":0.007944,"redis_calls":34,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.007014,"redis_read_bytes":80,"redis_write_bytes":5122,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.000944,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":10,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.001109,"redis_cache_read_bytes":19,"redis_cache_write_bytes":892,"redis_queues_calls":2,"redis_queues_duration_s":0.00031,"redis_queues_read_bytes":3,"redis_queues_write_bytes":1133,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001667,"redis_queues_metadata_read_bytes":7,"redis_queues_metadata_write_bytes":772,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000238,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":2,"redis_repository_cache_duration_s":0.000575,"redis_repository_cache_read_bytes":39,"redis_repository_cache_write_bytes":83,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001227,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":551,"db_count":27,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":27,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.028,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":13,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.003,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.005,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.019,"db_ci_duration_s":0.009,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.099821,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.10516482,"duration_s":0.137307,"completed_at":"2026-08-17T07:25:17.379Z","load_balancing_strategy":"primary","db_duration_s":0.029904,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2313gitlab # [ 426.862037] gitaly[913]: time="2026-08-17T07:25:16.827Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M079REYPKV2XEAYQFXMNCPGS diskcache=348ed6ee-dd24-47b0-b480-96de03fe94c4 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-17T07:25:46.636" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-17T07:25:16.737" pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2314gitlab # [ 426.871479] gitaly[913]: time="2026-08-17T07:25:16.828Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=90 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7183 command.oublock=0 command.real_time_ms=85 command.spawn_token_fork_ms=0 command.system_time_ms=32 command.user_time_ms=58 component=gitaly.UnaryServerInterceptor correlation_id=01M079REYPKV2XEAYQFXMNCPGS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-17T07:25:46.636" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-17T07:25:16.737" grpc.time_ms=90.874 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2315gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/2b5870faf44f4f50eae55d42e55a8040db7166ea/statuses2316gitlab # [ 426.885063] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-17T07:25:17.381Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"bd2da1fe3cb724713f89fe36","created_at":"2026-08-17T07:25:16.833Z","trace_propagation_headers":{"sentry-trace":"c85d3e5382094c2eb35f851befdbc22f-4b30415cae69460e","baggage":"sentry-trace_id=c85d3e5382094c2eb35f851befdbc22f,sentry-release=Unknown"},"correlation_id":"01M079REYPKV2XEAYQFXMNCPGS","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-08-17T07:25:16.835Z","job_size_bytes":3,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-bd2da1fe3cb724713f89fe36: start","job_status":"start","queue_duration_s":0.545657,"scheduling_latency_s":0.545678}2317gitlab # [ 426.900432] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-17T07:25:17.415Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"bd2da1fe3cb724713f89fe36","created_at":"2026-08-17T07:25:16.833Z","trace_propagation_headers":{"sentry-trace":"c85d3e5382094c2eb35f851befdbc22f-4b30415cae69460e","baggage":"sentry-trace_id=c85d3e5382094c2eb35f851befdbc22f,sentry-release=Unknown"},"correlation_id":"01M079REYPKV2XEAYQFXMNCPGS","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-08-17T07:25:16.835Z","job_size_bytes":3,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-bd2da1fe3cb724713f89fe36: done: 0.034324 sec","job_status":"done","queue_duration_s":0.545657,"scheduling_latency_s":0.545678,"redis_calls":7,"redis_duration_s":0.005353,"redis_read_bytes":5,"redis_write_bytes":746,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.004891,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000462,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":234,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02162,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.034324,"completed_at":"2026-08-17T07:25:17.415Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004488,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2318gitlab # [ 426.942636] gitaly[913]: time="2026-08-17T07:25:16.885Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M079REYPKV2XEAYQFXMNCPGS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-17T07:25:46.783" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-17T07:25:16.883" grpc.time_ms=1.157 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2319gitlab # [ 426.955217] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-17T07:25:17.423Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"9dfd6bf414a9d7276493f015","created_at":"2026-08-17T07:25:16.842Z","trace_propagation_headers":{"sentry-trace":"c85d3e5382094c2eb35f851befdbc22f-4b30415cae69460e","baggage":"sentry-trace_id=c85d3e5382094c2eb35f851befdbc22f,sentry-release=Unknown"},"correlation_id":"01M079REYPKV2XEAYQFXMNCPGS","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-08-17T07:25:16.845Z","job_size_bytes":3,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-9dfd6bf414a9d7276493f015: start","job_status":"start","queue_duration_s":0.577695,"scheduling_latency_s":0.577716}2320gitlab # [ 426.971286] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-17T07:25:17.454Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"9dfd6bf414a9d7276493f015","created_at":"2026-08-17T07:25:16.842Z","trace_propagation_headers":{"sentry-trace":"c85d3e5382094c2eb35f851befdbc22f-4b30415cae69460e","baggage":"sentry-trace_id=c85d3e5382094c2eb35f851befdbc22f,sentry-release=Unknown"},"correlation_id":"01M079REYPKV2XEAYQFXMNCPGS","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-08-17T07:25:16.845Z","job_size_bytes":3,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-9dfd6bf414a9d7276493f015: done: 0.031303 sec","job_status":"done","queue_duration_s":0.577695,"scheduling_latency_s":0.577716,"redis_calls":7,"redis_duration_s":0.00102,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000714,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000306,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022681,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.031303,"completed_at":"2026-08-17T07:25:17.454Z","load_balancing_strategy":"primary","db_duration_s":0.004857,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2321gitlab # [ 427.013391] gitaly[913]: time="2026-08-17T07:25:16.923Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M079REYPKV2XEAYQFXMNCPGS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-17T07:25:46.821" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-17T07:25:16.922" grpc.time_ms=0.849 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2322gitlab # [ 427.025900] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-17T07:25:17.455Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"f69051c1dd6cbe9a257474e7","created_at":"2026-08-17T07:25:16.855Z","trace_propagation_headers":{"sentry-trace":"c85d3e5382094c2eb35f851befdbc22f-4b30415cae69460e","baggage":"sentry-trace_id=c85d3e5382094c2eb35f851befdbc22f,sentry-release=Unknown"},"correlation_id":"01M079REYPKV2XEAYQFXMNCPGS","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-08-17T07:25:16.857Z","job_size_bytes":3,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-f69051c1dd6cbe9a257474e7: start","job_status":"start","queue_duration_s":0.598767,"scheduling_latency_s":0.598786}2323gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/2b5870faf44f4f50eae55d42e55a8040db7166ea/statuses, in 0.17 seconds)2324gitlab # [ 427.041913] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-17T07:25:17.489Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"f69051c1dd6cbe9a257474e7","created_at":"2026-08-17T07:25:16.855Z","trace_propagation_headers":{"sentry-trace":"c85d3e5382094c2eb35f851befdbc22f-4b30415cae69460e","baggage":"sentry-trace_id=c85d3e5382094c2eb35f851befdbc22f,sentry-release=Unknown"},"correlation_id":"01M079REYPKV2XEAYQFXMNCPGS","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-08-17T07:25:16.857Z","job_size_bytes":3,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-f69051c1dd6cbe9a257474e7: done: 0.033724 sec","job_status":"done","queue_duration_s":0.598767,"scheduling_latency_s":0.598786,"redis_calls":10,"redis_duration_s":0.001863,"redis_read_bytes":62,"redis_write_bytes":808,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001093,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000329,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000441,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023039,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.033724,"completed_at":"2026-08-17T07:25:17.489Z","load_balancing_strategy":"primary","db_duration_s":0.006609,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2325gitlab # [ 427.084896] gitaly[913]: time="2026-08-17T07:25:17.321Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M079RG7N29MYMESVRXTZ1EVW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-17T07:25:47.220" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-17T07:25:17.320" grpc.time_ms=0.993 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2326gitlab # [ 427.097583] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/08/17:07:25:17 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/2b5870faf44f4f50eae55d42e55a8040db7166ea/statuses HTTP/1.1" 200 633 "" "curl/8.21.0" 1012327gitlab # [ 427.100163] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-17T07:25:17.491Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"f5cd3fa9ea2dc06e4b5b2104","created_at":"2026-08-17T07:25:16.857Z","trace_propagation_headers":{"sentry-trace":"c85d3e5382094c2eb35f851befdbc22f-4b30415cae69460e","baggage":"sentry-trace_id=c85d3e5382094c2eb35f851befdbc22f,sentry-release=Unknown"},"correlation_id":"01M079REYPKV2XEAYQFXMNCPGS","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-08-17T07:25:16.859Z","job_size_bytes":3,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-f5cd3fa9ea2dc06e4b5b2104: start","job_status":"start","queue_duration_s":0.631937,"scheduling_latency_s":0.631957}2328gitlab # [ 427.117853] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-17T07:25:17.521Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"f5cd3fa9ea2dc06e4b5b2104","created_at":"2026-08-17T07:25:16.857Z","trace_propagation_headers":{"sentry-trace":"c85d3e5382094c2eb35f851befdbc22f-4b30415cae69460e","baggage":"sentry-trace_id=c85d3e5382094c2eb35f851befdbc22f,sentry-release=Unknown"},"correlation_id":"01M079REYPKV2XEAYQFXMNCPGS","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-08-17T07:25:16.859Z","job_size_bytes":3,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-f5cd3fa9ea2dc06e4b5b2104: done: 0.030415 sec","job_status":"done","queue_duration_s":0.631937,"scheduling_latency_s":0.631957,"redis_calls":7,"redis_duration_s":0.002036,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001512,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000524,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019099,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.030415,"completed_at":"2026-08-17T07:25:17.521Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006895,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2329gitlab # [ 427.161012] gitaly[913]: time="2026-08-17T07:25:17.367Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M079RG7N29MYMESVRXTZ1EVW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-17T07:25:47.266" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-17T07:25:17.366" grpc.time_ms=0.774 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2330gitlab # [ 427.173814] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-17T07:25:17.523Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"cf398caa9b5aace0e82b95c6","created_at":"2026-08-17T07:25:16.860Z","trace_propagation_headers":{"sentry-trace":"c85d3e5382094c2eb35f851befdbc22f-4b30415cae69460e","baggage":"sentry-trace_id=c85d3e5382094c2eb35f851befdbc22f,sentry-release=Unknown"},"correlation_id":"01M079REYPKV2XEAYQFXMNCPGS","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-08-17T07:25:16.862Z","job_size_bytes":19,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-cf398caa9b5aace0e82b95c6: start","job_status":"start","queue_duration_s":0.661606,"scheduling_latency_s":0.661626}2331gitlab # [ 427.190616] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-17T07:25:17.551Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"cf398caa9b5aace0e82b95c6","created_at":"2026-08-17T07:25:16.860Z","trace_propagation_headers":{"sentry-trace":"c85d3e5382094c2eb35f851befdbc22f-4b30415cae69460e","baggage":"sentry-trace_id=c85d3e5382094c2eb35f851befdbc22f,sentry-release=Unknown"},"correlation_id":"01M079REYPKV2XEAYQFXMNCPGS","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-08-17T07:25:16.862Z","job_size_bytes":19,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-cf398caa9b5aace0e82b95c6: done: 0.02752 sec","job_status":"done","queue_duration_s":0.661606,"scheduling_latency_s":0.661626,"redis_calls":8,"redis_duration_s":0.00206,"redis_read_bytes":6,"redis_write_bytes":764,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001603,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":570,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000457,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":194,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016488,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.02752,"completed_at":"2026-08-17T07:25:17.551Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006025,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2332gitlab # [ 427.234513] gitaly[913]: time="2026-08-17T07:25:17.782Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M079RHGTPNWMT6VFE0RNGJ6H grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-17T07:25:47.580" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-17T07:25:17.781" grpc.time_ms=1.06 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2333gitlab # [ 427.247762] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-17T07:25:17.553Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"468c8ca695d9560d898f4ac1","created_at":"2026-08-17T07:25:16.863Z","trace_propagation_headers":{"sentry-trace":"c85d3e5382094c2eb35f851befdbc22f-4b30415cae69460e","baggage":"sentry-trace_id=c85d3e5382094c2eb35f851befdbc22f,sentry-release=Unknown"},"correlation_id":"01M079REYPKV2XEAYQFXMNCPGS","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-08-17T07:25:16.865Z","job_size_bytes":66,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-468c8ca695d9560d898f4ac1: start","job_status":"start","queue_duration_s":0.687858,"scheduling_latency_s":0.687876}2334gitlab # [ 427.265499] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-17T07:25:17.578Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"468c8ca695d9560d898f4ac1","created_at":"2026-08-17T07:25:16.863Z","trace_propagation_headers":{"sentry-trace":"c85d3e5382094c2eb35f851befdbc22f-4b30415cae69460e","baggage":"sentry-trace_id=c85d3e5382094c2eb35f851befdbc22f,sentry-release=Unknown"},"correlation_id":"01M079REYPKV2XEAYQFXMNCPGS","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-08-17T07:25:16.865Z","job_size_bytes":66,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-468c8ca695d9560d898f4ac1: done: 0.025609 sec","job_status":"done","queue_duration_s":0.687858,"scheduling_latency_s":0.687876,"redis_calls":7,"redis_duration_s":0.0018479999999999998,"redis_read_bytes":5,"redis_write_bytes":761,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001349,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000499,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":240,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016477,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.025609,"completed_at":"2026-08-17T07:25:17.578Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004681,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2335gitlab # [ 427.310068] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-17T07:25:17.580Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"5c2fab12743d5196e7bd0616","created_at":"2026-08-17T07:25:16.865Z","trace_propagation_headers":{"sentry-trace":"c85d3e5382094c2eb35f851befdbc22f-4b30415cae69460e","baggage":"sentry-trace_id=c85d3e5382094c2eb35f851befdbc22f,sentry-release=Unknown"},"correlation_id":"01M079REYPKV2XEAYQFXMNCPGS","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-08-17T07:25:16.867Z","job_size_bytes":3,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-5c2fab12743d5196e7bd0616: start","job_status":"start","queue_duration_s":0.712775,"scheduling_latency_s":0.712791}2336gitlab # [ 427.327987] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-17T07:25:17.609Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"5c2fab12743d5196e7bd0616","created_at":"2026-08-17T07:25:16.865Z","trace_propagation_headers":{"sentry-trace":"c85d3e5382094c2eb35f851befdbc22f-4b30415cae69460e","baggage":"sentry-trace_id=c85d3e5382094c2eb35f851befdbc22f,sentry-release=Unknown"},"correlation_id":"01M079REYPKV2XEAYQFXMNCPGS","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-08-17T07:25:16.867Z","job_size_bytes":3,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-5c2fab12743d5196e7bd0616: done: 0.029435 sec","job_status":"done","queue_duration_s":0.712775,"scheduling_latency_s":0.712791,"redis_calls":7,"redis_duration_s":0.001839,"redis_read_bytes":5,"redis_write_bytes":656,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001284,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":458,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000555,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":198,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017644,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.029435,"completed_at":"2026-08-17T07:25:17.609Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007472,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2337gitlab # [ 427.371801] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-17T07:25:17.611Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"78222c72e0f37b64e0497181","created_at":"2026-08-17T07:25:16.867Z","trace_propagation_headers":{"sentry-trace":"c85d3e5382094c2eb35f851befdbc22f-4b30415cae69460e","baggage":"sentry-trace_id=c85d3e5382094c2eb35f851befdbc22f,sentry-release=Unknown"},"correlation_id":"01M079REYPKV2XEAYQFXMNCPGS","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-17T07:25:16.869Z","job_size_bytes":6,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-78222c72e0f37b64e0497181: start","job_status":"start","queue_duration_s":0.741587,"scheduling_latency_s":0.741606}2338gitlab # [ 427.388804] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-17T07:25:17.627Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"78222c72e0f37b64e0497181","created_at":"2026-08-17T07:25:16.867Z","trace_propagation_headers":{"sentry-trace":"c85d3e5382094c2eb35f851befdbc22f-4b30415cae69460e","baggage":"sentry-trace_id=c85d3e5382094c2eb35f851befdbc22f,sentry-release=Unknown"},"correlation_id":"01M079REYPKV2XEAYQFXMNCPGS","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-17T07:25:16.869Z","job_size_bytes":6,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-78222c72e0f37b64e0497181: done: 0.015875 sec","job_status":"done","queue_duration_s":0.741587,"scheduling_latency_s":0.741606,"redis_calls":7,"redis_duration_s":0.002234,"redis_read_bytes":5,"redis_write_bytes":721,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00177,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":497,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000464,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":224,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009742,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015875,"completed_at":"2026-08-17T07:25:17.626Z","load_balancing_strategy":"primary","db_duration_s":0.000679,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2339gitlab # [ 427.430407] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-17T07:25:17.628Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"943f1b386ff65fc3882cdcbe","created_at":"2026-08-17T07:25:16.870Z","trace_propagation_headers":{"sentry-trace":"c85d3e5382094c2eb35f851befdbc22f-4b30415cae69460e","baggage":"sentry-trace_id=c85d3e5382094c2eb35f851befdbc22f,sentry-release=Unknown"},"correlation_id":"01M079REYPKV2XEAYQFXMNCPGS","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-08-17T07:25:16.871Z","job_size_bytes":3,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-943f1b386ff65fc3882cdcbe: start","job_status":"start","queue_duration_s":0.756404,"scheduling_latency_s":0.75642}2340gitlab # [ 427.445652] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-17T07:25:17.655Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"943f1b386ff65fc3882cdcbe","created_at":"2026-08-17T07:25:16.870Z","trace_propagation_headers":{"sentry-trace":"c85d3e5382094c2eb35f851befdbc22f-4b30415cae69460e","baggage":"sentry-trace_id=c85d3e5382094c2eb35f851befdbc22f,sentry-release=Unknown"},"correlation_id":"01M079REYPKV2XEAYQFXMNCPGS","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-08-17T07:25:16.871Z","job_size_bytes":3,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-943f1b386ff65fc3882cdcbe: done: 0.027168 sec","job_status":"done","queue_duration_s":0.756404,"scheduling_latency_s":0.75642,"redis_calls":7,"redis_duration_s":0.001906,"redis_read_bytes":5,"redis_write_bytes":636,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001385,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":446,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000521,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017177,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.027168,"completed_at":"2026-08-17T07:25:17.655Z","load_balancing_strategy":"primary","db_duration_s":0.005481,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2341gitlab # [ 427.486643] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-17T07:25:17.657Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"e4842d295f49948d98a1518b","created_at":"2026-08-17T07:25:16.934Z","trace_propagation_headers":{"sentry-trace":"c85d3e5382094c2eb35f851befdbc22f-4b30415cae69460e","baggage":"sentry-trace_id=c85d3e5382094c2eb35f851befdbc22f,sentry-release=Unknown"},"correlation_id":"01M079REYPKV2XEAYQFXMNCPGS","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-17T07:25:16.935Z","job_size_bytes":3,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-e4842d295f49948d98a1518b: start","job_status":"start","queue_duration_s":0.721705,"scheduling_latency_s":0.721724}2342gitlab # [ 427.502364] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-17T07:25:17.687Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"e4842d295f49948d98a1518b","created_at":"2026-08-17T07:25:16.934Z","trace_propagation_headers":{"sentry-trace":"c85d3e5382094c2eb35f851befdbc22f-4b30415cae69460e","baggage":"sentry-trace_id=c85d3e5382094c2eb35f851befdbc22f,sentry-release=Unknown"},"correlation_id":"01M079REYPKV2XEAYQFXMNCPGS","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-17T07:25:16.935Z","job_size_bytes":3,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-e4842d295f49948d98a1518b: done: 0.03024 sec","job_status":"done","queue_duration_s":0.721705,"scheduling_latency_s":0.721724,"redis_calls":8,"redis_duration_s":0.00214,"redis_read_bytes":6,"redis_write_bytes":754,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001665,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":564,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000475,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019169,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.03024,"completed_at":"2026-08-17T07:25:17.687Z","load_balancing_strategy":"primary","db_duration_s":0.006621,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2343gitlab # [ 427.545461] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-17T07:25:17.689Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"2fbad30ad718013130bbd9aa","created_at":"2026-08-17T07:25:17.302Z","trace_propagation_headers":{"sentry-trace":"1617c4bc6619401997bf87770baf7e5b-66db6c4926ea412f","baggage":"sentry-trace_id=1617c4bc6619401997bf87770baf7e5b,sentry-release=Unknown"},"correlation_id":"01M079RG7N29MYMESVRXTZ1EVW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-08-17T07:25:17.304Z","job_size_bytes":3,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-2fbad30ad718013130bbd9aa: start","job_status":"start","queue_duration_s":0.384942,"scheduling_latency_s":0.38496}2344gitlab # [ 427.593424] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-17T07:25:17.767Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"2fbad30ad718013130bbd9aa","created_at":"2026-08-17T07:25:17.302Z","trace_propagation_headers":{"sentry-trace":"1617c4bc6619401997bf87770baf7e5b-66db6c4926ea412f","baggage":"sentry-trace_id=1617c4bc6619401997bf87770baf7e5b,sentry-release=Unknown"},"correlation_id":"01M079RG7N29MYMESVRXTZ1EVW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-08-17T07:25:17.304Z","job_size_bytes":3,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-2fbad30ad718013130bbd9aa: done: 0.077645 sec","job_status":"done","queue_duration_s":0.384942,"scheduling_latency_s":0.38496,"redis_calls":7,"redis_duration_s":0.002499,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001702,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000797,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.014,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.008,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.057191,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.077645,"completed_at":"2026-08-17T07:25:17.766Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.013369,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2345gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/2b5870faf44f4f50eae55d42e55a8040db7166ea/statuses2346gitlab # [ 428.108114] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-17T07:25:18.880Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::StaleRequestsCleanupCronWorker","jid":"fd766a21b16fa99ca5139d61","created_at":"2026-08-17T07:25:18.850Z","trace_propagation_headers":{"sentry-trace":"277c5a176ea149cc8b11c21a370250d3-44606c51a49a4aa0","baggage":"sentry-trace_id=277c5a176ea149cc8b11c21a370250d3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7453b4fb2a66d6cee71e9dc9dfd7040a","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:73d233265a8deedc9c2e88dc2f4303db4adf3b844f30d267f04d632004c6c278","size_limiter":"validated","enqueued_at":"2026-08-17T07:25:18.874Z","job_size_bytes":2,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::StaleRequestsCleanupCronWorker JID-fd766a21b16fa99ca5139d61: start","job_status":"start","queue_duration_s":0.006273,"scheduling_latency_s":0.006336}2347gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/2b5870faf44f4f50eae55d42e55a8040db7166ea/statuses, in 0.22 seconds)2348gitlab # [ 428.220186] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-17T07:25:18.993Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::StaleRequestsCleanupCronWorker","jid":"fd766a21b16fa99ca5139d61","created_at":"2026-08-17T07:25:18.850Z","trace_propagation_headers":{"sentry-trace":"277c5a176ea149cc8b11c21a370250d3-44606c51a49a4aa0","baggage":"sentry-trace_id=277c5a176ea149cc8b11c21a370250d3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7453b4fb2a66d6cee71e9dc9dfd7040a","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:73d233265a8deedc9c2e88dc2f4303db4adf3b844f30d267f04d632004c6c278","size_limiter":"validated","enqueued_at":"2026-08-17T07:25:18.874Z","job_size_bytes":2,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::StaleRequestsCleanupCronWorker JID-fd766a21b16fa99ca5139d61: done: 0.112883 sec","job_status":"done","queue_duration_s":0.006273,"scheduling_latency_s":0.006336,"redis_calls":11,"redis_duration_s":0.024364,"redis_read_bytes":9,"redis_write_bytes":1174,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00222,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":317,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.019352,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000527,"redis_rate_limiting_write_bytes":51,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002265,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":224,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.038287,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000708,"extra.cells_stale_requests_cleanup_cron_worker.removed_count":0,"duration_s":0.112883,"completed_at":"2026-08-17T07:25:18.993Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00625,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2349gitlab # [ 428.314453] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-17T07:25:18.998Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"50ea8f7860c2042d6cb06332","created_at":"2026-08-17T07:25:18.890Z","trace_propagation_headers":{"sentry-trace":"277c5a176ea149cc8b11c21a370250d3-44606c51a49a4aa0","baggage":"sentry-trace_id=277c5a176ea149cc8b11c21a370250d3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"98e9e7c308dc0c08e79e82a6a8f3b71e","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-17T07:25:18.908Z","job_size_bytes":2,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-50ea8f7860c2042d6cb06332: start","job_status":"start","queue_duration_s":0.089885,"scheduling_latency_s":0.089943}2350gitlab # [ 428.335757] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/08/17:07:25:19 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/2b5870faf44f4f50eae55d42e55a8040db7166ea/statuses HTTP/1.1" 200 633 "" "curl/8.21.0" 1392351gitlab # [ 428.340950] gitaly[913]: time="2026-08-17T07:25:18.994Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M079RJNX3QF6A203HK09N3WT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-17T07:25:48.592" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-17T07:25:18.993" grpc.time_ms=1.248 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2352gitlab # [ 428.357542] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-17T07:25:19.100Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"50ea8f7860c2042d6cb06332","created_at":"2026-08-17T07:25:18.890Z","trace_propagation_headers":{"sentry-trace":"277c5a176ea149cc8b11c21a370250d3-44606c51a49a4aa0","baggage":"sentry-trace_id=277c5a176ea149cc8b11c21a370250d3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"98e9e7c308dc0c08e79e82a6a8f3b71e","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-17T07:25:18.908Z","job_size_bytes":2,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-50ea8f7860c2042d6cb06332: done: 0.10204 sec","job_status":"done","queue_duration_s":0.089885,"scheduling_latency_s":0.089943,"redis_calls":9,"redis_duration_s":0.008432,"redis_read_bytes":7,"redis_write_bytes":984,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000691,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.005961,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":473,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00178,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":208,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.042377,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.10204,"completed_at":"2026-08-17T07:25:19.100Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.017115,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2353gitlab # [ 428.405518] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-17T07:25:19.110Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"1c4bf3d7c43d00962ae718bd","created_at":"2026-08-17T07:25:18.942Z","trace_propagation_headers":{"sentry-trace":"277c5a176ea149cc8b11c21a370250d3-44606c51a49a4aa0","baggage":"sentry-trace_id=277c5a176ea149cc8b11c21a370250d3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9e1967b2099507f64901a05fcc016541","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-17T07:25:19.040Z","job_size_bytes":2,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-1c4bf3d7c43d00962ae718bd: start","job_status":"start","queue_duration_s":0.070355,"scheduling_latency_s":0.0704}2354gitlab # [ 428.449625] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-17T07:25:19.223Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"1c4bf3d7c43d00962ae718bd","created_at":"2026-08-17T07:25:18.942Z","trace_propagation_headers":{"sentry-trace":"277c5a176ea149cc8b11c21a370250d3-44606c51a49a4aa0","baggage":"sentry-trace_id=277c5a176ea149cc8b11c21a370250d3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9e1967b2099507f64901a05fcc016541","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-17T07:25:19.040Z","job_size_bytes":2,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-1c4bf3d7c43d00962ae718bd: done: 0.112808 sec","job_status":"done","queue_duration_s":0.070355,"scheduling_latency_s":0.0704,"redis_calls":11,"redis_duration_s":0.019065,"redis_read_bytes":9,"redis_write_bytes":1459,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.008072,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":628,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.005006,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":563,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.005987,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":268,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.017,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.017,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.036693,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.112808,"completed_at":"2026-08-17T07:25:19.223Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.016496,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2355gitlab # [ 428.535776] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-17T07:25:19.233Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ContainerRegistry::CleanupWorker","jid":"90199df752ffa9983ed0f99b","created_at":"2026-08-17T07:25:19.054Z","trace_propagation_headers":{"sentry-trace":"277c5a176ea149cc8b11c21a370250d3-44606c51a49a4aa0","baggage":"sentry-trace_id=277c5a176ea149cc8b11c21a370250d3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0ebce87e7678a3565a5685f1066d6e59","meta.root_caller_id":"Cronjob","meta.feature_category":"container_registry","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:1c3f6896f5901f854330d52bd75eff7c46411059671aef387767811adc368565","size_limiter":"validated","enqueued_at":"2026-08-17T07:25:19.078Z","job_size_bytes":2,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"ContainerRegistry::CleanupWorker JID-90199df752ffa9983ed0f99b: start","job_status":"start","queue_duration_s":0.154429,"scheduling_latency_s":0.154456}2356gitlab # [ 428.626269] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-17T07:25:19.399Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ContainerRegistry::CleanupWorker","jid":"90199df752ffa9983ed0f99b","created_at":"2026-08-17T07:25:19.054Z","trace_propagation_headers":{"sentry-trace":"277c5a176ea149cc8b11c21a370250d3-44606c51a49a4aa0","baggage":"sentry-trace_id=277c5a176ea149cc8b11c21a370250d3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0ebce87e7678a3565a5685f1066d6e59","meta.root_caller_id":"Cronjob","meta.feature_category":"container_registry","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:1c3f6896f5901f854330d52bd75eff7c46411059671aef387767811adc368565","size_limiter":"validated","enqueued_at":"2026-08-17T07:25:19.078Z","job_size_bytes":2,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"ContainerRegistry::CleanupWorker JID-90199df752ffa9983ed0f99b: done: 0.16618 sec","job_status":"done","queue_duration_s":0.154429,"scheduling_latency_s":0.154456,"redis_calls":12,"redis_duration_s":0.066755,"redis_read_bytes":171,"redis_write_bytes":1164,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.05072,"redis_feature_flag_read_bytes":164,"redis_feature_flag_write_bytes":400,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.011849,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.004186,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":210,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.012,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.044831,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00459656,"duration_s":0.16618,"completed_at":"2026-08-17T07:25:19.399Z","load_balancing_strategy":"primary","db_duration_s":0.01815,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2357gitlab # [ 428.715755] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-17T07:25:19.412Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"2416e5465c45a325f9123aff","created_at":"2026-08-17T07:25:19.097Z","trace_propagation_headers":{"sentry-trace":"277c5a176ea149cc8b11c21a370250d3-44606c51a49a4aa0","baggage":"sentry-trace_id=277c5a176ea149cc8b11c21a370250d3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"23c686ff04279d4b5270a582dea260ea","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-17T07:25:19.116Z","job_size_bytes":2,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-2416e5465c45a325f9123aff: start","job_status":"start","queue_duration_s":0.295244,"scheduling_latency_s":0.295289}2358gitlab # [ 428.765464] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-17T07:25:19.538Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"2416e5465c45a325f9123aff","created_at":"2026-08-17T07:25:19.097Z","trace_propagation_headers":{"sentry-trace":"277c5a176ea149cc8b11c21a370250d3-44606c51a49a4aa0","baggage":"sentry-trace_id=277c5a176ea149cc8b11c21a370250d3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"23c686ff04279d4b5270a582dea260ea","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-17T07:25:19.116Z","job_size_bytes":2,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-2416e5465c45a325f9123aff: done: 0.126707 sec","job_status":"done","queue_duration_s":0.295244,"scheduling_latency_s":0.295289,"redis_calls":9,"redis_duration_s":0.021322,"redis_read_bytes":7,"redis_write_bytes":1119,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.004236,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":343,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.013302,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.003784,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":246,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.033487,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.126707,"completed_at":"2026-08-17T07:25:19.538Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00347,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2359gitlab # [ 428.848383] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-17T07:25:19.552Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"3f53d39385d8d56b5a908a5b","created_at":"2026-08-17T07:25:19.124Z","trace_propagation_headers":{"sentry-trace":"277c5a176ea149cc8b11c21a370250d3-44606c51a49a4aa0","baggage":"sentry-trace_id=277c5a176ea149cc8b11c21a370250d3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fc62a18c4b27985c29f27a1662d95827","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-17T07:25:19.147Z","job_size_bytes":2,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-3f53d39385d8d56b5a908a5b: start","job_status":"start","queue_duration_s":0.405444,"scheduling_latency_s":0.405489}2360gitlab # [ 428.869629] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-17T07:25:19.643Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0}2361gitlab # [ 429.102664] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-17T07:25:19.876Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"3f53d39385d8d56b5a908a5b","created_at":"2026-08-17T07:25:19.124Z","trace_propagation_headers":{"sentry-trace":"277c5a176ea149cc8b11c21a370250d3-44606c51a49a4aa0","baggage":"sentry-trace_id=277c5a176ea149cc8b11c21a370250d3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fc62a18c4b27985c29f27a1662d95827","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-17T07:25:19.147Z","job_size_bytes":2,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-3f53d39385d8d56b5a908a5b: done: 0.323285 sec","job_status":"done","queue_duration_s":0.405444,"scheduling_latency_s":0.405489,"redis_calls":9,"redis_duration_s":0.017588,"redis_read_bytes":7,"redis_write_bytes":1152,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.002187,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":351,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.010331,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":545,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00507,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":256,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.038564,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.323285,"completed_at":"2026-08-17T07:25:19.875Z","load_balancing_strategy":"primary","db_duration_s":0.001053,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2362gitlab # [ 429.211351] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-17T07:25:19.888Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"355f051fd3cb61add80af911","created_at":"2026-08-17T07:25:19.179Z","trace_propagation_headers":{"sentry-trace":"277c5a176ea149cc8b11c21a370250d3-44606c51a49a4aa0","baggage":"sentry-trace_id=277c5a176ea149cc8b11c21a370250d3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"20b8641ed301ab7ea6979513effb9a58","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-08-17T07:25:19.206Z","job_size_bytes":2,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-355f051fd3cb61add80af911: start","job_status":"start","queue_duration_s":0.6813,"scheduling_latency_s":0.68135}2363gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/2b5870faf44f4f50eae55d42e55a8040db7166ea/statuses2364gitlab # [ 429.350199] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-17T07:25:20.122Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"355f051fd3cb61add80af911","created_at":"2026-08-17T07:25:19.179Z","trace_propagation_headers":{"sentry-trace":"277c5a176ea149cc8b11c21a370250d3-44606c51a49a4aa0","baggage":"sentry-trace_id=277c5a176ea149cc8b11c21a370250d3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"20b8641ed301ab7ea6979513effb9a58","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-08-17T07:25:19.206Z","job_size_bytes":2,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-355f051fd3cb61add80af911: done: 0.234253 sec","job_status":"done","queue_duration_s":0.6813,"scheduling_latency_s":0.68135,"redis_calls":18,"redis_duration_s":0.064946,"redis_read_bytes":20,"redis_write_bytes":4702,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.012054,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":672,"redis_queues_calls":2,"redis_queues_duration_s":0.003889,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3019,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.043993,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":727,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.00501,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":284,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.032,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.032,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.076935,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.234253,"completed_at":"2026-08-17T07:25:20.122Z","load_balancing_strategy":"primary","db_duration_s":0.031431,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2365gitlab # [ 429.436112] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-17T07:25:20.133Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"66cd3d457784aef8fd900ae7","created_at":"2026-08-17T07:25:19.225Z","trace_propagation_headers":{"sentry-trace":"277c5a176ea149cc8b11c21a370250d3-44606c51a49a4aa0","baggage":"sentry-trace_id=277c5a176ea149cc8b11c21a370250d3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b3b7bfdb942c2e9ee0412bd522c38681","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-17T07:25:19.240Z","job_size_bytes":2,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-66cd3d457784aef8fd900ae7: start","job_status":"start","queue_duration_s":0.89323,"scheduling_latency_s":0.893284}2366gitlab # [ 429.452363] gitaly[913]: time="2026-08-17T07:25:20.218Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M079RKVQ4SCARTAKZJ1BACJR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-17T07:25:50.015" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-17T07:25:20.216" grpc.time_ms=1.116 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2367gitlab # [ 429.466360] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-17T07:25:20.240Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0}2368gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/2b5870faf44f4f50eae55d42e55a8040db7166ea/statuses, in 0.22 seconds)2369gitlab # [ 429.491768] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-17T07:25:20.265Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"66cd3d457784aef8fd900ae7","created_at":"2026-08-17T07:25:19.225Z","trace_propagation_headers":{"sentry-trace":"277c5a176ea149cc8b11c21a370250d3-44606c51a49a4aa0","baggage":"sentry-trace_id=277c5a176ea149cc8b11c21a370250d3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b3b7bfdb942c2e9ee0412bd522c38681","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-17T07:25:19.240Z","job_size_bytes":2,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-66cd3d457784aef8fd900ae7: done: 0.13184 sec","job_status":"done","queue_duration_s":0.89323,"scheduling_latency_s":0.893284,"redis_calls":9,"redis_duration_s":0.013847,"redis_read_bytes":7,"redis_write_bytes":1159,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000805,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":353,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.011018,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":548,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002024,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":258,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.031573,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.13184,"completed_at":"2026-08-17T07:25:20.265Z","load_balancing_strategy":"primary","db_duration_s":0.002468,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2370gitlab # [ 429.565695] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-17T07:25:20.268Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"d6305fff9d108ff07493ac41","created_at":"2026-08-17T07:25:19.295Z","trace_propagation_headers":{"sentry-trace":"277c5a176ea149cc8b11c21a370250d3-44606c51a49a4aa0","baggage":"sentry-trace_id=277c5a176ea149cc8b11c21a370250d3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a3e80d65c16c31051eecf6434fecaf4b","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-17T07:25:19.323Z","job_size_bytes":2,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-d6305fff9d108ff07493ac41: start","job_status":"start","queue_duration_s":0.944055,"scheduling_latency_s":0.944097}2371gitlab # [ 429.583586] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-17T07:25:20.328Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"d6305fff9d108ff07493ac41","created_at":"2026-08-17T07:25:19.295Z","trace_propagation_headers":{"sentry-trace":"277c5a176ea149cc8b11c21a370250d3-44606c51a49a4aa0","baggage":"sentry-trace_id=277c5a176ea149cc8b11c21a370250d3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a3e80d65c16c31051eecf6434fecaf4b","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-17T07:25:19.323Z","job_size_bytes":2,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-d6305fff9d108ff07493ac41: done: 0.060197 sec","job_status":"done","queue_duration_s":0.944055,"scheduling_latency_s":0.944097,"redis_calls":12,"redis_duration_s":0.0042450000000000005,"redis_read_bytes":10,"redis_write_bytes":1576,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000617,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002076,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":636,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001552,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":603,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.039267,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.01784038,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.060197,"completed_at":"2026-08-17T07:25:20.328Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004792,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2372gitlab # [ 429.635272] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/08/17:07:25:20 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/2b5870faf44f4f50eae55d42e55a8040db7166ea/statuses HTTP/1.1" 200 633 "" "curl/8.21.0" 1482373gitlab # [ 429.637957] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-17T07:25:20.330Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"32e10301eb6eb858c0d805e4","created_at":"2026-08-17T07:25:19.344Z","trace_propagation_headers":{"sentry-trace":"277c5a176ea149cc8b11c21a370250d3-44606c51a49a4aa0","baggage":"sentry-trace_id=277c5a176ea149cc8b11c21a370250d3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6a1bd0ec11d8cf790c5a9093d8ad692b","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-17T07:25:19.366Z","job_size_bytes":2,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-32e10301eb6eb858c0d805e4: start","job_status":"start","queue_duration_s":0.963835,"scheduling_latency_s":0.963901}2374gitlab # [ 429.659802] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-17T07:25:20.433Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"32e10301eb6eb858c0d805e4","created_at":"2026-08-17T07:25:19.344Z","trace_propagation_headers":{"sentry-trace":"277c5a176ea149cc8b11c21a370250d3-44606c51a49a4aa0","baggage":"sentry-trace_id=277c5a176ea149cc8b11c21a370250d3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6a1bd0ec11d8cf790c5a9093d8ad692b","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-17T07:25:19.366Z","job_size_bytes":2,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-32e10301eb6eb858c0d805e4: done: 0.102603 sec","job_status":"done","queue_duration_s":0.963835,"scheduling_latency_s":0.963901,"redis_calls":11,"redis_duration_s":0.004731,"redis_read_bytes":9,"redis_write_bytes":1518,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000709,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":349,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002105,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001917,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":615,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.023,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.023,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.05963,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00106648,"exclusive_lock_hold_duration_s":0.04786558,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.102603,"completed_at":"2026-08-17T07:25:20.433Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.023847,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2375gitlab # [ 429.705450] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-17T07:25:20.437Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"79ec0a90e9b1ffff2e97073e","created_at":"2026-08-17T07:25:19.396Z","trace_propagation_headers":{"sentry-trace":"277c5a176ea149cc8b11c21a370250d3-44606c51a49a4aa0","baggage":"sentry-trace_id=277c5a176ea149cc8b11c21a370250d3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1ad63d5d593a6f6d7ce1ade79659facd","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-17T07:25:19.416Z","job_size_bytes":2,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-79ec0a90e9b1ffff2e97073e: start","job_status":"start","queue_duration_s":1.020959,"scheduling_latency_s":1.021007}2376gitlab # [ 429.719893] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-17T07:25:20.491Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"79ec0a90e9b1ffff2e97073e","created_at":"2026-08-17T07:25:19.396Z","trace_propagation_headers":{"sentry-trace":"277c5a176ea149cc8b11c21a370250d3-44606c51a49a4aa0","baggage":"sentry-trace_id=277c5a176ea149cc8b11c21a370250d3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1ad63d5d593a6f6d7ce1ade79659facd","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-17T07:25:19.416Z","job_size_bytes":2,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-79ec0a90e9b1ffff2e97073e: done: 0.054082 sec","job_status":"done","queue_duration_s":1.020959,"scheduling_latency_s":1.021007,"redis_calls":11,"redis_duration_s":0.004971000000000001,"redis_read_bytes":9,"redis_write_bytes":1418,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000754,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002011,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002206,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":566,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.032548,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.001212,"exclusive_lock_hold_duration_s":0.00601594,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.054082,"completed_at":"2026-08-17T07:25:20.491Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003049,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2377gitlab # [ 429.763935] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-17T07:25:20.494Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"850f57672fe4b3351e299fe2","created_at":"2026-08-17T07:25:19.426Z","trace_propagation_headers":{"sentry-trace":"277c5a176ea149cc8b11c21a370250d3-44606c51a49a4aa0","baggage":"sentry-trace_id=277c5a176ea149cc8b11c21a370250d3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0650af47215179a823d284bc77c5faa6","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-17T07:25:19.442Z","job_size_bytes":2,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-850f57672fe4b3351e299fe2: start","job_status":"start","queue_duration_s":1.051612,"scheduling_latency_s":1.051649}2378gitlab # [ 429.779941] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-17T07:25:20.519Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0}2379gitlab # [ 429.783551] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-17T07:25:20.533Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"850f57672fe4b3351e299fe2","created_at":"2026-08-17T07:25:19.426Z","trace_propagation_headers":{"sentry-trace":"277c5a176ea149cc8b11c21a370250d3-44606c51a49a4aa0","baggage":"sentry-trace_id=277c5a176ea149cc8b11c21a370250d3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0650af47215179a823d284bc77c5faa6","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-17T07:25:19.442Z","job_size_bytes":2,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-850f57672fe4b3351e299fe2: done: 0.03925 sec","job_status":"done","queue_duration_s":1.051612,"scheduling_latency_s":1.051649,"redis_calls":9,"redis_duration_s":0.003011,"redis_read_bytes":7,"redis_write_bytes":1185,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000762,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":359,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001594,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000655,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020308,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.03925,"completed_at":"2026-08-17T07:25:20.533Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001381,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2380gitlab # [ 429.826148] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-17T07:25:20.535Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"6750cbefdd217ac992542f7d","created_at":"2026-08-17T07:25:19.473Z","trace_propagation_headers":{"sentry-trace":"277c5a176ea149cc8b11c21a370250d3-44606c51a49a4aa0","baggage":"sentry-trace_id=277c5a176ea149cc8b11c21a370250d3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5030e5059c737591bdc245b4df41de86","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-17T07:25:19.502Z","job_size_bytes":2,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-6750cbefdd217ac992542f7d: start","job_status":"start","queue_duration_s":1.033672,"scheduling_latency_s":1.033701}2381gitlab # [ 429.842873] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-17T07:25:20.616Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"6750cbefdd217ac992542f7d","created_at":"2026-08-17T07:25:19.473Z","trace_propagation_headers":{"sentry-trace":"277c5a176ea149cc8b11c21a370250d3-44606c51a49a4aa0","baggage":"sentry-trace_id=277c5a176ea149cc8b11c21a370250d3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5030e5059c737591bdc245b4df41de86","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-17T07:25:19.502Z","job_size_bytes":2,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-6750cbefdd217ac992542f7d: done: 0.080842 sec","job_status":"done","queue_duration_s":1.033672,"scheduling_latency_s":1.033701,"redis_calls":13,"redis_duration_s":0.0046040000000000005,"redis_read_bytes":11,"redis_write_bytes":1780,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001747,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":618,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001502,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":551,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001355,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":611,"db_count":8,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.024,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.022,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.041605,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00071056,"exclusive_lock_hold_duration_s":0.04292676,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.080842,"completed_at":"2026-08-17T07:25:20.616Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.026134,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2382gitlab # [ 429.888115] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-17T07:25:20.618Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"6860d575e77d899b99dcffe1","created_at":"2026-08-17T07:25:19.532Z","trace_propagation_headers":{"sentry-trace":"277c5a176ea149cc8b11c21a370250d3-44606c51a49a4aa0","baggage":"sentry-trace_id=277c5a176ea149cc8b11c21a370250d3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a8b6caa57c2b92bd88a36040d2ee87a2","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-17T07:25:19.551Z","job_size_bytes":2,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-6860d575e77d899b99dcffe1: start","job_status":"start","queue_duration_s":1.067213,"scheduling_latency_s":1.06724}2383gitlab # [ 429.901276] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-17T07:25:20.659Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"6860d575e77d899b99dcffe1","created_at":"2026-08-17T07:25:19.532Z","trace_propagation_headers":{"sentry-trace":"277c5a176ea149cc8b11c21a370250d3-44606c51a49a4aa0","baggage":"sentry-trace_id=277c5a176ea149cc8b11c21a370250d3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a8b6caa57c2b92bd88a36040d2ee87a2","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-17T07:25:19.551Z","job_size_bytes":2,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-6860d575e77d899b99dcffe1: done: 0.040761 sec","job_status":"done","queue_duration_s":1.067213,"scheduling_latency_s":1.06724,"redis_calls":11,"redis_duration_s":0.004046,"redis_read_bytes":9,"redis_write_bytes":1399,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00062,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001963,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001463,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":560,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024278,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00068924,"exclusive_lock_hold_duration_s":0.01006982,"duration_s":0.040761,"completed_at":"2026-08-17T07:25:20.659Z","load_balancing_strategy":"primary","db_duration_s":0.005532,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2384gitlab # [ 429.942857] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-17T07:25:20.663Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"afc12f2c040f8b5a1a0df0a8","created_at":"2026-08-17T07:25:19.581Z","trace_propagation_headers":{"sentry-trace":"277c5a176ea149cc8b11c21a370250d3-44606c51a49a4aa0","baggage":"sentry-trace_id=277c5a176ea149cc8b11c21a370250d3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b1b55a0f0794f9c708e392d488ab13a4","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-17T07:25:19.591Z","job_size_bytes":2,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-afc12f2c040f8b5a1a0df0a8: start","job_status":"start","queue_duration_s":1.071316,"scheduling_latency_s":1.071343}2385gitlab # [ 429.956908] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-17T07:25:20.715Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"afc12f2c040f8b5a1a0df0a8","created_at":"2026-08-17T07:25:19.581Z","trace_propagation_headers":{"sentry-trace":"277c5a176ea149cc8b11c21a370250d3-44606c51a49a4aa0","baggage":"sentry-trace_id=277c5a176ea149cc8b11c21a370250d3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b1b55a0f0794f9c708e392d488ab13a4","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-17T07:25:19.591Z","job_size_bytes":2,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-afc12f2c040f8b5a1a0df0a8: done: 0.052144 sec","job_status":"done","queue_duration_s":1.071316,"scheduling_latency_s":1.071343,"redis_calls":9,"redis_duration_s":0.002894,"redis_read_bytes":7,"redis_write_bytes":1183,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00063,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001654,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00061,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.016,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.016,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021676,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.052144,"completed_at":"2026-08-17T07:25:20.715Z","load_balancing_strategy":"primary","db_duration_s":0.019342,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2386gitlab # [ 429.999899] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-17T07:25:20.717Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"eadf67ff09cf484965e4b02c","created_at":"2026-08-17T07:25:19.603Z","trace_propagation_headers":{"sentry-trace":"277c5a176ea149cc8b11c21a370250d3-44606c51a49a4aa0","baggage":"sentry-trace_id=277c5a176ea149cc8b11c21a370250d3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"af59127c2f71c2ada83fd32da53f2d2d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-17T07:25:19.628Z","job_size_bytes":2,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-eadf67ff09cf484965e4b02c: start","job_status":"start","queue_duration_s":1.088742,"scheduling_latency_s":1.088773}2387gitlab # [ 430.014475] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-17T07:25:20.739Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0}2388gitlab # [ 430.018187] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-17T07:25:20.749Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"eadf67ff09cf484965e4b02c","created_at":"2026-08-17T07:25:19.603Z","trace_propagation_headers":{"sentry-trace":"277c5a176ea149cc8b11c21a370250d3-44606c51a49a4aa0","baggage":"sentry-trace_id=277c5a176ea149cc8b11c21a370250d3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"af59127c2f71c2ada83fd32da53f2d2d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-17T07:25:19.628Z","job_size_bytes":2,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-eadf67ff09cf484965e4b02c: done: 0.032292 sec","job_status":"done","queue_duration_s":1.088742,"scheduling_latency_s":1.088773,"redis_calls":9,"redis_duration_s":0.002624,"redis_read_bytes":7,"redis_write_bytes":1105,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000645,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001428,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":524,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000551,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":242,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017195,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.032292,"completed_at":"2026-08-17T07:25:20.749Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001001,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2389gitlab # [ 430.060715] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-17T07:25:20.751Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"0884a29ec7b266fb55178c7e","created_at":"2026-08-17T07:25:19.842Z","trace_propagation_headers":{"sentry-trace":"277c5a176ea149cc8b11c21a370250d3-44606c51a49a4aa0","baggage":"sentry-trace_id=277c5a176ea149cc8b11c21a370250d3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5604dd46bfa0ea7002191c2530c3da87","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-17T07:25:19.869Z","job_size_bytes":2,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-0884a29ec7b266fb55178c7e: start","job_status":"start","queue_duration_s":0.881991,"scheduling_latency_s":0.882017}2390gitlab # [ 430.074944] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-17T07:25:20.786Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"0884a29ec7b266fb55178c7e","created_at":"2026-08-17T07:25:19.842Z","trace_propagation_headers":{"sentry-trace":"277c5a176ea149cc8b11c21a370250d3-44606c51a49a4aa0","baggage":"sentry-trace_id=277c5a176ea149cc8b11c21a370250d3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5604dd46bfa0ea7002191c2530c3da87","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-17T07:25:19.869Z","job_size_bytes":2,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-0884a29ec7b266fb55178c7e: done: 0.034543 sec","job_status":"done","queue_duration_s":0.881991,"scheduling_latency_s":0.882017,"redis_calls":9,"redis_duration_s":0.002677,"redis_read_bytes":7,"redis_write_bytes":1026,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000632,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":315,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001513,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":491,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000532,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":220,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018083,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.034543,"completed_at":"2026-08-17T07:25:20.786Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006913,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2391gitlab # [ 430.117302] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-17T07:25:20.788Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"68ed0d768f912f13af521ace","created_at":"2026-08-17T07:25:19.882Z","trace_propagation_headers":{"sentry-trace":"277c5a176ea149cc8b11c21a370250d3-44606c51a49a4aa0","baggage":"sentry-trace_id=277c5a176ea149cc8b11c21a370250d3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"03f3bc3f94a0b138a3d792df18ba245a","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-17T07:25:19.898Z","job_size_bytes":2,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-68ed0d768f912f13af521ace: start","job_status":"start","queue_duration_s":0.889826,"scheduling_latency_s":0.889848}2392gitlab # [ 430.297803] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-17T07:25:21.071Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"68ed0d768f912f13af521ace","created_at":"2026-08-17T07:25:19.882Z","trace_propagation_headers":{"sentry-trace":"277c5a176ea149cc8b11c21a370250d3-44606c51a49a4aa0","baggage":"sentry-trace_id=277c5a176ea149cc8b11c21a370250d3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"03f3bc3f94a0b138a3d792df18ba245a","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-17T07:25:19.898Z","job_size_bytes":2,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-68ed0d768f912f13af521ace: done: 0.283035 sec","job_status":"done","queue_duration_s":0.889826,"scheduling_latency_s":0.889848,"redis_calls":11,"redis_duration_s":0.003193,"redis_read_bytes":9,"redis_write_bytes":1292,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000579,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001355,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":476,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001259,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":511,"db_count":130,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":130,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.052,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":129,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":84,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.051,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.212611,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.0006207,"exclusive_lock_hold_duration_s":0.25914672,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"ci","turbo_mode":false},"duration_s":0.283035,"completed_at":"2026-08-17T07:25:21.070Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.079134,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2393gitlab # [ 430.389709] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-17T07:25:21.072Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"ea2ba56df8dec9140ff93627","created_at":"2026-08-17T07:25:19.914Z","trace_propagation_headers":{"sentry-trace":"277c5a176ea149cc8b11c21a370250d3-44606c51a49a4aa0","baggage":"sentry-trace_id=277c5a176ea149cc8b11c21a370250d3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fcece84d170d68c9ac590dd4412471c5","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-17T07:25:19.935Z","job_size_bytes":2,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-ea2ba56df8dec9140ff93627: start","job_status":"start","queue_duration_s":1.136918,"scheduling_latency_s":1.136934}2394gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/2b5870faf44f4f50eae55d42e55a8040db7166ea/statuses2395gitlab # [ 430.652452] gitaly[913]: time="2026-08-17T07:25:21.425Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M079RN27P0086XYD9FVJ036J grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-17T07:25:51.223" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-17T07:25:21.424" grpc.time_ms=1.02 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2396gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/2b5870faf44f4f50eae55d42e55a8040db7166ea/statuses, in 0.19 seconds)2397gitlab # [ 430.690190] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/08/17:07:25:21 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/2b5870faf44f4f50eae55d42e55a8040db7166ea/statuses HTTP/1.1" 200 633 "" "curl/8.21.0" 1052398gitlab # [ 430.792813] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-17T07:25:21.566Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"ea2ba56df8dec9140ff93627","created_at":"2026-08-17T07:25:19.914Z","trace_propagation_headers":{"sentry-trace":"277c5a176ea149cc8b11c21a370250d3-44606c51a49a4aa0","baggage":"sentry-trace_id=277c5a176ea149cc8b11c21a370250d3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fcece84d170d68c9ac590dd4412471c5","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-17T07:25:19.935Z","job_size_bytes":2,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-ea2ba56df8dec9140ff93627: done: 0.4943 sec","job_status":"done","queue_duration_s":1.136918,"scheduling_latency_s":1.136934,"redis_calls":564,"redis_duration_s":0.112609,"redis_read_bytes":562,"redis_write_bytes":49063,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00056,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001702,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":470,"redis_shared_state_calls":557,"redis_shared_state_duration_s":0.110347,"redis_shared_state_read_bytes":556,"redis_shared_state_write_bytes":48290,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.430215,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.4943,"completed_at":"2026-08-17T07:25:21.566Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000879,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2399gitlab # [ 430.881426] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-17T07:25:21.568Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"b5f2e6e7774721f6cf280dad","created_at":"2026-08-17T07:25:19.967Z","trace_propagation_headers":{"sentry-trace":"277c5a176ea149cc8b11c21a370250d3-44606c51a49a4aa0","baggage":"sentry-trace_id=277c5a176ea149cc8b11c21a370250d3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4b1bcc4caec9010f3e3598b7df71d7f6","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-17T07:25:19.988Z","job_size_bytes":2,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-b5f2e6e7774721f6cf280dad: start","job_status":"start","queue_duration_s":1.580371,"scheduling_latency_s":1.580395}2400gitlab # [ 430.925281] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-17T07:25:21.582Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0}2401gitlab # [ 430.934773] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-17T07:25:21.589Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"b5f2e6e7774721f6cf280dad","created_at":"2026-08-17T07:25:19.967Z","trace_propagation_headers":{"sentry-trace":"277c5a176ea149cc8b11c21a370250d3-44606c51a49a4aa0","baggage":"sentry-trace_id=277c5a176ea149cc8b11c21a370250d3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4b1bcc4caec9010f3e3598b7df71d7f6","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-17T07:25:19.988Z","job_size_bytes":2,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-b5f2e6e7774721f6cf280dad: done: 0.021115 sec","job_status":"done","queue_duration_s":1.580371,"scheduling_latency_s":1.580395,"redis_calls":9,"redis_duration_s":0.002286,"redis_read_bytes":7,"redis_write_bytes":1178,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000557,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001207,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":557,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000522,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":264,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012143,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.021115,"completed_at":"2026-08-17T07:25:21.589Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001071,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2402gitlab # [ 430.997015] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-17T07:25:21.591Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"291d0296b2ddd75b262cd8d9","created_at":"2026-08-17T07:25:19.992Z","trace_propagation_headers":{"sentry-trace":"277c5a176ea149cc8b11c21a370250d3-883cda54c7664ab0","baggage":"sentry-trace_id=277c5a176ea149cc8b11c21a370250d3,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"20b8641ed301ab7ea6979513effb9a58","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:25:20.046Z","job_size_bytes":2,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-291d0296b2ddd75b262cd8d9: start","job_status":"start","queue_duration_s":1.544654,"scheduling_latency_s":1.544671}2403gitlab # [ 431.011372] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-17T07:25:21.610Z","message":"No existing merge request to be cleaned up."}2404gitlab # [ 431.013249] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-17T07:25:21.624Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"291d0296b2ddd75b262cd8d9","created_at":"2026-08-17T07:25:19.992Z","trace_propagation_headers":{"sentry-trace":"277c5a176ea149cc8b11c21a370250d3-883cda54c7664ab0","baggage":"sentry-trace_id=277c5a176ea149cc8b11c21a370250d3,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"20b8641ed301ab7ea6979513effb9a58","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:25:20.046Z","job_size_bytes":2,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-291d0296b2ddd75b262cd8d9: done: 0.033085 sec","job_status":"done","queue_duration_s":1.544654,"scheduling_latency_s":1.544671,"redis_calls":12,"redis_duration_s":0.002975,"redis_read_bytes":10,"redis_write_bytes":1323,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000457,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":301,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00101,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001508,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":4,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.004,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.004,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019708,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.033085,"completed_at":"2026-08-17T07:25:21.624Z","load_balancing_strategy":"primary","db_duration_s":0.007071,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2405gitlab # [ 431.058630] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-17T07:25:21.626Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"56dbc41d22770ed01097fff1","created_at":"2026-08-17T07:25:19.992Z","trace_propagation_headers":{"sentry-trace":"277c5a176ea149cc8b11c21a370250d3-883cda54c7664ab0","baggage":"sentry-trace_id=277c5a176ea149cc8b11c21a370250d3,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"20b8641ed301ab7ea6979513effb9a58","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:25:20.046Z","job_size_bytes":2,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-56dbc41d22770ed01097fff1: start","job_status":"start","queue_duration_s":1.579726,"scheduling_latency_s":1.579744}2406gitlab # [ 431.072602] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-17T07:25:21.637Z","message":"No existing merge request to be cleaned up."}2407gitlab # [ 431.074399] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-17T07:25:21.646Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"56dbc41d22770ed01097fff1","created_at":"2026-08-17T07:25:19.992Z","trace_propagation_headers":{"sentry-trace":"277c5a176ea149cc8b11c21a370250d3-883cda54c7664ab0","baggage":"sentry-trace_id=277c5a176ea149cc8b11c21a370250d3,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"20b8641ed301ab7ea6979513effb9a58","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:25:20.046Z","job_size_bytes":2,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-56dbc41d22770ed01097fff1: done: 0.020063 sec","job_status":"done","queue_duration_s":1.579726,"scheduling_latency_s":1.579744,"redis_calls":10,"redis_duration_s":0.002356,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000988,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001368,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012815,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020063,"completed_at":"2026-08-17T07:25:21.646Z","load_balancing_strategy":"primary","db_duration_s":0.002524,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2408gitlab # [ 431.114527] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-17T07:25:21.647Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"c7b4977e9ce1fa267b882168","created_at":"2026-08-17T07:25:19.992Z","trace_propagation_headers":{"sentry-trace":"277c5a176ea149cc8b11c21a370250d3-883cda54c7664ab0","baggage":"sentry-trace_id=277c5a176ea149cc8b11c21a370250d3,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"20b8641ed301ab7ea6979513effb9a58","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:25:20.046Z","job_size_bytes":2,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-c7b4977e9ce1fa267b882168: start","job_status":"start","queue_duration_s":1.601288,"scheduling_latency_s":1.601305}2409gitlab # [ 431.127075] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-17T07:25:21.659Z","message":"No existing merge request to be cleaned up."}2410gitlab # [ 431.128786] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-17T07:25:21.668Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"c7b4977e9ce1fa267b882168","created_at":"2026-08-17T07:25:19.992Z","trace_propagation_headers":{"sentry-trace":"277c5a176ea149cc8b11c21a370250d3-883cda54c7664ab0","baggage":"sentry-trace_id=277c5a176ea149cc8b11c21a370250d3,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"20b8641ed301ab7ea6979513effb9a58","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:25:20.046Z","job_size_bytes":2,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-c7b4977e9ce1fa267b882168: done: 0.020308 sec","job_status":"done","queue_duration_s":1.601288,"scheduling_latency_s":1.601305,"redis_calls":10,"redis_duration_s":0.002625,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000934,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001691,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013012,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020308,"completed_at":"2026-08-17T07:25:21.668Z","load_balancing_strategy":"primary","db_duration_s":0.001972,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2411gitlab # [ 431.167395] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-17T07:25:21.669Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"73350fd3f68513ce4ebb090f","created_at":"2026-08-17T07:25:19.992Z","trace_propagation_headers":{"sentry-trace":"277c5a176ea149cc8b11c21a370250d3-883cda54c7664ab0","baggage":"sentry-trace_id=277c5a176ea149cc8b11c21a370250d3,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"20b8641ed301ab7ea6979513effb9a58","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:25:20.046Z","job_size_bytes":2,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-73350fd3f68513ce4ebb090f: start","job_status":"start","queue_duration_s":1.622966,"scheduling_latency_s":1.622981}2412gitlab # [ 431.179984] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-17T07:25:21.680Z","message":"No existing merge request to be cleaned up."}2413gitlab # [ 431.181635] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-17T07:25:21.688Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"73350fd3f68513ce4ebb090f","created_at":"2026-08-17T07:25:19.992Z","trace_propagation_headers":{"sentry-trace":"277c5a176ea149cc8b11c21a370250d3-883cda54c7664ab0","baggage":"sentry-trace_id=277c5a176ea149cc8b11c21a370250d3,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"20b8641ed301ab7ea6979513effb9a58","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:25:20.046Z","job_size_bytes":2,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-73350fd3f68513ce4ebb090f: done: 0.019354 sec","job_status":"done","queue_duration_s":1.622966,"scheduling_latency_s":1.622981,"redis_calls":10,"redis_duration_s":0.002375,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00098,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001395,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012848,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019354,"completed_at":"2026-08-17T07:25:21.688Z","load_balancing_strategy":"primary","db_duration_s":0.001971,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2414gitlab # [ 431.221222] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-17T07:25:21.690Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"24cffc83d8d0e8d2c0ac5f03","created_at":"2026-08-17T07:25:20.011Z","trace_propagation_headers":{"sentry-trace":"277c5a176ea149cc8b11c21a370250d3-44606c51a49a4aa0","baggage":"sentry-trace_id=277c5a176ea149cc8b11c21a370250d3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"691b6752d38caea2d225e1cd21717924","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-17T07:25:20.050Z","job_size_bytes":2,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-24cffc83d8d0e8d2c0ac5f03: start","job_status":"start","queue_duration_s":1.640231,"scheduling_latency_s":1.640247}2415gitlab # [ 431.235010] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-17T07:25:21.804Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"24cffc83d8d0e8d2c0ac5f03","created_at":"2026-08-17T07:25:20.011Z","trace_propagation_headers":{"sentry-trace":"277c5a176ea149cc8b11c21a370250d3-44606c51a49a4aa0","baggage":"sentry-trace_id=277c5a176ea149cc8b11c21a370250d3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"691b6752d38caea2d225e1cd21717924","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-17T07:25:20.050Z","job_size_bytes":2,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-24cffc83d8d0e8d2c0ac5f03: done: 0.114581 sec","job_status":"done","queue_duration_s":1.640231,"scheduling_latency_s":1.640247,"redis_calls":70,"redis_duration_s":0.018239,"redis_read_bytes":118,"redis_write_bytes":42480,"redis_feature_flag_calls":10,"redis_feature_flag_duration_s":0.002212,"redis_feature_flag_read_bytes":10,"redis_feature_flag_write_bytes":1471,"redis_queues_calls":2,"redis_queues_duration_s":0.000879,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37385,"redis_queues_metadata_calls":55,"redis_queues_metadata_duration_s":0.014395,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3324,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000753,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":300,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.092318,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.114581,"completed_at":"2026-08-17T07:25:21.804Z","load_balancing_strategy":"primary","db_duration_s":0.002397,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2416gitlab # [ 431.278115] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-17T07:25:21.806Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"2f8ed4c2f248ee4dc5a51845","created_at":"2026-08-17T07:25:20.109Z","trace_propagation_headers":{"sentry-trace":"277c5a176ea149cc8b11c21a370250d3-44606c51a49a4aa0","baggage":"sentry-trace_id=277c5a176ea149cc8b11c21a370250d3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"87ca441595ef9a7b6b5bf48380e62f34","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-17T07:25:20.132Z","job_size_bytes":2,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-2f8ed4c2f248ee4dc5a51845: start","job_status":"start","queue_duration_s":1.674344,"scheduling_latency_s":1.674366}2417gitlab # [ 431.292743] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-17T07:25:21.819Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0}2418gitlab # [ 431.295872] gitaly[913]: time="2026-08-17T07:25:21.997Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M079RNKKEE0K298B227CGPV3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-17T07:25:51.795" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-17T07:25:21.996" grpc.time_ms=0.85 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2419gitlab # [ 431.309403] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-17T07:25:21.827Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"2f8ed4c2f248ee4dc5a51845","created_at":"2026-08-17T07:25:20.109Z","trace_propagation_headers":{"sentry-trace":"277c5a176ea149cc8b11c21a370250d3-44606c51a49a4aa0","baggage":"sentry-trace_id=277c5a176ea149cc8b11c21a370250d3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"87ca441595ef9a7b6b5bf48380e62f34","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-17T07:25:20.132Z","job_size_bytes":2,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-2f8ed4c2f248ee4dc5a51845: done: 0.020666 sec","job_status":"done","queue_duration_s":1.674344,"scheduling_latency_s":1.674366,"redis_calls":9,"redis_duration_s":0.002239,"redis_read_bytes":7,"redis_write_bytes":1112,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000513,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001239,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000487,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012021,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020666,"completed_at":"2026-08-17T07:25:21.827Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000932,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2420gitlab # [ 431.351711] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-17T07:25:21.828Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"fdceba61d40ebaa3bd823dd5","created_at":"2026-08-17T07:25:20.143Z","trace_propagation_headers":{"sentry-trace":"277c5a176ea149cc8b11c21a370250d3-44606c51a49a4aa0","baggage":"sentry-trace_id=277c5a176ea149cc8b11c21a370250d3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"08c1010f4e136ae2f7b414f1685a7c3f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-17T07:25:20.159Z","job_size_bytes":2,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-fdceba61d40ebaa3bd823dd5: start","job_status":"start","queue_duration_s":1.669547,"scheduling_latency_s":1.669565}2421gitlab # [ 431.365216] gitaly[913]: time="2026-08-17T07:25:22.064Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=570 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M079RNKKEE0K298B227CGPV3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-17T07:25:32.047" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-17T07:25:22.047" grpc.time_ms=16.945 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2422gitlab # [ 431.379097] nixbot[3496]: {"ts": "2026-08-17T07:25:22.132Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/2b5870faf44f4f50eae55d42e55a8040db7166ea \"HTTP/1.1 201 Created\""}2423gitlab # [ 431.381987] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/08/17:07:25:22 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/2b5870faf44f4f50eae55d42e55a8040db7166ea HTTP/1.1" 201 669 "" "python-httpx/0.28.1" 2232424gitlab # [ 431.384588] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-17T07:25:21.873Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"fdceba61d40ebaa3bd823dd5","created_at":"2026-08-17T07:25:20.143Z","trace_propagation_headers":{"sentry-trace":"277c5a176ea149cc8b11c21a370250d3-44606c51a49a4aa0","baggage":"sentry-trace_id=277c5a176ea149cc8b11c21a370250d3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"08c1010f4e136ae2f7b414f1685a7c3f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-17T07:25:20.159Z","job_size_bytes":2,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-fdceba61d40ebaa3bd823dd5: done: 0.044465 sec","job_status":"done","queue_duration_s":1.669547,"scheduling_latency_s":1.669565,"redis_calls":9,"redis_duration_s":0.007988,"redis_read_bytes":7,"redis_write_bytes":1068,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000509,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.006928,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000551,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022194,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.044465,"completed_at":"2026-08-17T07:25:21.873Z","load_balancing_strategy":"primary","db_duration_s":0.00921,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2425gitlab # [ 431.426634] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-17T07:25:21.876Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"da223340a02c03b8af9a8b3c","created_at":"2026-08-17T07:25:21.710Z","trace_propagation_headers":{"sentry-trace":"277c5a176ea149cc8b11c21a370250d3-8c80e30adc9d42c9","baggage":"sentry-trace_id=277c5a176ea149cc8b11c21a370250d3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"691b6752d38caea2d225e1cd21717924","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:25:21.795Z","job_size_bytes":2,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-da223340a02c03b8af9a8b3c: start","job_status":"start","queue_duration_s":0.080874,"scheduling_latency_s":0.080897}2426gitlab # [ 431.439274] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-17T07:25:21.902Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"da223340a02c03b8af9a8b3c","created_at":"2026-08-17T07:25:21.710Z","trace_propagation_headers":{"sentry-trace":"277c5a176ea149cc8b11c21a370250d3-8c80e30adc9d42c9","baggage":"sentry-trace_id=277c5a176ea149cc8b11c21a370250d3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"691b6752d38caea2d225e1cd21717924","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:25:21.795Z","job_size_bytes":2,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-da223340a02c03b8af9a8b3c: done: 0.025887 sec","job_status":"done","queue_duration_s":0.080874,"scheduling_latency_s":0.080897,"redis_calls":15,"redis_duration_s":0.004533,"redis_read_bytes":12,"redis_write_bytes":1464,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000633,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001924,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001976,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01508,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.025887,"completed_at":"2026-08-17T07:25:21.902Z","load_balancing_strategy":"primary","db_duration_s":0.000773,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2427gitlab # [ 431.480391] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-17T07:25:21.903Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ca8e35cc5d3bba86bbbb1e4d","created_at":"2026-08-17T07:25:21.710Z","trace_propagation_headers":{"sentry-trace":"277c5a176ea149cc8b11c21a370250d3-8c80e30adc9d42c9","baggage":"sentry-trace_id=277c5a176ea149cc8b11c21a370250d3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"691b6752d38caea2d225e1cd21717924","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:25:21.795Z","job_size_bytes":2,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ca8e35cc5d3bba86bbbb1e4d: start","job_status":"start","queue_duration_s":0.108206,"scheduling_latency_s":0.108227}2428gitlab # [ 431.492824] gitaly[913]: time="2026-08-17T07:25:22.199Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M079RNTSMBYCZR9EZ36GP1KH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-17T07:25:52.097" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-17T07:25:22.197" grpc.time_ms=0.925 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2429gitlab # [ 431.505656] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-17T07:25:21.930Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ca8e35cc5d3bba86bbbb1e4d","created_at":"2026-08-17T07:25:21.710Z","trace_propagation_headers":{"sentry-trace":"277c5a176ea149cc8b11c21a370250d3-8c80e30adc9d42c9","baggage":"sentry-trace_id=277c5a176ea149cc8b11c21a370250d3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"691b6752d38caea2d225e1cd21717924","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:25:21.795Z","job_size_bytes":2,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ca8e35cc5d3bba86bbbb1e4d: done: 0.026474 sec","job_status":"done","queue_duration_s":0.108206,"scheduling_latency_s":0.108227,"redis_calls":13,"redis_duration_s":0.003221,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001126,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002095,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018543,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.026474,"completed_at":"2026-08-17T07:25:21.930Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2430gitlab # [ 431.545030] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-17T07:25:21.933Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"12fbaf84d5749fc5db3e3d54","created_at":"2026-08-17T07:25:21.710Z","trace_propagation_headers":{"sentry-trace":"277c5a176ea149cc8b11c21a370250d3-8c80e30adc9d42c9","baggage":"sentry-trace_id=277c5a176ea149cc8b11c21a370250d3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"691b6752d38caea2d225e1cd21717924","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:25:21.795Z","job_size_bytes":2,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-12fbaf84d5749fc5db3e3d54: start","job_status":"start","queue_duration_s":0.13787,"scheduling_latency_s":0.137911}2431gitlab # [ 431.557474] gitaly[913]: time="2026-08-17T07:25:22.256Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M079RNTSMBYCZR9EZ36GP1KH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-17T07:25:32.239" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-17T07:25:22.239" grpc.time_ms=16.452 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2432gitlab # [ 431.571113] nixbot[3496]: {"ts": "2026-08-17T07:25:22.313Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/2b5870faf44f4f50eae55d42e55a8040db7166ea \"HTTP/1.1 201 Created\""}2433gitlab # [ 431.573974] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/08/17:07:25:22 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/2b5870faf44f4f50eae55d42e55a8040db7166ea HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 1742434gitlab # [ 431.576480] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-17T07:25:21.967Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"12fbaf84d5749fc5db3e3d54","created_at":"2026-08-17T07:25:21.710Z","trace_propagation_headers":{"sentry-trace":"277c5a176ea149cc8b11c21a370250d3-8c80e30adc9d42c9","baggage":"sentry-trace_id=277c5a176ea149cc8b11c21a370250d3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"691b6752d38caea2d225e1cd21717924","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:25:21.795Z","job_size_bytes":2,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-12fbaf84d5749fc5db3e3d54: done: 0.034127 sec","job_status":"done","queue_duration_s":0.13787,"scheduling_latency_s":0.137911,"redis_calls":13,"redis_duration_s":0.003083,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001143,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00194,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023336,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.034127,"completed_at":"2026-08-17T07:25:21.967Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2435gitlab # [ 431.615716] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-17T07:25:21.969Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"72741887b20716e9ddb3877d","created_at":"2026-08-17T07:25:21.710Z","trace_propagation_headers":{"sentry-trace":"277c5a176ea149cc8b11c21a370250d3-8c80e30adc9d42c9","baggage":"sentry-trace_id=277c5a176ea149cc8b11c21a370250d3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"691b6752d38caea2d225e1cd21717924","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:25:21.795Z","job_size_bytes":2,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-72741887b20716e9ddb3877d: start","job_status":"start","queue_duration_s":0.174525,"scheduling_latency_s":0.174557}2436gitlab # [ 431.629459] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-17T07:25:22.000Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"72741887b20716e9ddb3877d","created_at":"2026-08-17T07:25:21.710Z","trace_propagation_headers":{"sentry-trace":"277c5a176ea149cc8b11c21a370250d3-8c80e30adc9d42c9","baggage":"sentry-trace_id=277c5a176ea149cc8b11c21a370250d3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"691b6752d38caea2d225e1cd21717924","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:25:21.795Z","job_size_bytes":2,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-72741887b20716e9ddb3877d: done: 0.030345 sec","job_status":"done","queue_duration_s":0.174525,"scheduling_latency_s":0.174557,"redis_calls":13,"redis_duration_s":0.004271,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00142,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002851,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021253,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.030345,"completed_at":"2026-08-17T07:25:22.000Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2437gitlab # [ 431.668648] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-17T07:25:22.003Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0ecd0e6d31a5ede8796bd9a9","created_at":"2026-08-17T07:25:21.710Z","trace_propagation_headers":{"sentry-trace":"277c5a176ea149cc8b11c21a370250d3-8c80e30adc9d42c9","baggage":"sentry-trace_id=277c5a176ea149cc8b11c21a370250d3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"691b6752d38caea2d225e1cd21717924","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:25:21.795Z","job_size_bytes":2,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0ecd0e6d31a5ede8796bd9a9: start","job_status":"start","queue_duration_s":0.208028,"scheduling_latency_s":0.208065}2438gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/2b5870faf44f4f50eae55d42e55a8040db7166ea/statuses2439gitlab # [ 431.681469] gitaly[913]: time="2026-08-17T07:25:22.386Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M079RP0S9DEAJZANQTH7Q524 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-17T07:25:52.184" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-17T07:25:22.384" grpc.time_ms=0.862 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2440gitlab # [ 431.694443] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-17T07:25:22.029Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0ecd0e6d31a5ede8796bd9a9","created_at":"2026-08-17T07:25:21.710Z","trace_propagation_headers":{"sentry-trace":"277c5a176ea149cc8b11c21a370250d3-8c80e30adc9d42c9","baggage":"sentry-trace_id=277c5a176ea149cc8b11c21a370250d3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"691b6752d38caea2d225e1cd21717924","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:25:21.795Z","job_size_bytes":2,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0ecd0e6d31a5ede8796bd9a9: done: 0.026216 sec","job_status":"done","queue_duration_s":0.208028,"scheduling_latency_s":0.208065,"redis_calls":13,"redis_duration_s":0.00351,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001207,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002303,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017485,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.026216,"completed_at":"2026-08-17T07:25:22.029Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2441gitlab # [ 431.731715] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-17T07:25:22.031Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5cb337704181b54829ffc11e","created_at":"2026-08-17T07:25:21.710Z","trace_propagation_headers":{"sentry-trace":"277c5a176ea149cc8b11c21a370250d3-8c80e30adc9d42c9","baggage":"sentry-trace_id=277c5a176ea149cc8b11c21a370250d3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"691b6752d38caea2d225e1cd21717924","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:25:21.795Z","job_size_bytes":2,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5cb337704181b54829ffc11e: start","job_status":"start","queue_duration_s":0.236217,"scheduling_latency_s":0.23624}2442gitlab # [ 431.744421] gitaly[913]: time="2026-08-17T07:25:22.448Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=6 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M079RP0S9DEAJZANQTH7Q524 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-17T07:25:32.083" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-17T07:25:22.424" grpc.time_ms=21.97 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2443gitlab # [ 431.758411] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-17T07:25:22.053Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5cb337704181b54829ffc11e","created_at":"2026-08-17T07:25:21.710Z","trace_propagation_headers":{"sentry-trace":"277c5a176ea149cc8b11c21a370250d3-8c80e30adc9d42c9","baggage":"sentry-trace_id=277c5a176ea149cc8b11c21a370250d3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"691b6752d38caea2d225e1cd21717924","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:25:21.795Z","job_size_bytes":2,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5cb337704181b54829ffc11e: done: 0.02184 sec","job_status":"done","queue_duration_s":0.236217,"scheduling_latency_s":0.23624,"redis_calls":13,"redis_duration_s":0.002181,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00072,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001461,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015777,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.02184,"completed_at":"2026-08-17T07:25:22.053Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2444gitlab # [ 431.798028] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-17T07:25:22.055Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"826f52779963819dfebc1c2a","created_at":"2026-08-17T07:25:21.710Z","trace_propagation_headers":{"sentry-trace":"277c5a176ea149cc8b11c21a370250d3-8c80e30adc9d42c9","baggage":"sentry-trace_id=277c5a176ea149cc8b11c21a370250d3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"691b6752d38caea2d225e1cd21717924","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:25:21.795Z","job_size_bytes":2,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-826f52779963819dfebc1c2a: start","job_status":"start","queue_duration_s":0.259677,"scheduling_latency_s":0.259697}2445gitlab # [ 431.811017] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/08/17:07:25:22 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/2b5870faf44f4f50eae55d42e55a8040db7166ea HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 1942446gitlab # [ 431.813668] nixbot[3496]: {"ts": "2026-08-17T07:25:22.526Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/2b5870faf44f4f50eae55d42e55a8040db7166ea \"HTTP/1.1 201 Created\""}2447gitlab # [ 431.816473] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-17T07:25:22.074Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"826f52779963819dfebc1c2a","created_at":"2026-08-17T07:25:21.710Z","trace_propagation_headers":{"sentry-trace":"277c5a176ea149cc8b11c21a370250d3-8c80e30adc9d42c9","baggage":"sentry-trace_id=277c5a176ea149cc8b11c21a370250d3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"691b6752d38caea2d225e1cd21717924","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:25:21.795Z","job_size_bytes":2,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-826f52779963819dfebc1c2a: done: 0.019509 sec","job_status":"done","queue_duration_s":0.259677,"scheduling_latency_s":0.259697,"redis_calls":13,"redis_duration_s":0.002845,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000875,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00197,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013141,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019509,"completed_at":"2026-08-17T07:25:22.074Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2448gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/2b5870faf44f4f50eae55d42e55a8040db7166ea/statuses, in 0.18 seconds)2449gitlab # [ 431.857424] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-17T07:25:22.076Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9419d653fe913f66a4d8b1f0","created_at":"2026-08-17T07:25:21.710Z","trace_propagation_headers":{"sentry-trace":"277c5a176ea149cc8b11c21a370250d3-8c80e30adc9d42c9","baggage":"sentry-trace_id=277c5a176ea149cc8b11c21a370250d3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"691b6752d38caea2d225e1cd21717924","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:25:21.795Z","job_size_bytes":2,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9419d653fe913f66a4d8b1f0: start","job_status":"start","queue_duration_s":0.280856,"scheduling_latency_s":0.280875}2450(finished: subtest: eval and build post commit statuses, in 6.14 seconds)2451(finished: run the VM test script, in 500.13 seconds)2452gitlab # [ 431.874132] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-17T07:25:22.093Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9419d653fe913f66a4d8b1f0","created_at":"2026-08-17T07:25:21.710Z","trace_propagation_headers":{"sentry-trace":"277c5a176ea149cc8b11c21a370250d3-8c80e30adc9d42c9","baggage":"sentry-trace_id=277c5a176ea149cc8b11c21a370250d3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"691b6752d38caea2d225e1cd21717924","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:25:21.795Z","job_size_bytes":2,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9419d653fe913f66a4d8b1f0: done: 0.017036 sec","job_status":"done","queue_duration_s":0.280856,"scheduling_latency_s":0.280875,"redis_calls":13,"redis_duration_s":0.0028250000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001073,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001752,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01098,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017036,"completed_at":"2026-08-17T07:25:22.093Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2453gitlab # [ 431.914257] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-17T07:25:22.094Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0e057f13224bfd208c53200d","created_at":"2026-08-17T07:25:21.710Z","trace_propagation_headers":{"sentry-trace":"277c5a176ea149cc8b11c21a370250d3-8c80e30adc9d42c9","baggage":"sentry-trace_id=277c5a176ea149cc8b11c21a370250d3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"691b6752d38caea2d225e1cd21717924","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:25:21.795Z","job_size_bytes":2,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0e057f13224bfd208c53200d: start","job_status":"start","queue_duration_s":0.299312,"scheduling_latency_s":0.299329}2454test script finished in 500.18s2455cleanup2456kill QemuMachine (pid 46)2457gitlab # [ 431.930766] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/08/17:07:25:22 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/2b5870faf44f4f50eae55d42e55a8040db7166ea/statuses HTTP/1.1" 200 1328 "" "curl/8.21.0" 87qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/41m77i1296n33p6liin8ynr6wh3h6b7m-python3-3.14.6/bin/python3.14)2458(finished: cleanup, in 1.38 seconds)2459additionally exposed symbols:2460 gitlab,2461 vlan1,2462 start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh2463[]2464[]2465[{'id': 1, 'url': 'http://buildbot:8010/webhooks/gitlab', 'name': None, 'description': None, 'created_at': '2026-08-17T07:23:44.471Z', 'push_events': True, 'tag_push_events': False, 'merge_requests_events': True, 'repository_update_events': False, 'enable_ssl_verification': True, 'alert_status': 'executable', 'disabled_until': None, 'push_events_branch_filter': None, 'branch_filter_strategy': 'wildcard', 'custom_webhook_template': None, 'token_present': True, 'signing_token_present': False, 'project_id': 1, 'issues_events': False, 'confidential_issues_events': False, 'note_events': False, 'confidential_note_events': None, 'pipeline_events': False, 'wiki_page_events': False, 'deployment_events': False, 'feature_flag_events': False, 'job_events': False, 'releases_events': False, 'milestone_events': False, 'emoji_events': False, 'resource_access_token_events': False, 'resource_deploy_token_events': False, 'vulnerability_events': False}]2466[]2467[]2468[]2469[]2470[]2471[]2472[]2473[]2474[]2475[]2476[]2477[]2478[]2479[]2480[]2481[]2482[]2483[]2484[]2485[]2486[]2487[]2488[]2489[]2490[]2491[]2492[]2493[]2494[]2495[]2496[]2497[]2498[]2499[]2500[]2501[]2502[]2503[]2504[]2505[]2506[]2507[]2508[]2509[]2510[]2511[]2512[]2513[]2514[]2515[]2516[]2517[]2518[]2519[]2520[]2521[]2522[]2523[]2524[]2525[]2526[]2527[]2528[]2529[]2530[]2531[]2532[]2533[]2534[]2535[]2536[]2537[]2538[]2539[]2540[]2541[]2542[]2543[]2544[]2545[]2546[]2547[]2548[]2549[]2550[]2551[]2552[{'id': 2, 'project_id': 1, 'number': 2, 'tree_hash': 'cefc112e8680bb0f9569544b9656644ac3312d93', 'commit_sha': '2b5870faf44f4f50eae55d42e55a8040db7166ea', 'branch': 'master', 'pr_number': None, 'pr_author': None, 'status': 'pending', 'eval_warnings': None, 'error': None, 'created_at': '2026-08-17T07:25:16.389732Z', 'started_at': None, 'finished_at': None}]2553[]2554[{'id': 5, 'sha': '2b5870faf44f4f50eae55d42e55a8040db7166ea', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluating flake', 'created_at': '2026-08-17T07:25:16.721Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2555[{'id': 5, 'sha': '2b5870faf44f4f50eae55d42e55a8040db7166ea', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluating flake', 'created_at': '2026-08-17T07:25:16.721Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2556[{'id': 5, 'sha': '2b5870faf44f4f50eae55d42e55a8040db7166ea', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluating flake', 'created_at': '2026-08-17T07:25:16.721Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2557[{'id': 5, 'sha': '2b5870faf44f4f50eae55d42e55a8040db7166ea', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluating flake', 'created_at': '2026-08-17T07:25:16.721Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2558[{'id': 5, 'sha': '2b5870faf44f4f50eae55d42e55a8040db7166ea', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluation succeeded (1 warning)', 'created_at': '2026-08-17T07:25:16.721Z', 'started_at': None, 'finished_at': '2026-08-17T07:25:22.095Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}, {'id': 6, 'sha': '2b5870faf44f4f50eae55d42e55a8040db7166ea', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-build', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': '0 attributes built', 'created_at': '2026-08-17T07:25:22.284Z', 'started_at': None, 'finished_at': '2026-08-17T07:25:22.493Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]