vm-test-run-nixbot-gitlab
default.checks.aarch64-linux.nixbot-gitlab
· build #224
· raw
1tribuchet: building on eliza2Machine state will be reset. To keep it, pass --keep-machine-state3start all VLans4(finished: start all VLans, in 0.00 seconds)5Test will time out and terminate in 3600 seconds6run the VM test script7start all VMs8gitlab: starting vm9gitlab: QEMU running (pid 46)10gitlab # Disk image does not exist, creating the virtualisation disk image...11gitlab # Formatting '/build/vm-state-gitlab/tmp.bBQPHkf3vK', fmt=raw size=107374182412gitlab # mke2fs 1.47.4 (6-Mar-2025)13(finished: start all VMs, in 72.92 seconds)14gitlab # Discarding device blocks: 0/262144 done15gitlab: waiting for unit setup-gitlab.service16gitlab # Creating filesystem with 262144 4k blocks and 65536 inodes17gitlab: waiting for the VM to finish booting18gitlab # Filesystem UUID: 683253c4-e500-4d06-8d15-7fb3e66e0f7a19gitlab # Superblock backups stored on blocks:20gitlab # 32768, 98304, 163840, 22937621gitlab # 22gitlab # Allocating group tables: 0/8 done23gitlab # Writing inode tables: 0/8 done24gitlab # Creating journal (8192 blocks): done25gitlab # Writing superblocks and filesystem accounting information: 0/8 done26gitlab # 27gitlab # Virtualisation disk image created.28gitlab # Creating Nix store image...29gitlab # Created Nix store image.30gitlab # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40]31gitlab # [ 0.000000] Linux version 6.18.43 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Thu Aug 6 17:27:09 UTC 202632gitlab # [ 0.000000] KASLR enabled33gitlab # [ 0.000000] random: crng init done34gitlab # [ 0.000000] Machine model: linux,dummy-virt35gitlab # [ 0.000000] efi: UEFI not found.36gitlab # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT37gitlab # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x00000001bfffffff]38gitlab # [ 0.000000] NODE_DATA(0) allocated [mem 0x1bfdeb740-0x1bfdeeebf]39gitlab # [ 0.000000] Zone ranges:40gitlab # [ 0.000000] DMA [mem 0x0000000040000000-0x00000000ffffffff]41gitlab # [ 0.000000] DMA32 empty42gitlab # [ 0.000000] Normal [mem 0x0000000100000000-0x00000001bfffffff]43gitlab # [ 0.000000] Device empty44gitlab # [ 0.000000] Movable zone start for each node45gitlab # [ 0.000000] Early memory node ranges46gitlab # [ 0.000000] node 0: [mem 0x0000000040000000-0x00000001bfffffff]47gitlab # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x00000001bfffffff]48gitlab # [ 0.000000] cma: Reserved 32 MiB at 0x00000000fe00000049gitlab # [ 0.000000] psci: probing for conduit method from DT.50gitlab # [ 0.000000] psci: PSCIv1.3 detected in firmware.51gitlab # [ 0.000000] psci: Using standard PSCI v0.2 function IDs52gitlab # [ 0.000000] psci: Trusted OS migration not required53gitlab # [ 0.000000] psci: SMC Calling Convention v1.154gitlab # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003)55gitlab # [ 0.000000] percpu: Embedded 76 pages/cpu s186712 r8192 d116392 u31129656gitlab # [ 0.000000] Detected PIPT I-cache on CPU057gitlab # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm)58gitlab # [ 0.000000] CPU features: detected: GICv3 CPU interface59gitlab # [ 0.000000] CPU features: detected: Spectre-v460gitlab # [ 0.000000] CPU features: detected: Spectre-BHB61gitlab # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_3862gitlab # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_2363gitlab # [ 0.000000] alternatives: applying boot alternatives64gitlab # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/vx40h6r50a12nm7hl0byzzgygph8vrlf-nixos-system-gitlab-test/init regInfo=/nix/store/xdzx9qn99q7n685m5cx7zf2vh55jpppd-closure-info/registration console=ttyAMA0,115200n8 console=tty065gitlab # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/xdzx9qn99q7n685m5cx7zf2vh55jpppd-closure-info/registration", will be passed to user space.66gitlab # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes67gitlab # [ 0.000000] Dentry cache hash table entries: 1048576 (order: 11, 8388608 bytes, linear)68gitlab # [ 0.000000] Inode-cache hash table entries: 524288 (order: 10, 4194304 bytes, linear)69gitlab # [ 0.000000] software IO TLB: area num 4.70gitlab # [ 0.000000] software IO TLB: mapped [mem 0x00000000fa000000-0x00000000fe000000] (64MB)71gitlab # [ 0.000000] Fallback order for Node 0: 072gitlab # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 157286473gitlab # [ 0.000000] Policy zone: Normal74gitlab # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off75gitlab # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=176gitlab # [ 0.000000] allocated 12582912 bytes of page_ext77gitlab # [ 0.000000] ftrace: allocating 74867 entries in 294 pages78gitlab # [ 0.000000] ftrace: allocated 294 pages with 4 groups79gitlab # [ 0.000000] rcu: Hierarchical RCU implementation.80gitlab # [ 0.000000] rcu: RCU event tracing is enabled.81gitlab # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=4.82gitlab # [ 0.000000] Trampoline variant of Tasks RCU enabled.83gitlab # [ 0.000000] Rude variant of Tasks RCU enabled.84gitlab # [ 0.000000] Tracing variant of Tasks RCU enabled.85gitlab # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.86gitlab # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=487gitlab # [ 0.000000] RCU Tasks: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.88gitlab # [ 0.000000] RCU Tasks Rude: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.89gitlab # [ 0.000000] RCU Tasks Trace: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.90gitlab # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 091gitlab # [ 0.000000] GICv3: 256 SPIs implemented92gitlab # [ 0.000000] GICv3: 0 Extended SPIs implemented93gitlab # [ 0.000000] Root IRQ handler: gic_handle_irq94gitlab # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI95gitlab # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=096gitlab # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a000097gitlab # [ 0.000000] ITS [mem 0x08080000-0x0809ffff]98gitlab # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @100f10000 (indirect, esz 8, psz 64K, shr 1)99gitlab # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @100f20000 (flat, esz 8, psz 64K, shr 1)100gitlab # [ 0.000000] GICv3: using LPI property table @0x0000000100f30000101gitlab # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000100f40000102gitlab # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.103gitlab # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns104gitlab # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt).105gitlab # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns106gitlab # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns107gitlab # [ 0.000029] arm-pv: using stolen time PV108gitlab # [ 0.000383] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)109gitlab # [ 0.000567] Console: colour dummy device 80x25110gitlab # [ 0.000575] printk: legacy console [tty0] enabled111gitlab # [ 0.000751] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000)112gitlab # [ 0.000757] pid_max: default: 32768 minimum: 301113gitlab # [ 0.000834] LSM: initializing lsm=capability,landlock,yama,bpf,ima114gitlab # [ 0.001012] landlock: Up and running.115gitlab # [ 0.001015] Yama: becoming mindful.116gitlab # [ 0.001448] LSM support for eBPF active117gitlab # [ 0.001667] Mount-cache hash table entries: 16384 (order: 5, 131072 bytes, linear)118gitlab # [ 0.001766] Mountpoint-cache hash table entries: 16384 (order: 5, 131072 bytes, linear)119gitlab # [ 0.002894] cacheinfo: Unable to detect cache hierarchy for CPU 0120gitlab # [ 0.003547] rcu: Hierarchical SRCU implementation.121gitlab # [ 0.003551] rcu: Max phase no-delay instances is 1000.122gitlab # [ 0.003694] Timer migration: 1 hierarchy levels; 8 children per group; 1 crossnode level123gitlab # [ 0.004701] fsl-mc MSI: its@8080000 domain created124gitlab # [ 0.004794] EFI services will not be available.125gitlab # [ 0.004999] smp: Bringing up secondary CPUs ...126gitlab # [ 0.005631] Detected PIPT I-cache on CPU1127gitlab # [ 0.005731] GICv3: CPU1: found redistributor 1 region 0:0x00000000080c0000128gitlab # [ 0.005852] GICv3: CPU1: using allocated LPI pending table @0x0000000100f50000129gitlab # [ 0.005975] CPU1: Booted secondary processor 0x0000000001 [0xc00fac40]130gitlab # [ 0.007015] Detected PIPT I-cache on CPU2131gitlab # [ 0.007122] GICv3: CPU2: found redistributor 2 region 0:0x00000000080e0000132gitlab # [ 0.007243] GICv3: CPU2: using allocated LPI pending table @0x0000000100f60000133gitlab # [ 0.007366] CPU2: Booted secondary processor 0x0000000002 [0xc00fac40]134gitlab # [ 0.008392] Detected PIPT I-cache on CPU3135gitlab # [ 0.008507] GICv3: CPU3: found redistributor 3 region 0:0x0000000008100000136gitlab # [ 0.008629] GICv3: CPU3: using allocated LPI pending table @0x0000000100f70000137gitlab # [ 0.008755] CPU3: Booted secondary processor 0x0000000003 [0xc00fac40]138gitlab # [ 0.009270] smp: Brought up 1 node, 4 CPUs139gitlab # [ 0.009295] SMP: Total of 4 processors activated.140gitlab # [ 0.009298] CPU: All CPU(s) started at EL1141gitlab # [ 0.009306] CPU features: detected: Branch Target Identification142gitlab # [ 0.009310] CPU features: detected: ARMv8.4 Translation Table Level143gitlab # [ 0.009313] CPU features: detected: Instruction cache invalidation not required for I/D coherence144gitlab # [ 0.009316] CPU features: detected: Data cache clean to the PoU not required for I/D coherence145gitlab # [ 0.009319] CPU features: detected: Common not Private translations146gitlab # [ 0.009322] CPU features: detected: CRC32 instructions147gitlab # [ 0.009325] CPU features: detected: Data cache clean to Point of Deep Persistence148gitlab # [ 0.009328] CPU features: detected: Data cache clean to Point of Persistence149gitlab # [ 0.009331] CPU features: detected: Data independent timing control (DIT)150gitlab # [ 0.009334] CPU features: detected: E0PD151gitlab # [ 0.009336] CPU features: detected: Enhanced Counter Virtualization152gitlab # [ 0.009339] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF)153gitlab # [ 0.009342] CPU features: detected: Enhanced Virtualization Traps154gitlab # [ 0.009345] CPU features: detected: Fine Grained Traps155gitlab # [ 0.009347] CPU features: detected: Generic authentication (architected QARMA5 algorithm)156gitlab # [ 0.009352] CPU features: detected: RCpc load-acquire (LDAPR)157gitlab # [ 0.009354] CPU features: detected: LSE atomic instructions158gitlab # [ 0.009356] CPU features: detected: Privileged Access Never159gitlab # [ 0.009359] CPU features: detected: PMUv3160gitlab # [ 0.009361] CPU features: detected: RAS Extension Support161gitlab # [ 0.009363] CPU features: detected: RASv1p1 Extension Support162gitlab # [ 0.009366] CPU features: detected: Random Number Generator163gitlab # [ 0.009368] CPU features: detected: Speculation barrier (SB)164gitlab # [ 0.009370] CPU features: detected: Stage-2 Force Write-Back165gitlab # [ 0.009373] CPU features: detected: TLB range maintenance instructions166gitlab # [ 0.009376] CPU features: detected: Speculative Store Bypassing Safe (SSBS)167gitlab # [ 0.009498] alternatives: applying system-wide alternatives168gitlab # [ 0.012326] CPU features: detected: BBM Level 2 without TLB conflict abort169gitlab # [ 0.012513] Memory: 5963800K/6291456K available (24448K kernel code, 7090K rwdata, 26340K rodata, 4736K init, 1106K bss, 272908K reserved, 32768K cma-reserved)170gitlab # [ 0.013936] devtmpfs: initialized171gitlab # [ 0.017981] posixtimers hash table entries: 2048 (order: 3, 32768 bytes, linear)172gitlab # [ 0.018045] futex hash table entries: 1024 (65536 bytes on 1 NUMA nodes, total 64 KiB, linear).173gitlab # [ 0.018264] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL174gitlab # [ 0.018268] 0 pages in range for non-PLT usage175gitlab # [ 0.018269] 508288 pages in range for PLT usage176gitlab # [ 0.018356] pinctrl core: initialized pinctrl subsystem177gitlab # [ 0.019170] DMI not present or invalid.178gitlab # [ 0.022240] NET: Registered PF_NETLINK/PF_ROUTE protocol family179gitlab # [ 0.024551] DMA: preallocated 1024 KiB GFP_KERNEL pool for atomic allocations180gitlab # [ 0.024823] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations181gitlab # [ 0.026627] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations182gitlab # [ 0.026652] audit: initializing netlink subsys (disabled)183gitlab # [ 0.026960] audit: type=2000 audit(0.024:1): state=initialized audit_enabled=0 res=1184gitlab # [ 0.027427] thermal_sys: Registered thermal governor 'fair_share'185gitlab # [ 0.027429] thermal_sys: Registered thermal governor 'bang_bang'186gitlab # [ 0.027434] thermal_sys: Registered thermal governor 'step_wise'187gitlab # [ 0.027436] thermal_sys: Registered thermal governor 'user_space'188gitlab # [ 0.027439] thermal_sys: Registered thermal governor 'power_allocator'189gitlab # [ 0.027534] cpuidle: using governor ladder190gitlab # [ 0.027557] cpuidle: using governor menu191gitlab # [ 0.027741] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers.192gitlab # [ 0.027951] ASID allocator initialised with 65536 entries193gitlab # [ 0.029069] Serial: AMBA PL011 UART driver194gitlab # [ 0.034161] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1195gitlab # [ 0.034433] printk: console [ttyAMA0] enabled196gitlab # [ 0.039495] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages197gitlab # [ 0.039513] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page198gitlab # [ 0.039523] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages199gitlab # [ 0.039531] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page200gitlab # [ 0.039539] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages201gitlab # [ 0.039547] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page202gitlab # [ 0.039555] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages203gitlab # [ 0.039563] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page204gitlab # [ 0.050112] fbcon: Taking over console205gitlab # [ 0.050123] ACPI: Interpreter disabled.206gitlab # [ 0.051085] iommu: Default domain type: Translated207gitlab # [ 0.051101] iommu: DMA domain TLB invalidation policy: strict mode208gitlab # [ 0.063508] SCSI subsystem initialized209gitlab # [ 0.063934] usbcore: registered new interface driver usbfs210gitlab # [ 0.063959] usbcore: registered new interface driver hub211gitlab # [ 0.063975] usbcore: registered new device driver usb212gitlab # [ 0.064244] pps_core: LinuxPPS API ver. 1 registered213gitlab # [ 0.064248] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>214gitlab # [ 0.064256] PTP clock support registered215gitlab # [ 0.064299] EDAC MC: Ver: 3.0.0216gitlab # [ 0.064572] scmi_core: SCMI protocol bus registered217gitlab # [ 0.065131] FPGA manager framework218gitlab # [ 0.065846] vgaarb: loaded219gitlab # [ 0.067427] clocksource: Switched to clocksource arch_sys_counter220gitlab # [ 0.067888] VFS: Disk quotas dquot_6.6.0221gitlab # [ 0.067912] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)222gitlab # [ 0.068278] netfs: FS-Cache loaded223gitlab # [ 0.068366] pnp: PnP ACPI: disabled224gitlab # [ 0.074724] NET: Registered PF_INET protocol family225gitlab # [ 0.075551] IP idents hash table entries: 131072 (order: 8, 1048576 bytes, linear)226gitlab # [ 0.102956] tcp_listen_portaddr_hash hash table entries: 4096 (order: 4, 65536 bytes, linear)227gitlab # [ 0.103001] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)228gitlab # [ 0.103041] TCP established hash table entries: 65536 (order: 7, 524288 bytes, linear)229gitlab # [ 0.103297] TCP bind hash table entries: 65536 (order: 9, 2097152 bytes, linear)230gitlab # [ 0.103871] TCP: Hash tables configured (established 65536 bind 65536)231gitlab # [ 0.103950] MPTCP token hash table entries: 8192 (order: 6, 196608 bytes, linear)232gitlab # [ 0.103999] UDP hash table entries: 4096 (order: 6, 262144 bytes, linear)233gitlab # [ 0.104109] UDP-Lite hash table entries: 4096 (order: 6, 262144 bytes, linear)234gitlab # [ 0.104253] NET: Registered PF_UNIX/PF_LOCAL protocol family235gitlab # [ 0.104300] NET: Registered PF_XDP protocol family236gitlab # [ 0.104314] PCI: CLS 0 bytes, default 64237gitlab # [ 0.104556] Trying to unpack rootfs image as initramfs...238gitlab # [ 0.115528] kvm [1]: HYP mode not available239gitlab # [ 0.158231] Initialise system trusted keyrings240gitlab # [ 0.158643] workingset: timestamp_bits=42 max_order=21 bucket_order=0241gitlab # [ 0.160972] squashfs: version 4.0 (2009/01/31) Phillip Lougher242gitlab # [ 0.161173] 9p: Installing v9fs 9p2000 file system support243gitlab # [ 0.199371] Key type asymmetric registered244gitlab # [ 0.199382] Asymmetric key parser 'x509' registered245gitlab # [ 0.199738] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242)246gitlab # [ 0.200039] io scheduler mq-deadline registered247gitlab # [ 0.200052] io scheduler kyber registered248gitlab # [ 0.223040] pl061_gpio 9030000.pl061: PL061 GPIO chip registered249gitlab # [ 0.231498] ledtrig-cpu: registered to indicate activity on CPUs250gitlab # [ 0.232691] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges:251gitlab # [ 0.232727] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000252gitlab # [ 0.232752] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000253gitlab # [ 0.232768] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000254gitlab # [ 0.232834] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits255gitlab # [ 0.232882] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff]256gitlab # [ 0.233169] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00257gitlab # [ 0.233188] pci_bus 0000:00: root bus resource [bus 00-ff]258gitlab # [ 0.233299] pci_bus 0000:00: root bus resource [io 0x0000-0xffff]259gitlab # [ 0.233310] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff]260gitlab # [ 0.233320] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff]261gitlab # [ 0.233554] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint262gitlab # [ 0.235031] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint263gitlab # [ 0.235730] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f]264gitlab # [ 0.235767] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff]265gitlab # [ 0.235856] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]266gitlab # [ 0.235893] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref]267gitlab # [ 0.237523] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint268gitlab # [ 0.238194] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f]269gitlab # [ 0.238242] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff]270gitlab # [ 0.238321] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]271gitlab # [ 0.239879] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint272gitlab # [ 0.240546] pci 0000:00:03.0: BAR 0 [io 0x0000-0x001f]273gitlab # [ 0.240583] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff]274gitlab # [ 0.240664] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]275gitlab # [ 0.242227] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint276gitlab # [ 0.242879] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f]277gitlab # [ 0.242914] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff]278gitlab # [ 0.243014] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]279gitlab # [ 0.244654] pci 0000:00:05.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint280gitlab # [ 0.245325] pci 0000:00:05.0: BAR 0 [io 0x0000-0x007f]281gitlab # [ 0.245360] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff]282gitlab # [ 0.245452] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]283gitlab # [ 0.247022] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint284gitlab # [ 0.247686] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f]285gitlab # [ 0.247733] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff]286gitlab # [ 0.247815] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]287gitlab # [ 0.249361] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint288gitlab # [ 0.250010] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f]289gitlab # [ 0.250045] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff]290gitlab # [ 0.250126] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]291gitlab # [ 0.250164] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref]292gitlab # [ 0.251807] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint293gitlab # [ 0.252502] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff]294gitlab # [ 0.252592] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]295gitlab # [ 0.254122] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint296gitlab # [ 0.254732] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff]297gitlab # [ 0.254811] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]298gitlab # [ 0.256153] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint299gitlab # [ 0.256762] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff]300gitlab # [ 0.257575] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint301gitlab # [ 0.258268] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f]302gitlab # [ 0.258304] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff]303gitlab # [ 0.258382] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]304gitlab # [ 0.259945] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint305gitlab # [ 0.260547] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f]306gitlab # [ 0.260583] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff]307gitlab # [ 0.260661] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]308gitlab # [ 0.262565] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned309gitlab # [ 0.262583] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned310gitlab # [ 0.262594] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned311gitlab # [ 0.262726] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned312gitlab # [ 0.262859] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned313gitlab # [ 0.263005] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned314gitlab # [ 0.263134] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned315gitlab # [ 0.263282] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned316gitlab # [ 0.263410] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned317gitlab # [ 0.263604] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned318gitlab # [ 0.263757] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned319gitlab # [ 0.263901] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned320gitlab # [ 0.264077] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned321gitlab # [ 0.264261] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned322gitlab # [ 0.264314] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned323gitlab # [ 0.264365] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned324gitlab # [ 0.264420] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned325gitlab # [ 0.264471] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned326gitlab # [ 0.264524] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned327gitlab # [ 0.264590] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned328gitlab # [ 0.264644] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned329gitlab # [ 0.264709] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned330gitlab # [ 0.264765] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned331gitlab # [ 0.264820] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned332gitlab # [ 0.264874] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned333gitlab # [ 0.264927] pci 0000:00:05.0: BAR 0 [io 0x1000-0x107f]: assigned334gitlab # [ 0.265003] pci 0000:00:06.0: BAR 0 [io 0x1080-0x10ff]: assigned335gitlab # [ 0.265066] pci 0000:00:0b.0: BAR 0 [io 0x1100-0x113f]: assigned336gitlab # [ 0.265119] pci 0000:00:01.0: BAR 0 [io 0x1140-0x115f]: assigned337gitlab # [ 0.265182] pci 0000:00:02.0: BAR 0 [io 0x1160-0x117f]: assigned338gitlab # [ 0.265237] pci 0000:00:03.0: BAR 0 [io 0x1180-0x119f]: assigned339gitlab # [ 0.265290] pci 0000:00:04.0: BAR 0 [io 0x11a0-0x11bf]: assigned340gitlab # [ 0.265353] pci 0000:00:07.0: BAR 0 [io 0x11c0-0x11df]: assigned341gitlab # [ 0.265418] pci 0000:00:0c.0: BAR 0 [io 0x11e0-0x11ff]: assigned342gitlab # [ 0.265496] pci_bus 0000:00: resource 4 [io 0x0000-0xffff]343gitlab # [ 0.265511] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff]344gitlab # [ 0.265521] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff]345gitlab # [ 0.269460] pci 0000:00:0a.0: enabling device (0000 -> 0002)346gitlab # [ 0.299097] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003)347gitlab # [ 0.302971] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003)348gitlab # [ 0.306991] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003)349gitlab # [ 0.311906] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003)350gitlab # [ 0.316754] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003)351gitlab # [ 0.320431] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003)352gitlab # [ 0.325295] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003)353gitlab # [ 0.330347] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002)354gitlab # [ 0.334071] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002)355gitlab # [ 0.338427] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003)356gitlab # [ 0.343694] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003)357gitlab # [ 0.354113] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled358gitlab # [ 0.357771] msm_serial: driver initialized359gitlab # [ 0.358123] SuperH (H)SCI(F) driver initialized360gitlab # [ 0.358216] STM32 USART driver initialized361gitlab # [ 0.399993] loop: module loaded362gitlab # [ 0.400543] virtio_blk virtio4: 4/0/0 default/read/poll queues363gitlab # [ 0.405127] virtio_blk virtio4: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)364gitlab # [ 0.409415] virtio_blk virtio5: 4/0/0 default/read/poll queues365gitlab # [ 0.413813] virtio_blk virtio5: [vdb] 12227512 512-byte logical blocks (6.26 GB/5.83 GiB)366gitlab # [ 0.419063] megasas: 07.734.00.00-rc1367gitlab # [ 0.420902] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff]368gitlab # [ 0.426128] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000369gitlab # [ 0.426166] Intel/Sharp Extended Query Table at 0x0031370gitlab # [ 0.431184] Using buffer write method371gitlab # [ 0.431252] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff]372gitlab # [ 0.438053] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000373gitlab # [ 0.438088] Intel/Sharp Extended Query Table at 0x0031374gitlab # [ 0.442013] Using buffer write method375gitlab # [ 0.442048] Concatenating MTD devices:376gitlab # [ 0.442054] (0): "0.flash"377gitlab # [ 0.442061] (1): "0.flash"378gitlab # [ 0.442067] into device "0.flash"379gitlab # [ 0.570149] Freeing initrd memory: 27184K380gitlab # [ 0.582782] tun: Universal TUN/TAP device driver, 1.6381gitlab # [ 0.586751] thunder_xcv, ver 1.0382gitlab # [ 0.586800] thunder_bgx, ver 1.0383gitlab # [ 0.586824] nicpf, ver 1.0384gitlab # [ 0.587459] e1000: Intel(R) PRO/1000 Network Driver385gitlab # [ 0.587463] e1000: Copyright (c) 1999-2006 Intel Corporation.386gitlab # [ 0.587488] e1000e: Intel(R) PRO/1000 Network Driver387gitlab # [ 0.587494] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.388gitlab # [ 0.587518] igb: Intel(R) Gigabit Ethernet Network Driver389gitlab # [ 0.587521] igb: Copyright (c) 2007-2014 Intel Corporation.390gitlab # [ 0.587547] igbvf: Intel(R) Gigabit Virtual Function Network Driver391gitlab # [ 0.587551] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.392gitlab # [ 0.587687] sky2: driver version 1.30393gitlab # [ 0.589462] usbcore: registered new interface driver usb-storage394gitlab # [ 0.589591] usbcore: registered new interface driver usbserial_generic395gitlab # [ 0.589604] usbserial: USB Serial support registered for generic396gitlab # [ 0.590188] ehci-pci 0000:00:0a.0: EHCI Host Controller397gitlab # [ 0.590230] hv_vmbus: registering driver hyperv_keyboard398gitlab # [ 0.590232] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 1399gitlab # [ 0.590877] ehci-pci 0000:00:0a.0: irq 15, io mem 0x10089000400gitlab # [ 0.591220] rtc-pl031 9010000.pl031: registered as rtc0401gitlab # [ 0.591244] rtc-pl031 9010000.pl031: setting system clock to 2026-08-15T23:29:48 UTC (1786836588)402gitlab # [ 0.591575] i2c_dev: i2c /dev entries driver403gitlab # [ 0.594502] sdhci: Secure Digital Host Controller Interface driver404gitlab # [ 0.594508] sdhci: Copyright(c) Pierre Ossman405gitlab # [ 0.594784] Synopsys Designware Multimedia Card Interface Driver406gitlab # [ 0.595167] sdhci-pltfm: SDHCI platform and OF driver helper407gitlab # [ 0.596869] hid: raw HID events driver (C) Jiri Kosina408gitlab # [ 0.597142] usbcore: registered new interface driver usbhid409gitlab # [ 0.597146] usbhid: USB HID core driver410gitlab # [ 0.621101] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.00411gitlab # [ 0.621744] hub 1-0:1.0: USB hub found412gitlab # [ 0.621797] hub 1-0:1.0: 6 ports detected413gitlab # [ 0.622289] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available414gitlab # [ 0.627135] drop_monitor: Initializing network drop monitor service415gitlab # [ 0.627741] NET: Registered PF_INET6 protocol family416gitlab # [ 0.629574] Segment Routing with IPv6417gitlab # [ 0.629609] In-situ OAM (IOAM) with IPv6418gitlab # [ 0.629766] NET: Registered PF_PACKET protocol family419gitlab # [ 0.629986] 9pnet: Installing 9P2000 support420gitlab # [ 0.634489] Key type dns_resolver registered421gitlab # [ 0.653130] registered taskstats version 1422gitlab # [ 0.653725] Loading compiled-in X.509 certificates423gitlab # [ 0.679223] Demotion targets for Node 0: null424gitlab # [ 0.679485] Key type .fscrypt registered425gitlab # [ 0.679493] Key type fscrypt-provisioning registered426gitlab # [ 0.679721] ima: No TPM chip found, activating TPM-bypass!427gitlab # [ 0.679745] ima: Allocated hash algorithm: sha1428gitlab # [ 0.679777] ima: No architecture policies found429gitlab # [ 0.681341] input: gpio-keys as /devices/platform/gpio-keys/input/input0430gitlab # [ 0.712225] clk: Disabling unused clocks431gitlab # [ 0.712257] PM: genpd: Disabling unused power domains432gitlab # [ 0.717830] Freeing unused kernel memory: 4736K433gitlab # [ 0.718083] Run /init as init process434gitlab # [ 0.758147] systemd[1]: Successfully made /usr/ read-only.435gitlab # [ 0.867553] usb 1-1: new high-speed USB device number 2 using ehci-pci436gitlab # [ 1.021689] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input1437gitlab # [ 1.092955] systemd[1]: systemd 261.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)438gitlab # [ 1.093019] systemd[1]: Detected virtualization qemu.439gitlab # [ 1.093092] systemd[1]: Detected architecture arm64.440gitlab # [ 1.093107] systemd[1]: Running in initrd.441gitlab # [ 1.093941] systemd[1]: Initializing machine ID from random generator.442gitlab # [ 1.094305] systemd[1]: Hostname set to <gitlab>.443gitlab # [ 1.159505] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input0444gitlab # [ 1.283544] usb 1-2: new high-speed USB device number 3 using ehci-pci445gitlab # [ 1.319174] systemd[1]: bpf-restrict-fs: LSM BPF program attached446gitlab # [ 1.422662] systemd[1]: Queued start job for default target Initrd Default Target.447gitlab # [ 1.435505] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input2448gitlab # [ 1.436021] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input0449gitlab # [ 1.440276] systemd[1]: Created slice Slice /system/modprobe.450gitlab # [ 1.440647] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.451gitlab # [ 1.440707] systemd[1]: Expecting device /dev/disk/by-label/nix-store...452gitlab # [ 1.440730] systemd[1]: Expecting device /dev/disk/by-label/nixos...453gitlab # [ 1.440767] systemd[1]: Reached target Path Units.454gitlab # [ 1.440795] systemd[1]: Reached target Slice Units.455gitlab # [ 1.440827] systemd[1]: Reached target Swaps.456gitlab # [ 1.440857] systemd[1]: Reached target Timer Units.457gitlab # [ 1.441138] systemd[1]: Listening on D-Bus System Message Bus Socket.458gitlab # [ 1.441460] systemd[1]: Listening on Journal Socket (/dev/log).459gitlab # [ 1.441709] systemd[1]: Listening on Journal Sockets.460gitlab # [ 1.441949] systemd[1]: Listening on udev Control Socket.461gitlab # [ 1.442090] systemd[1]: Listening on udev Kernel Socket.462gitlab # [ 1.442122] systemd[1]: Reached target Socket Units.463gitlab # [ 1.444864] systemd[1]: Starting Create List of Static Device Nodes...464gitlab # [ 1.447666] systemd[1]: Starting Load Kernel Module 9pnet_virtio...465gitlab # [ 1.447785] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs466gitlab # [ 1.450574] systemd[1]: Mounting Kernel Configuration File System...467gitlab # [ 1.481813] systemd[1]: Starting Journal Service...468gitlab # [ 1.485589] systemd[1]: Starting Load Kernel Modules...469gitlab # [ 1.485785] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os470gitlab # [ 1.489085] systemd[1]: Starting Coldplug All udev Devices...471gitlab # [ 1.497867] systemd[1]: Finished Create List of Static Device Nodes.472gitlab # [ 1.500738] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.473gitlab # [ 1.501666] systemd[1]: Finished Load Kernel Module 9pnet_virtio.474gitlab # [ 1.502323] systemd[1]: Mounted Kernel Configuration File System.475gitlab # [ 1.507733] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...476gitlab # [ 1.516473] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.477gitlab # [ 1.516809] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev478gitlab # [ 1.539196] systemd-journald[95]: Collecting audit messages is disabled.479gitlab # [ 1.539234] [drm] pci: virtio-gpu-pci detected at 0000:00:08.0480gitlab # [ 1.539638] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.481gitlab # [ 1.543628] systemd[1]: Starting Create Static Device Nodes in /dev...482gitlab # [ 1.547793] [drm] features: -virgl +edid -resource_blob -host_visible483gitlab # [ 1.547802] [drm] features: -context_init484gitlab # [ 1.549346] [drm] number of scanouts: 1485gitlab # [ 1.549368] [drm] number of cap sets: 0486gitlab # [ 1.550267] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic487gitlab # [ 1.550279] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 0488gitlab # [ 1.557594] Console: switching to colour frame buffer device 160x50489gitlab # [ 1.565127] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device490gitlab # [ 1.580788] systemd[1]: Finished Load Kernel Modules.491gitlab # [ 1.584359] systemd[1]: Finished Create Static Device Nodes in /dev.492gitlab # [ 1.584731] systemd[1]: Reached target Preparation for Local File Systems.493gitlab # [ 1.585301] systemd[1]: Reached target Local File Systems.494gitlab # [ 1.589268] systemd[1]: Starting Apply Kernel Variables...495gitlab # [ 1.597962] systemd[1]: Starting Rule-based Manager for Device Events and Files...496gitlab # [ 1.613750] systemd-modules-load[96]: Using 4 probe threads497gitlab # [ 1.615032] systemd-modules-load[96]: Module 'virtio_balloon' is built in498gitlab # [ 1.615747] systemd[1]: Started Journal Service.499gitlab # [ 1.616276] systemd-modules-load[96]: Module 'virtio_console' is built in500gitlab # [ 1.618933] systemd-modules-load[96]: Module 'virtio_rng' is built in501gitlab # [ 1.620083] systemd-modules-load[96]: Inserted module 'dm_mod'502gitlab # [ 1.621143] systemd-modules-load[96]: Inserted module 'virtio_gpu'503gitlab # [ 1.629584] systemd[1]: Starting Create System Files and Directories...504gitlab # [ 1.640923] systemd[1]: Finished Apply Kernel Variables.505gitlab # [ 1.644149] systemd[1]: Finished Create System Files and Directories.506gitlab # [ 1.651234] systemd-udevd[107]: Using default interface naming scheme 'v261'.507gitlab # [ 1.665827] systemd[1]: Started Rule-based Manager for Device Events and Files.508gitlab # [ 1.686824] systemd[1]: Starting Virtual Console Setup...509gitlab # [ 1.734844] systemd-vconsole-setup[129]: Configuration of first virtual console was skipped, ignoring remaining ones.510gitlab # [ 1.741529] systemd[1]: Finished Virtual Console Setup.511gitlab # [ 2.133065] systemd[1]: Finished Coldplug All udev Devices.512gitlab # [ 2.135599] systemd[1]: Reached target System Initialization.513gitlab # [ 2.138223] systemd[1]: Reached target Basic System.514gitlab # [ 2.364961] (udev-worker)[120]: Network interface NamePolicy= disabled on kernel command line.515gitlab # [ 2.370119] (udev-worker)[143]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.516gitlab # [ 2.375225] (udev-worker)[143]: Network interface NamePolicy= disabled on kernel command line.517gitlab # [ 2.386351] systemd[1]: Found device /dev/disk/by-label/nixos.518gitlab # [ 2.396098] systemd[1]: Found device /dev/disk/by-label/nix-store.519gitlab # [ 2.416082] systemd[1]: Reached target Initrd Root Device.520gitlab # [ 2.419074] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...521gitlab # [ 2.471183] systemd-fsck[151]: nixos: clean, 12/65536 files, 13019/262144 blocks522gitlab # [ 2.473635] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.523gitlab # [ 2.489597] systemd[1]: Mounting /sysroot...524gitlab # [ 2.534401] EXT4-fs (vda): mounted filesystem 683253c4-e500-4d06-8d15-7fb3e66e0f7a r/w with ordered data mode. Quota mode: none.525gitlab # [ 2.534774] systemd[1]: Mounted /sysroot.526gitlab # [ 2.536411] systemd[1]: Reached target Initrd Root File System.527gitlab # [ 2.540813] systemd[1]: Mounting /sysroot/nix/.ro-store...528gitlab # [ 2.545091] systemd[1]: Mounting /sysroot/nix/.rw-store...529gitlab # [ 2.564511] systemd[1]: Mounting /sysroot/run...530gitlab # [ 2.573533] systemd[1]: Mounting /sysroot/tmp/shared...531gitlab # [ 2.584084] systemd[1]: Mounting /sysroot/tmp/xchg...532gitlab # [ 2.585161] systemd[1]: Starting Mountpoints Configured in the Real Root...533gitlab # [ 2.586452] systemd[1]: Mounted /sysroot/nix/.rw-store.534gitlab # [ 2.587416] systemd[1]: Mounted /sysroot/run.535gitlab # [ 2.593983] systemd[1]: Starting rw-sysroot-nix-store.service...536gitlab # [ 2.600164] systemd-sysroot-fstab-check[165]: /sysroot should be mounted in the initrd, will request daemon-reload.537gitlab # [ 2.602422] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.538gitlab # [ 2.603643] systemd[1]: Finished rw-sysroot-nix-store.service.[ 2.607162] erofs (device vdb): mounted with root inode @ nid 128.539gitlab # 540gitlab # [ 2.610624] systemd[1]: Mounted /sysroot/nix/.ro-store.541gitlab # [ 2.612372] systemd[1]: Mounted /sysroot/tmp/shared.542gitlab # [ 2.613220] systemd[1]: Mounted /sysroot/tmp/xchg.543gitlab # [ 2.614004] systemd[1]: Reload requested from client PID 165 ('systemd-sysroot') (unit initrd-parse-etc.service)...544gitlab # [ 2.615639] systemd[1]: Reloading...545gitlab # [ 2.708638] systemd[1]: Reloading finished in 94 ms.546gitlab # [ 2.760308] systemd-sysroot-fstab-check[165]: Requesting initrd-fs.target/start/replace...547gitlab # [ 2.765481] systemd-sysroot-fstab-check[165]: Requesting swap.target/start/replace...548gitlab # [ 2.768542] systemd[1]: Starting rw-sysroot-nix-store.service...549gitlab # [ 2.771686] systemd[1]: initrd-parse-etc.service: Deactivated successfully.550gitlab # [ 2.773717] systemd[1]: Finished Mountpoints Configured in the Real Root.551gitlab # [ 2.775708] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies.552gitlab # [ 2.788149] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.553gitlab # [ 2.789821] systemd[1]: Finished rw-sysroot-nix-store.service.554gitlab # [ 2.942393] (udev-worker)[144]: mtd0ro: Failed to find and pin callout binary "/nix/store/x3ma60wd3w0db1m4dr1xln72q96lnm3b-systemd-261.1/lib/udev/mtd_probe": No such file or directory555gitlab # [ 2.945427] (udev-worker)[144]: mtd0ro: /nix/store/x3ma60wd3w0db1m4dr1xln72q96lnm3b-systemd-261.1/lib/udev/rules.d/75-probe_mtd.rules:5 IMPORT{program}="mtd_probe $devnode": Failed to execute "mtd_probe /dev/mtd0ro", ignoring: No such file or directory556gitlab # [ 2.952766] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.557gitlab # [ 2.954187] systemd[1]: Stopped Virtual Console Setup.558gitlab # [ 2.955143] systemd[1]: Stopping Virtual Console Setup...559gitlab # [ 2.956096] systemd[1]: Starting Virtual Console Setup...560gitlab # [ 2.993039] systemd-vconsole-setup[197]: Configuration of first virtual console was skipped, ignoring remaining ones.561gitlab # [ 2.995216] systemd[1]: Finished Virtual Console Setup.562gitlab # [ 3.495575] systemd[1]: Mounting /sysroot/nix/store...563gitlab # [ 3.563939] systemd[1]: Mounted /sysroot/nix/store.564gitlab # [ 3.566240] systemd[1]: Reached target Initrd File Systems.565gitlab # [ 3.568878] systemd[1]: Starting Find NixOS closure...566gitlab # [ 3.571370] systemd[1]: Starting Create Volatile Files and Directories in the Real Root...567gitlab # [ 3.612638] systemd[1]: Finished Create Volatile Files and Directories in the Real Root.568gitlab # [ 3.616395] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully.569gitlab # [ 3.636818] systemd[1]: Finished Find NixOS closure.570gitlab # [ 3.639110] systemd[1]: Reached target Initrd Default Target.571gitlab # [ 3.641914] systemd[1]: Starting Cleaning Up and Shutting Down Daemons...572gitlab # [ 3.688497] systemd[1]: Stopped target Initrd Default Target.573gitlab # [ 3.691336] systemd[1]: Stopped target Basic System.574gitlab # [ 3.693776] systemd[1]: Stopped target Initrd Root Device.575gitlab # [ 3.696160] systemd[1]: Stopped target Path Units.576gitlab # [ 3.698277] systemd[1]: systemd-ask-password-console.path: Deactivated successfully.577gitlab # [ 3.701620] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch.578gitlab # [ 3.704929] systemd[1]: Stopped target Slice Units.579gitlab # [ 3.707080] systemd[1]: Stopped target Socket Units.580gitlab # [ 3.711076] systemd[1]: Stopped target System Initialization.581gitlab # [ 3.715271] systemd[1]: Stopped target Swaps.582gitlab # [ 3.719946] systemd[1]: Stopped target Timer Units.583gitlab # [ 3.723537] systemd[1]: dbus.socket: Deactivated successfully.584gitlab # [ 3.727613] systemd[1]: Closed D-Bus System Message Bus Socket.585gitlab # [ 3.730665] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully.586gitlab # [ 3.734095] systemd[1]: Stopped Find NixOS closure.587gitlab # [ 3.735889] systemd[1]: Starting Load Kernel Module 9pnet_virtio...588gitlab # [ 3.738478] systemd[1]: Starting rw-sysroot-nix-store.service...589gitlab # [ 3.740523] systemd[1]: systemd-sysctl.service: Deactivated successfully.590gitlab # [ 3.742790] systemd[1]: Stopped Apply Kernel Variables.591gitlab # [ 3.744455] systemd[1]: systemd-modules-load.service: Deactivated successfully.592gitlab # [ 3.746604] systemd[1]: Stopped Load Kernel Modules.593gitlab # [ 3.748137] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully.594gitlab # [ 3.750473] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root.595gitlab # [ 3.752711] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully.596gitlab # [ 3.754635] systemd[1]: Stopped Create System Files and Directories.597gitlab # [ 3.756268] systemd[1]: Stopped target Local File Systems.598gitlab # [ 3.757804] systemd[1]: Stopped target Preparation for Local File Systems.599gitlab # [ 3.759424] systemd[1]: systemd-udev-trigger.service: Deactivated successfully.600gitlab # [ 3.761238] systemd[1]: Stopped Coldplug All udev Devices.601gitlab # [ 3.762549] systemd[1]: Stopping Rule-based Manager for Device Events and Files...602gitlab # [ 3.764244] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.603gitlab # [ 3.765901] systemd[1]: Stopped Virtual Console Setup.604gitlab # [ 3.767037] systemd[1]: initrd-cleanup.service: Deactivated successfully.605gitlab # [ 3.768518] systemd[1]: Finished Cleaning Up and Shutting Down Daemons.606gitlab # [ 3.769958] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.607gitlab # [ 3.771415] systemd[1]: Finished rw-sysroot-nix-store.service.608gitlab # [ 3.772701] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.609gitlab # [ 3.774182] systemd[1]: Finished Load Kernel Module 9pnet_virtio.610gitlab # [ 3.775384] systemd[1]: systemd-udevd.service: Deactivated successfully.611gitlab # [ 3.776749] systemd[1]: Stopped Rule-based Manager for Device Events and Files.612gitlab # [ 3.778133] systemd[1]: systemd-udevd.service: Consumed 2.229s CPU time over 2.155s wall clock time, 31.4M memory peak.613gitlab # [ 3.780044] systemd[1]: systemd-udevd-control.socket: Deactivated successfully.614gitlab # [ 3.781383] systemd[1]: Closed udev Control Socket.615gitlab # [ 3.782339] systemd[1]: Starting Cleanup udev Database...616gitlab # [ 3.783475] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully.617gitlab # [ 3.784906] systemd[1]: Stopped Create Static Device Nodes in /dev.618gitlab # [ 3.786019] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully.619gitlab # [ 3.787380] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully.620gitlab # [ 3.788635] systemd[1]: kmod-static-nodes.service: Deactivated successfully.621gitlab # [ 3.789838] systemd[1]: Stopped Create List of Static Device Nodes.622gitlab # [ 3.855863] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully.623gitlab # [ 3.859377] systemd[1]: Finished Cleanup udev Database.624gitlab # [ 3.861792] systemd[1]: Reached target Switch Root.625gitlab # [ 3.863920] systemd[1]: Starting NixOS Activation...626gitlab # [ 4.038137] initrd-nixos-activation-start[222]: booting system configuration /nix/store/vx40h6r50a12nm7hl0byzzgygph8vrlf-nixos-system-gitlab-test627gitlab # [ 4.098344] initrd-nixos-activation-start[222]: running activation script...628gitlab # [ 4.424545] initrd-nixos-activation-start[245]: setting up /etc...629gitlab # [ 4.575711] systemd[1]: initrd-nixos-activation.service: Deactivated successfully.630gitlab # [ 4.579394] systemd[1]: Finished NixOS Activation.631gitlab # [ 4.581897] systemd[1]: Starting Switch Root...632gitlab # [ 4.648673] systemd[1]: Switching root.633gitlab # [ 4.820338] systemd-journald[95]: Received SIGTERM from PID 1 (systemd).634gitlab # [ 5.427963] systemd[1]: systemd 261.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)635gitlab # [ 5.428096] systemd[1]: Detected virtualization qemu.636gitlab # [ 5.428167] systemd[1]: Detected architecture arm64.637gitlab # [ 5.428330] systemd[1]: Detected first boot.638gitlab # [ 5.429672] systemd[1]: Initializing machine ID from random generator.639gitlab # [ 5.705218] systemd[1]: bpf-restrict-fs: LSM BPF program attached640gitlab # [ 5.835933] systemd[1]: Applying preset policy.641gitlab # [ 6.024229] systemd[1]: Populated /etc with preset unit settings.642gitlab # [ 6.231888] systemd[1]: initrd-switch-root.service: Deactivated successfully.643gitlab # [ 6.232195] systemd[1]: Stopped initrd-switch-root.service.644gitlab # [ 6.234064] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1.645gitlab # [ 6.240715] systemd[1]: Created slice Slice /system/getty.646gitlab # [ 6.243775] systemd[1]: Created slice GitLab DevOps Platform Slice.647gitlab # [ 6.247053] systemd[1]: Created slice User and Session Slice.648gitlab # [ 6.248799] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.649gitlab # [ 6.249940] systemd[1]: Started Forward Password Requests to Wall Directory Watch.650gitlab # [ 6.250698] systemd[1]: Expecting device /dev/hvc0...651gitlab # [ 6.251371] systemd[1]: Expecting device /dev/ttyAMA0...652gitlab # [ 6.252305] systemd[1]: Reached target Local Encrypted Volumes.653gitlab # [ 6.253424] systemd[1]: Stopped target initrd-fs.target.654gitlab # [ 6.254468] systemd[1]: Stopped target initrd-root-fs.target.655gitlab # [ 6.255546] systemd[1]: Stopped target initrd-switch-root.target.656gitlab # [ 6.256603] systemd[1]: Reached target Virtual Machines and Containers.657gitlab # [ 6.257701] systemd[1]: Reached target Path Units.658gitlab # [ 6.258764] systemd[1]: Reached target Remote File Systems.659gitlab # [ 6.259816] systemd[1]: Reached target Slice Units.660gitlab # [ 6.260837] systemd[1]: Reached target Swaps.661gitlab # [ 6.264700] systemd[1]: Listening on Query the User Interactively for a Password.662gitlab # [ 6.268709] systemd[1]: Listening on Process Core Dump Socket.663gitlab # [ 6.271787] systemd[1]: Listening on Credential Encryption/Decryption.664gitlab # [ 6.275189] systemd[1]: Listening on Factory Reset Management.665gitlab # [ 6.276504] systemd[1]: Listening on Hostname Service Socket.666gitlab # [ 6.287115] systemd[1]: Starting Journal Log Access Socket...667gitlab # [ 6.289382] systemd[1]: Listening on Journal Audit Socket.668gitlab # [ 6.292498] systemd[1]: Listening on Console Output Muting Service Socket.669gitlab # [ 6.293530] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket.670gitlab # [ 6.294208] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os671gitlab # [ 6.294946] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki672gitlab # [ 6.301162] systemd[1]: Listening on Disk Repartitioning Service Socket.673gitlab # [ 6.302581] systemd[1]: Listening on udev Control Socket.674gitlab # [ 6.303913] systemd[1]: Listening on udev Varlink Socket.675gitlab # [ 6.347916] systemd[1]: Mounting Huge Pages File System...676gitlab # [ 6.353284] systemd[1]: Mounting POSIX Message Queue File System...677gitlab # [ 6.359088] systemd[1]: Mounting Kernel Debug File System...678gitlab # [ 6.367780] systemd[1]: Mounting Kernel Trace File System...679gitlab # [ 6.380920] systemd[1]: Starting Create List of Static Device Nodes...680gitlab # [ 6.387206] systemd[1]: Starting Load Kernel Module 9pnet_virtio...681gitlab # [ 6.388410] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs682gitlab # [ 6.403789] systemd[1]: Mounting Kernel Configuration File System...683gitlab # [ 6.405048] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm684gitlab # [ 6.406163] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore685gitlab # [ 6.429678] systemd[1]: Starting Load Kernel Module fuse...686gitlab # [ 6.430944] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67687gitlab # [ 6.442469] systemd[1]: Starting Journal Service...688gitlab # [ 6.447637] systemd[1]: Starting Load Kernel Modules...689gitlab # [ 6.454581] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer...690gitlab # [ 6.463733] systemd[1]: Starting Remount Root and Kernel File Systems...691gitlab # [ 6.464675] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os692gitlab # [ 6.483663] fuse: init (API version 7.45)693gitlab # [ 6.484663] systemd[1]: Starting Coldplug All udev Devices...694gitlab # [ 6.489989] systemd[1]: Listening on Journal Log Access Socket.695gitlab # [ 6.492208] systemd[1]: Mounted Huge Pages File System.696gitlab # [ 6.493246] systemd[1]: Mounted POSIX Message Queue File System.697gitlab # [ 6.494190] systemd[1]: Mounted Kernel Debug File System.698gitlab # [ 6.495062] systemd[1]: Mounted Kernel Trace File System.699gitlab # [ 6.496543] systemd[1]: Finished Create List of Static Device Nodes.700gitlab # [ 6.497798] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.701gitlab # [ 6.498923] systemd[1]: Finished Load Kernel Module 9pnet_virtio.702gitlab # [ 6.502051] systemd[1]: Mounted Kernel Configuration File System.703gitlab # [ 6.503015] systemd-journald[318]: Collecting audit messages is enabled.704gitlab # [ 6.503329] systemd[1]: modprobe@fuse.service: Deactivated successfully.705gitlab # [ 6.505848] systemd[1]: Finished Load Kernel Module fuse.706gitlab # [ 6.513183] systemd[1]: Mounting FUSE Control File System...707gitlab # [ 6.531688] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...708gitlab # [ 6.533242] systemd[1]: Finished Load Kernel Modules.709gitlab # [ 6.545412] systemd[1]: Starting Firewall...710gitlab # [ 6.542981] systemd[1]: Queued start job for default target Multi-User System.711gitlab # [ 6.549466] systemd[1]: Unnecessary job was removed for /dev/vdb.712gitlab # [ 6.555780] EXT4-fs (vda): re-mounted 683253c4-e500-4d06-8d15-7fb3e66e0f7a.713gitlab # [ 6.557002] systemd[1]: Starting Apply Kernel Variables...714gitlab # [ 6.556335] systemd[1]: systemd-journald.service: Deactivated successfully.[ 6.561907] systemd[1]: Started Journal Service.715gitlab # 716gitlab # [ 6.566097] systemd-modules-load[319]: Using 3 probe threads717gitlab # [ 6.570258] systemd-modules-load[319]: Module 'atkbd' is built in718gitlab # [ 6.573710] systemd-modules-load[319]: Module 'loop' is built in719gitlab # [ 6.576622] systemd-modules-load[319]: Inserted module 'tls'720gitlab # [ 6.580048] systemd-oomd[320]: No swap; memory pressure usage will be degraded721gitlab # [ 6.586373] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer.722gitlab # [ 6.587615] systemd[1]: Finished Remount Root and Kernel File Systems.723gitlab # [ 6.589486] systemd[1]: Mounted FUSE Control File System.724gitlab # [ 6.590885] systemd[1]: Listening on Disk Image Download Service Socket.725gitlab # [ 6.592198] systemd[1]: Starting Flush Journal to Persistent Storage...726gitlab # [ 6.593520] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore727gitlab # [ 6.595498] systemd[1]: Starting Load/Save OS Random Seed...728gitlab # [ 6.596636] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os729gitlab # [ 6.601581] systemd[1]: Finished Apply Kernel Variables.730gitlab # [ 6.603521] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.731gitlab # [ 6.606107] systemd[1]: Starting Create Static Device Nodes in /dev...732gitlab # [ 6.613835] systemd-journald[318]: Received client request to flush runtime journal.733gitlab # [ 6.647379] systemd[1]: Finished Create Static Device Nodes in /dev.734gitlab # [ 6.650369] systemd[1]: Finished Load/Save OS Random Seed.735gitlab # [ 6.651508] systemd[1]: Reached target First Boot Complete.736gitlab # [ 6.652624] systemd[1]: Reached target Preparation for Local File Systems.737gitlab # [ 6.653651] systemd[1]: Starting Rule-based Manager for Device Events and Files...738gitlab # [ 6.654734] systemd[1]: Finished Flush Journal to Persistent Storage.739gitlab # [ 6.711903] systemd-udevd[359]: Using default interface naming scheme 'v261'.740gitlab # [ 6.767524] systemd[1]: Started Rule-based Manager for Device Events and Files.741gitlab # [ 6.939331] systemd[1]: Finished Firewall.742gitlab # [ 7.150524] systemd[1]: Finished Coldplug All udev Devices.743gitlab # [ 7.237301] systemd[1]: Mounting /run/wrappers...744gitlab # [ 7.249113] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs745gitlab # [ 7.275504] systemd[1]: Mounted /run/wrappers.746gitlab # [ 7.277869] systemd[1]: Reached target Local File Systems.747gitlab # [ 7.279435] systemd[1]: Listening on Boot Loader Control Service Socket.748gitlab # [ 7.285750] systemd[1]: Starting register-nix-paths.service...749gitlab # [ 7.292363] systemd[1]: Starting Create SUID/SGID Wrappers...750gitlab # [ 7.296267] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met.751gitlab # [ 7.302455] systemd[1]: Starting Save Transient machine-id to Disk...752gitlab # [ 7.316309] systemd[1]: Starting Create System Files and Directories...753gitlab # [ 7.364197] systemd[1]: etc-machine\x2did.mount: Deactivated successfully.754gitlab # [ 7.365807] systemd[1]: Finished Save Transient machine-id to Disk.755gitlab # [ 7.367400] systemd[1]: Condition check resulted in /dev/hvc0 being skipped.756gitlab # [ 7.371295] systemd[1]: Finished Create System Files and Directories.757gitlab # [ 7.423394] systemd[1]: Condition check resulted in /dev/ttyAMA0 being skipped.758gitlab # [ 7.430870] systemd[1]: Starting Rebuild Journal Catalog...759gitlab # [ 7.432600] systemd[1]: Starting Record System Boot/Shutdown in UTMP...760gitlab # [ 7.463017] systemd[1]: Finished Record System Boot/Shutdown in UTMP.761gitlab # [ 7.468180] (udev-worker)[418]: Network interface NamePolicy= disabled on kernel command line.762gitlab # [ 7.482196] systemd[1]: Finished Rebuild Journal Catalog.763gitlab # [ 7.488094] systemd[1]: Starting Update is Completed...764gitlab # [ 7.491101] (udev-worker)[424]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.765gitlab # [ 7.493918] (udev-worker)[424]: Network interface NamePolicy= disabled on kernel command line.766gitlab # [ 7.521039] systemd[1]: Finished Update is Completed.767gitlab # [ 7.528959] systemd[1]: Condition check resulted in Virtio network device being skipped.768gitlab # [ 7.531639] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore769gitlab # [ 7.534014] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met.770gitlab # [ 7.535597] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67771gitlab # [ 7.538522] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore772gitlab # [ 7.540365] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os773gitlab # [ 7.541697] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os774gitlab # [ 7.543217] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully.775gitlab # [ 7.544342] systemd[1]: Finished Create SUID/SGID Wrappers.776gitlab # [ 7.545148] systemd[1]: suid-sgid-wrappers.service: Consumed 156ms CPU time over 238ms wall clock time, 6.3M memory peak, 1.9M read from disk.777gitlab # [ 7.568570] mousedev: PS/2 mouse device common for all mice778gitlab # [ 7.750799] systemd[1]: Finished register-nix-paths.service.779gitlab # [ 7.753191] systemd[1]: Reached target System Initialization.780gitlab # [ 7.756176] systemd[1]: Started Discard unused filesystem blocks once a week.781gitlab # [ 7.757477] systemd[1]: Started logrotate.timer.782gitlab # [ 7.758322] systemd[1]: Started Daily Cleanup of Temporary Directories.783gitlab # [ 7.759429] systemd[1]: Reached target Timer Units.784gitlab # [ 7.761640] systemd[1]: Listening on D-Bus System Message Bus Socket.785gitlab # [ 7.762763] systemd[1]: Listening on Nix Daemon Socket.786gitlab # [ 7.779703] systemd[1]: Starting nixbot CI service socket...787gitlab # [ 7.780923] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket.788gitlab # [ 7.783951] systemd[1]: Listening on nixbot CI service socket.789gitlab # [ 7.785009] systemd[1]: Reached target Socket Units.790gitlab # [ 7.788312] systemd[1]: Starting D-Bus System Message Bus...791gitlab # [ 7.822741] dbus-broker-launch[562]: Looking up NSS user entry for 'systemd-timesync'...792gitlab # [ 7.824331] dbus-broker-launch[562]: NSS returned no entry for 'systemd-timesync'793gitlab # [ 7.825989] dbus-broker-launch[562]: Invalid user-name in /nix/store/9zcyylhndlnizbwn48627991zr1jxg4p-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync"794gitlab # [ 7.830310] systemd[1]: Started D-Bus System Message Bus.795gitlab # [ 7.838800] dbus-broker-launch[562]: Ready796gitlab # [ 7.839648] systemd[1]: Reached target Basic System.797gitlab # [ 7.842518] systemd[1]: Started backdoor.service.798gitlab # [ 7.843706] systemd[1]: Starting gitlab-config.service...799gitlab # [ 7.864374] systemd[1]: Starting Import lastlog data into lastlog2 database...800gitlab # [ 7.867056] systemd[1]: Starting Logrotate configuration check...801gitlab # [ 7.876164] systemd[1]: Starting Name Service Cache Daemon (nsncd)...802gitlab # [ 7.881094] systemd[1]: Starting Post-Boot Actions...803gitlab # [ 7.883675] logrotate[567]: warning: logrotate in debug mode does nothing except printing debug messages! Consider using verbose mode (-v) instead if this is not what you want.804gitlab # connecting to host...805gitlab # [ 7.892367] logrotate[567]: reading config file /nix/store/22afkmbkaxyx50bj9lbkkpmz7pd69hsf-logrotate.conf806gitlab # [ 7.893709] logrotate[567]: note: 'monthly' overrides previously specified 'weekly'807gitlab # [ 7.894767] logrotate[567]: Reading state from file: /var/lib/logrotate.status808gitlab # [ 7.895833] logrotate[567]: state file /var/lib/logrotate.status does not exist809gitlab # [ 7.897144] logrotate[567]: Allocating hash table for state file, size 64 entries810gitlab # [ 7.898345] logrotate[567]: Handling 4 logs811gitlab # [ 7.899136] logrotate[567]: rotating pattern: "/var/log/btmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed812gitlab # [ 7.901306] logrotate[567]: considering log /var/log/btmp813gitlab # [ 7.902090] logrotate[567]: Creating new state814gitlab # [ 7.902702] logrotate[567]: Now: 2026-08-15 23:29815gitlab # [ 7.903385] logrotate[567]: Last rotated at 2026-08-15 23:00816gitlab # [ 7.904199] logrotate[567]: log does not need rotating (log has already been rotated)817gitlab: Guest shell says: b'Spawning backdoor root shell...\n'818gitlab # [ 7.905218] logrotate[567]: rotating pattern: "/var/log/wtmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed819gitlab # [ 7.907283] logrotate[567]: considering log /var/log/wtmp820gitlab # [ 7.908063] logrotate[567]: Creating new state821gitlab # [ 7.908623] logrotate[567]: Now: 2026-08-15 23:29822gitlab: connected to guest root shell823gitlab # [ 7.909306] logrotate[567]: Last rotated at 2026-08-15 23:00824gitlab: (connecting took 8.36 seconds)825gitlab # [ 7.910066] logrotate[567]: log does not need rotating (log has already been rotated)826gitlab: (finished: waiting for the VM to finish booting, in 8.37 seconds)827gitlab # [ 7.910991] logrotate[567]: rotating pattern: "/var/gitlab/state/log/*.log" after 1 days empty log files are not rotated, (30 rotations), old logs are removed828gitlab # [ 7.912705] logrotate[567]: switching euid from 0 to 165 and egid from 0 to 165 (pid 567)829gitlab # [ 7.913681] logrotate[567]: considering log /var/gitlab/state/log/*.log830gitlab # [ 7.914481] logrotate[567]: log /var/gitlab/state/log/*.log does not exist -- skipping831gitlab # [ 7.915427] logrotate[567]: Creating new state832gitlab # [ 7.915979] logrotate[567]: switching euid from 165 to 0 and egid from 165 to 0 (pid 567)833gitlab # [ 7.918130] logrotate[567]: rotating pattern: "/var/log/nginx/*.log" weekly empty log files are not rotated, (26 rotations), old logs are removed834gitlab # [ 7.919635] logrotate[567]: switching euid from 0 to 60 and egid from 0 to 60 (pid 567)835gitlab # [ 7.920879] logrotate[567]: considering log /var/log/nginx/*.log836gitlab # [ 7.921622] logrotate[567]: log /var/log/nginx/*.log does not exist -- skipping837gitlab # [ 7.922498] logrotate[567]: Creating new state838gitlab # [ 7.923051] logrotate[567]: not running postrotate script, since no logs were rotated839gitlab # [ 7.923961] logrotate[567]: switching euid from 60 to 0 and egid from 60 to 0 (pid 567)840gitlab # [ 7.925525] nsncd[568]: Aug 15 23:29:55.832 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"841gitlab # [ 7.927304] systemd[1]: Started Reset console on configuration changes.842gitlab # [ 7.932191] systemd[1]: Starting resolvconf update...843gitlab # [ 7.933208] systemd[1]: Finished Logrotate configuration check.844gitlab # [ 7.934242] systemd[1]: Finished Post-Boot Actions.845gitlab # [ 7.935019] systemd[1]: Started Name Service Cache Daemon (nsncd).846gitlab # [ 7.938720] systemd[1]: Reached target Host and Network Name Lookups.847gitlab # [ 7.939696] systemd[1]: Reached target User and Group Name Lookups.848gitlab # [ 7.949891] systemd[1]: Starting User Login Management...849gitlab # [ 7.950896] systemd[1]: Finished Import lastlog data into lastlog2 database.850gitlab # [ 8.009865] systemd-logind[602]: Watching system buttons on /dev/input/event1 (QEMU QEMU USB Keyboard)851gitlab # [ 8.013526] systemd-logind[602]: Watching system buttons on /dev/input/event0 (gpio-keys)852gitlab # [ 8.014704] systemd-logind[602]: New seat seat0.853gitlab # [ 8.017628] systemd[1]: Started User Login Management.854gitlab # [ 8.024045] systemd[1]: Starting linger-users.service...855gitlab # [ 8.029936] systemd[1]: Stopped target Host and Network Name Lookups.856gitlab # [ 8.031616] systemd[1]: Stopping Host and Network Name Lookups...857gitlab # [ 8.032592] systemd[1]: Stopped target User and Group Name Lookups.858gitlab # [ 8.033446] systemd[1]: Stopping User and Group Name Lookups...859gitlab # [ 8.034690] systemd[1]: Stopping Name Service Cache Daemon (nsncd)...860gitlab # [ 8.035572] systemd[1]: nscd.service: Deactivated successfully.861gitlab # [ 8.040801] systemd[1]: Stopped Name Service Cache Daemon (nsncd).862gitlab # [ 8.041889] systemd[1]: nscd.service: Consumed 26ms CPU time over 159ms wall clock time, 7.6M memory peak, 5.8M read from disk.863gitlab # [ 8.052445] systemd[1]: Starting Name Service Cache Daemon (nsncd)...864gitlab # [ 8.058103] systemd[1]: linger-users.service: Deactivated successfully.865gitlab # [ 8.062495] systemd[1]: Finished linger-users.service.866gitlab # [ 8.068401] nsncd[663]: Aug 15 23:29:55.979 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"867gitlab # [ 8.070708] systemd[1]: Started Name Service Cache Daemon (nsncd).868gitlab # [ 8.071552] systemd[1]: Reached target Host and Network Name Lookups.869gitlab # [ 8.076668] systemd[1]: Reached target User and Group Name Lookups.870gitlab # [ 8.084763] systemd[1]: Finished resolvconf update.871gitlab # [ 8.086829] systemd[1]: Reached target Preparation for Network.872gitlab # [ 8.092513] systemd[1]: Starting DHCP Client...873gitlab # [ 8.103745] input: QEMU Virtio Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:09.0/virtio8/input/input3874gitlab # [ 8.103252] systemd[1]: Starting Address configuration of eth1...875gitlab # [ 8.108325] systemd[1]: Starting Extra networking commands....876gitlab # [ 8.154258] network-addresses-eth1-start[687]: adding address 192.168.1.1/24... done877gitlab # [ 8.162952] network-addresses-eth1-start[687]: adding address 2001:db8:1::1/64... done878gitlab # [ 8.169846] systemd[1]: Finished Address configuration of eth1.879gitlab # [ 8.210509] systemd[1]: Finished Extra networking commands..880gitlab # [ 8.212395] systemd[1]: Reached target Network.881gitlab # [ 8.216586] dhcpcd[696]: dhcpcd-10.3.2 starting882gitlab # [ 8.217331] systemd[1]: Starting gitlab-workhorse.service...883gitlab # [ 8.224393] systemd[1]: Starting Nginx Web Server...884gitlab # [ 8.225555] dhcpcd[753]: dev: loaded udev885gitlab # [ 8.254220] systemd[1]: Starting PostgreSQL Server...886gitlab # [ 8.284409] systemd[1]: Starting Redis Server - redis-gitlab...887gitlab # [ 8.317181] systemd[1]: Starting Permit User Sessions...888gitlab # [ 8.337916] 8021q: 802.1Q VLAN Support v1.8889gitlab # [ 8.338300] 8021q: adding VLAN 0 to HW filter on device eth1890gitlab # [ 8.343315] systemd[1]: Starting Virtual Console Setup...891gitlab # [ 8.352758] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.892gitlab # [ 8.354328] systemd[1]: Stopped Virtual Console Setup.893gitlab # [ 8.372308] systemd[1]: Finished Permit User Sessions.894gitlab # [ 8.384573] cfg80211: Loading compiled-in X.509 certificates for regulatory database895gitlab # [ 8.382406] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.896gitlab # [ 8.393083] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7'897gitlab # [ 8.393579] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600'898gitlab # [ 8.395058] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2899gitlab # [ 8.395370] cfg80211: failed to load regulatory.db900gitlab # [ 8.405866] systemd[1]: Started Getty on tty1.901gitlab # [ 8.407291] systemd-logind[602]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard)902gitlab # [ 8.409577] systemd[1]: Reached target Login Prompts.903gitlab # [ 8.419346] systemd[1]: Starting Virtual Console Setup...904gitlab # [ 8.439449] 8021q: adding VLAN 0 to HW filter on device eth0905gitlab # [ 8.436590] dhcpcd[753]: eth0: waiting for carrier906gitlab # [ 8.438824] dhcpcd[753]: eth0: carrier acquired907gitlab # [ 8.441587] dhcpcd[753]: DUID 00:01:00:01:32:13:b2:f4:52:54:00:12:34:56908gitlab # [ 8.442647] dhcpcd[753]: eth0: IAID 00:12:34:56909gitlab # [ 8.443299] dhcpcd[753]: eth0: adding address fe80::5054:ff:fe12:3456910gitlab # [ 8.481648] nginx-pre-start[782]: nginx: the configuration file /nix/store/ybdwy2xmslvjmdkxgrrhy1x5rwh45z0q-nginx.conf syntax is ok911gitlab # [ 8.483617] nginx-pre-start[782]: nginx: configuration file /nix/store/ybdwy2xmslvjmdkxgrrhy1x5rwh45z0q-nginx.conf test is successful912gitlab # [ 8.492921] systemd[1]: Started Nginx Web Server.913gitlab # [ 8.517885] systemd-vconsole-setup[785]: Configuration of first virtual console was skipped, ignoring remaining ones.914gitlab # [ 8.522879] postgresql-pre-start[788]: The files belonging to this database system will be owned by user "postgres".915gitlab # [ 8.525360] postgresql-pre-start[788]: This user must also own the server process.916gitlab # [ 8.527261] systemd[1]: Finished Virtual Console Setup.917gitlab # [ 8.528442] postgresql-pre-start[788]: The database cluster will be initialized with locale "en_US.UTF-8".918gitlab # [ 8.529762] postgresql-pre-start[788]: The default database encoding has accordingly been set to "UTF8".919gitlab # [ 8.531134] postgresql-pre-start[788]: The default text search configuration will be set to "english".920gitlab # [ 8.533028] postgresql-pre-start[788]: Data page checksums are enabled.921gitlab # [ 8.535119] postgresql-pre-start[788]: fixing permissions on existing directory /var/lib/postgresql/18 ... ok922gitlab # [ 8.536649] postgresql-pre-start[788]: creating subdirectories ... ok923gitlab # [ 8.537496] postgresql-pre-start[788]: selecting dynamic shared memory implementation ... posix924gitlab # [ 8.546769] redis-server[794]: Supervised by systemd. Please make sure you set appropriate values for TimeoutStartSec and TimeoutStopSec in your service unit.925gitlab # [ 8.551454] redis-server[794]: oO0OoO0OoO0Oo Redis is starting oO0OoO0OoO0Oo926gitlab # [ 8.552922] redis-server[794]: Redis version=8.8.1, bits=64, commit=00000000, modified=0, pid=794, just started927gitlab # [ 8.554711] systemd[1]: Started Redis Server - redis-gitlab.928gitlab # [ 8.555648] redis-server[794]: Configuration loaded929gitlab # [ 8.556643] redis[794]: monotonic clock: ARM CNTVCT @ 1000 ticks/us930gitlab # [ 8.557904] redis[794]: Running mode=standalone, port=0.931gitlab # [ 8.559041] redis[794]: Server initialized932gitlab # [ 8.559825] redis[794]: Ready to accept connections unix933gitlab # [ 8.560974] redis[794]: WARNING: Redis does not require authentication. Redis will accept connections from any local client.934gitlab # [ 8.572121] postgresql-pre-start[788]: selecting default "max_connections" ... 100935gitlab # [ 8.622324] postgresql-pre-start[788]: selecting default "shared_buffers" ... 128MB936gitlab # [ 8.964189] systemd[1]: Started gitlab-workhorse.service.937gitlab # [ 9.072111] postgresql-pre-start[788]: selecting default time zone ... UTC938gitlab # [ 9.073936] postgresql-pre-start[788]: creating configuration files ... ok939gitlab # [ 9.214297] gitlab-workhorse[820]: time="2026-08-15T23:29:57Z" level=info msg=Starting build_time=19700101.000000 version=19.0.4940gitlab # [ 9.220181] gitlab-workhorse[820]: time="2026-08-15T23:29:57Z" level=info msg="Using redis/go-redis"941gitlab # [ 9.223767] gitlab-workhorse[820]: time="2026-08-15T23:29:57Z" level=info msg="Running upstream server" address=/run/gitlab/gitlab-workhorse.socket network=unix942gitlab # [ 9.290799] postgresql-pre-start[788]: running bootstrap script ... ok943gitlab # [ 9.893934] postgresql-pre-start[788]: performing post-bootstrap initialization ... ok944gitlab # [ 10.144488] postgresql-pre-start[788]: syncing data to disk ... ok945gitlab # [ 10.146945] postgresql-pre-start[788]: initdb: warning: enabling "trust" authentication for local connections946gitlab # [ 10.150658] postgresql-pre-start[788]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb.947gitlab # [ 10.156684] postgresql-pre-start[788]: Success. You can now start the database server using:948gitlab # [ 10.160001] postgresql-pre-start[788]: pg_ctl -D /var/lib/postgresql/18 -l logfile start949gitlab # [ 10.383553] postgres[854]: [854] LOG: starting PostgreSQL 18.4 on aarch64-unknown-linux-gnu, compiled by clang version 21.1.8, 64-bit950gitlab # [ 10.390382] postgres[854]: [854] LOG: listening on IPv6 address "::1", port 5432951gitlab # [ 10.393738] postgres[854]: [854] LOG: listening on IPv4 address "127.0.0.1", port 5432952gitlab # [ 10.397225] postgres[854]: [854] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432"953gitlab # [ 10.403952] dhcpcd[753]: eth0: soliciting a DHCP lease954gitlab # [ 10.408524] postgres[864]: [864] LOG: database system was shut down at 2026-08-15 23:29:57 GMT955gitlab # [ 10.412765] dhcpcd[753]: eth0: offered 10.0.2.15 from 10.0.2.2956gitlab # [ 10.415631] postgres[854]: [854] LOG: database system is ready to accept connections957gitlab # [ 10.420140] systemd[1]: Started PostgreSQL Server.958gitlab # [ 10.427764] systemd[1]: Starting PostgreSQL Setup Scripts...959gitlab # [ 10.432440] dhcpcd[753]: eth0: probing address 10.0.2.15/24960gitlab # [ 10.490980] dhcpcd[753]: eth0: soliciting an IPv6 router961gitlab # [ 10.493525] dhcpcd[753]: eth0: Router Advertisement from fe80::2962gitlab # [ 10.495930] dhcpcd[753]: eth0: adding address fec0::5054:ff:fe12:3456/64963gitlab # [ 10.498921] dhcpcd[753]: eth0: adding route to fec0::/64964gitlab # [ 10.501367] dhcpcd[753]: eth0: adding default route via fe80::2965gitlab # [ 10.786352] postgresql-setup-start[875]: CREATE DATABASE966gitlab # [ 10.826967] postgresql-setup-start[885]: CREATE ROLE967gitlab # [ 10.846350] postgresql-setup-start[887]: ALTER DATABASE968gitlab # [ 10.905099] postgresql-setup-start[892]: CREATE ROLE969gitlab # [ 10.907921] systemd[1]: Finished PostgreSQL Setup Scripts.970gitlab # [ 10.910469] systemd[1]: Reached target PostgreSQL.971gitlab # [ 10.912679] systemd[1]: Starting gitlab-postgresql.service...972gitlab # [ 10.956918] kmklqy2bdnfisygngf3cnp8jwzlh0j09-gitlab-config[880]: mkdir -p /var/gitlab/state/home/.ssh: OK973gitlab # [ 10.963039] kmklqy2bdnfisygngf3cnp8jwzlh0j09-gitlab-config[880]: chmod 700 /var/gitlab/state/home/.ssh: OK974gitlab # [ 11.067256] systemd[1]: Finished gitlab-config.service.975gitlab # [ 11.073829] systemd[1]: Started gitaly.service.976gitlab # [ 11.080449] systemd[1]: Starting gitlab-db-config.service...977gitlab # [ 11.112628] gitlab-postgresql-start[904]: CREATE DATABASE978gitlab # [ 11.193624] gitlab-postgresql-start[924]: CREATE EXTENSION979gitlab # [ 11.299253] gitlab-postgresql-start[932]: CREATE EXTENSION980gitlab # [ 11.304272] systemd[1]: Finished gitlab-postgresql.service.981gitlab # [ 11.655431] gitaly[914]: time="2026-08-15T23:29:59.566Z" level=warning msg="The current configurations will cause Gitaly to fail to start up in future versions. Please run 'gitaly configuration validate < /nix/store/0r0qd84zrxhqq373hk9spv8j9pg0qlnq-gitaly.toml' and fix the errors that are printed." pid=914982gitlab # [ 11.667962] gitaly[914]: time="2026-08-15T23:29:59.566Z" level=info msg="maxprocs: Leaving GOMAXPROCS=4: CPU quota undefined" pid=914983gitlab # [ 11.673343] gitaly[914]: time="2026-08-15T23:29:59.567Z" level=info msg="grpc prometheus histograms enabled" latencies="[0.001 0.005 0.025 0.1 0.5 1 10 30 60 300 1500]" pid=914984gitlab # [ 11.684284] gitaly[914]: time="2026-08-15T23:29:59.567Z" level=error msg="error initializing distributed tracing" error="tracing is disabled" pid=914985gitlab # [ 11.690821] gitaly[914]: time="2026-08-15T23:29:59.567Z" level=info msg="Starting Gitaly" pid=914 version=986gitlab # [ 11.883762] gitaly[914]: time="2026-08-15T23:29:59.795Z" level=info msg="finished unpacking auxiliary binaries" duration_ms=227 pid=914987gitlab # [ 11.885772] gitaly[914]: time="2026-08-15T23:29:59.795Z" level=info msg="finished initializing bootstrap" duration_ms=0 pid=914988gitlab # [ 11.887341] gitaly[914]: time="2026-08-15T23:29:59.796Z" level=info msg="finished initializing command factory" duration_ms=0 pid=914989gitlab # [ 11.889286] gitaly[914]: time="2026-08-15T23:29:59.796Z" level=info msg="using Git binary" binary_path=/run/gitaly/gitaly-914/git-exec-2069282209.d/git pid=914990gitlab # [ 11.892052] gitaly[914]: time="2026-08-15T23:29:59.803Z" level=info msg="finished detecting git version" duration_ms=6 pid=914991gitlab # [ 11.894286] gitaly[914]: time="2026-08-15T23:29:59.803Z" level=info msg="using Git version" pid=914 version=2.53.g992gitlab # [ 11.896303] gitaly[914]: time="2026-08-15T23:29:59.803Z" level=info msg="clearing disk cache object folder" pid=914 storage=default993gitlab # [ 11.898759] gitaly[914]: time="2026-08-15T23:29:59.803Z" level=info msg="moving disk cache object folder" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache629659580 pid=914 storage=default994gitlab # [ 11.902956] gitaly[914]: time="2026-08-15T23:29:59.803Z" level=info msg="disk cache object folder doesn't exist, no need to remove" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache629659580 pid=914 storage=default995gitlab # [ 11.907558] gitaly[914]: time="2026-08-15T23:29:59.803Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/cache path=/var/gitlab/state/repositories/+gitaly/cache pid=914996gitlab # [ 11.911757] gitaly[914]: time="2026-08-15T23:29:59.803Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/state path=/var/gitlab/state/repositories/+gitaly/state pid=914997gitlab # [ 11.915894] gitaly[914]: time="2026-08-15T23:29:59.803Z" level=info msg="cleared all cache object files" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache629659580 clear_duration_ms=0 pid=914 storage=default998gitlab # [ 11.921697] gitaly[914]: time="2026-08-15T23:29:59.833Z" level=warning msg="Unable to set SO_REUSEPORT: zero downtime upgrades will not work" error="operation not supported" pid=914999gitlab # [ 11.924639] gitaly[914]: time="2026-08-15T23:29:59.833Z" level=info msg="listening at address" address=/var/gitlab/state/tmp/sockets/gitaly.socket pid=914 schema=unix1000gitlab # [ 11.927419] gitaly[914]: time="2026-08-15T23:29:59.833Z" level=info msg="listening at address" address=/run/gitaly/gitaly-914/sock.d/intern pid=914 schema=unix1001gitlab # [ 11.930287] gitaly[914]: time="2026-08-15T23:29:59.834Z" level=info msg="counting repositories" pid=9141002gitlab # [ 11.932089] gitaly[914]: time="2026-08-15T23:29:59.834Z" level=info msg="starting to count repositories" pid=914 storage_path=/var/gitlab/state/repositories1003gitlab # [ 11.934806] gitaly[914]: time="2026-08-15T23:29:59.834Z" level=info msg="completed counting repositories" counting_duration_ms=0 pid=914 storage_path=/var/gitlab/state/repositories1004gitlab # [ 11.938013] gitaly[914]: time="2026-08-15T23:29:59.834Z" level=info msg="completed counting all repositories" counting_duration=0 pid=9141005gitlab # [ 11.940516] gitaly[914]: time="2026-08-15T23:29:59.834Z" level=info msg="finished tempdir cleaner walk" pid=914 storage=default time_ms=01006gitlab # [ 11.942972] gitaly[914]: time="2026-08-15T23:29:59.835Z" level=info msg="starting prometheus listener" address="localhost:9236" pid=9141007gitlab # [ 11.945528] gitaly[914]: time="2026-08-15T23:29:59.835Z" level=info msg="Started Gitaly" duration_ms=267 pid=9141008gitlab # [ 11.947491] gitaly[914]: time="2026-08-15T23:29:59.835Z" level=info msg="Gitaly graceful stop timeout duration" duration_s=1m0s pid=9141009gitlab # [ 11.949961] gitaly[914]: time="2026-08-15T23:29:59.835Z" level=info msg="maintenance: daily scheduled" pid=914 scheduled="2026-08-16 12:00:00 +0000 UTC"1010gitlab # [ 12.361454] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[922]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1011gitlab # [ 12.371678] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[922]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1012gitlab # [ 12.381789] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[922]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1013gitlab # [ 14.853120] dhcpcd[753]: eth0: leased 10.0.2.15 for 86400 seconds1014gitlab # [ 14.853507] dhcpcd[753]: eth0: adding route to 10.0.2.0/241015gitlab # [ 14.853749] dhcpcd[753]: eth0: adding default route via 10.0.2.21016gitlab # [ 14.984958] systemd[1]: Started DHCP Client.1017gitlab # [ 14.988671] systemd[1]: Reached target Network is Online.1018gitlab # [ 15.327193] gitaly[914]: time="2026-08-15T23:30:03.238Z" level=info msg="License database preloaded" duration_ms=3670 pid=9141019gitlab # [ 56.790900] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[922]: W, [2026-08-15T23:30:44.694985 #922] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1020gitlab # [ 59.276125] gitlab-workhorse[820]: time="2026-08-15T23:30:47Z" level=error correlation_id= duration_ms=1 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1021gitlab # [ 59.878759] postgres[1430]: [1430] ERROR: relation "feature_gates" does not exist at character 5231022gitlab # [ 59.882923] postgres[1430]: [1430] STATEMENT: SELECT a.attname, format_type(a.atttypid, a.atttypmod),1023gitlab # [ 59.886736] postgres[1430]: pg_get_expr(d.adbin, d.adrelid), a.attnotnull, a.atttypid, a.atttypmod,1024gitlab # [ 59.890788] postgres[1430]: c.collname, col_description(a.attrelid, a.attnum) AS comment,1025gitlab # [ 59.894385] postgres[1430]: attidentity AS identity,1026gitlab # [ 59.896683] postgres[1430]: attgenerated as attgenerated1027gitlab # [ 59.899111] postgres[1430]: FROM pg_attribute a1028gitlab # [ 59.901149] postgres[1430]: LEFT JOIN pg_attrdef d ON a.attrelid = d.adrelid AND a.attnum = d.adnum1029gitlab # [ 59.904778] postgres[1430]: LEFT JOIN pg_type t ON a.atttypid = t.oid1030gitlab # [ 59.907374] postgres[1430]: LEFT JOIN pg_collation c ON a.attcollation = c.oid AND a.attcollation <> t.typcollation1031gitlab # [ 59.911355] postgres[1430]: WHERE a.attrelid = '"feature_gates"'::regclass1032gitlab # [ 59.914103] postgres[1430]: AND a.attnum > 0 AND NOT a.attisdropped1033gitlab # [ 59.916742] postgres[1430]: ORDER BY a.attnum1034gitlab # [ 59.918561] postgres[1430]:1035gitlab # [ 65.039354] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[1481]: psql:/var/gitlab/state/db/structure.sql:9: NOTICE: extension "btree_gist" already exists, skipping1036gitlab # [ 65.039772] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[1481]: psql:/var/gitlab/state/db/structure.sql:11: NOTICE: extension "pg_trgm" already exists, skipping1037gitlab # [ 69.281786] gitlab-workhorse[820]: time="2026-08-15T23:30:57Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1038gitlab # [ 79.289817] gitlab-workhorse[820]: time="2026-08-15T23:31:07Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1039gitlab # [ 89.301103] gitlab-workhorse[820]: time="2026-08-15T23:31:17Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1040gitlab # [ 90.578483] postgres[1584]: [1584] ERROR: relation "table_without_models" does not exist1041gitlab # [ 90.578945] postgres[1584]: [1584] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1042gitlab # [ 99.311438] gitlab-workhorse[820]: time="2026-08-15T23:31:27Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1043gitlab # [ 109.312508] gitlab-workhorse[820]: time="2026-08-15T23:31:37Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1044gitlab # [ 119.322379] gitlab-workhorse[820]: time="2026-08-15T23:31:47Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1045gitlab # [ 121.323227] systemd[1]: Finished gitlab-db-config.service.1046gitlab # [ 121.332183] systemd[1]: Started gitlab-sidekiq.service.1047gitlab # [ 121.340209] systemd[1]: Starting gitlab.service...1048gitlab # [ 121.960198] bundle[1959]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1049gitlab # [ 121.960711] bundle[1959]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1050gitlab # [ 121.962211] bundle[1959]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1051gitlab # [ 126.746609] bundle[1959]: {"timestamp":"2026-08-15T23:31:54.629Z","pid":1959,"message":"* Enabling systemd notification integration"}1052gitlab # [ 126.747023] bundle[1959]: {"timestamp":"2026-08-15T23:31:54.657Z","pid":1959,"message":"Puma starting in cluster mode..."}1053gitlab # [ 126.747153] bundle[1959]: {"timestamp":"2026-08-15T23:31:54.657Z","pid":1959,"message":"* Puma version: 8.0.1 (\"Into the Arena\")"}1054gitlab # [ 126.747257] bundle[1959]: {"timestamp":"2026-08-15T23:31:54.657Z","pid":1959,"message":"* Ruby version: ruby 3.3.10 (2025-10-23 revision 343ea05002) [aarch64-linux]"}1055gitlab # [ 126.747370] bundle[1959]: {"timestamp":"2026-08-15T23:31:54.657Z","pid":1959,"message":"* Min threads: 0"}1056gitlab # [ 126.747471] bundle[1959]: {"timestamp":"2026-08-15T23:31:54.657Z","pid":1959,"message":"* Max threads: 4"}1057gitlab # [ 126.747628] bundle[1959]: {"timestamp":"2026-08-15T23:31:54.657Z","pid":1959,"message":"* Environment: production"}1058gitlab # [ 126.747728] bundle[1959]: {"timestamp":"2026-08-15T23:31:54.657Z","pid":1959,"message":"* Master PID: 1959"}1059gitlab # [ 126.747838] bundle[1959]: {"timestamp":"2026-08-15T23:31:54.657Z","pid":1959,"message":"* Workers: 2"}1060gitlab # [ 126.747938] bundle[1959]: {"timestamp":"2026-08-15T23:31:54.657Z","pid":1959,"message":"* Restarts: (✔) hot (✖) phased (✖) refork"}1061gitlab # [ 126.792623] bundle[1959]: {"timestamp":"2026-08-15T23:31:54.657Z","pid":1959,"message":"* Preloading application"}1062gitlab # [ 126.800398] sidekiq-cluster[1958]: {"severity":"INFO","time":"2026-08-15T23:31:54.682Z","message":"Starting cluster with 1 processes"}1063gitlab # [ 129.326122] gitlab-workhorse[820]: time="2026-08-15T23:31:57Z" level=error correlation_id= duration_ms=1 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1064gitlab # [ 139.330087] gitlab-workhorse[820]: time="2026-08-15T23:32:07Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1065gitlab # [ 149.333070] gitlab-workhorse[820]: time="2026-08-15T23:32:17Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1066gitlab # [ 159.342144] gitlab-workhorse[820]: time="2026-08-15T23:32:27Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1067gitlab # [ 164.615586] bundle[1959]: W, [2026-08-15T23:32:32.526487 #1959] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1068gitlab # [ 168.992580] sidekiq-cluster[2010]: 2026-08-15T23:32:36.904Z pid=2010 tid=woi INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>2010, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>430563328}1069gitlab # [ 169.305916] sidekiq-cluster[2010]: W, [2026-08-15T23:32:37.217848 #2010] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1070gitlab # [ 169.350411] gitlab-workhorse[820]: time="2026-08-15T23:32:37Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1071gitlab # [ 169.371870] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:32:37.283Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"}1072gitlab # [ 173.094515] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:32:41.005Z","message":"GitLab reliable fetch activated!"}1073gitlab # [ 173.094879] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:32:41.005Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1074gitlab # [ 173.127692] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:32:41.039Z","message":"Cron Jobs - added job with name bbo_users_delete_unconfirmed_secondary in the namespace default"}1075gitlab # [ 173.134890] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:32:41.042Z","message":"Cron Jobs - added job with name background_operation_environments_auto_delete in the namespace default"}1076gitlab # [ 173.142131] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:32:41.045Z","message":"Cron Jobs - added job with name adjourned_group_deletion_worker in the namespace default"}1077gitlab # [ 173.148829] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:32:41.048Z","message":"Cron Jobs - added job with name authn_data_retention_authentication_event_archive_worker in the namespace default"}1078gitlab # [ 173.156303] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:32:41.051Z","message":"Cron Jobs - added job with name delete_expired_trigger_token_worker in the namespace default"}1079gitlab # [ 173.162718] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:32:41.054Z","message":"Cron Jobs - added job with name adjourned_projects_deletion_cron_worker in the namespace default"}1080gitlab # [ 173.169028] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:32:41.056Z","message":"Cron Jobs - added job with name stuck_ci_jobs_worker in the namespace default"}1081gitlab # [ 173.174083] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:32:41.058Z","message":"Cron Jobs - added job with name drop_timed_out_worker in the namespace default"}1082gitlab # [ 173.178825] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:32:41.060Z","message":"Cron Jobs - added job with name pipeline_schedule_worker in the namespace default"}1083gitlab # [ 173.183360] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:32:41.062Z","message":"Cron Jobs - added job with name ci_schedule_bulk_delete_job_artifact_cron_worker in the namespace default"}1084gitlab # [ 173.188106] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:32:41.064Z","message":"Cron Jobs - added job with name update_locked_unknown_artifacts_worker in the namespace default"}1085gitlab # [ 173.192100] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:32:41.067Z","message":"Cron Jobs - added job with name ci_partitioning_worker in the namespace default"}1086gitlab # [ 173.195543] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:32:41.069Z","message":"Cron Jobs - added job with name ci_pipelines_expire_artifacts_worker in the namespace default"}1087gitlab # [ 173.199350] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:32:41.071Z","message":"Cron Jobs - added job with name ci_schedule_delete_objects_worker in the namespace default"}1088gitlab # [ 173.202908] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:32:41.073Z","message":"Cron Jobs - added job with name environments_auto_stop_cron_worker in the namespace default"}1089gitlab # [ 173.206303] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:32:41.075Z","message":"Cron Jobs - added job with name repository_check_worker in the namespace default"}1090gitlab # [ 173.209364] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:32:41.079Z","message":"Cron Jobs - added job with name admin_email_worker in the namespace default"}1091gitlab # [ 173.212152] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:32:41.082Z","message":"Cron Jobs - added job with name personal_access_tokens_expiring_worker in the namespace default"}1092gitlab # [ 173.215123] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:32:41.085Z","message":"Cron Jobs - added job with name deploy_tokens_expiring_worker in the namespace default"}1093gitlab # [ 173.218054] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:32:41.088Z","message":"Cron Jobs - added job with name personal_access_tokens_expired_notification_worker in the namespace default"}1094gitlab # [ 173.221143] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:32:41.091Z","message":"Cron Jobs - added job with name resource_access_tokens_inactive_tokens_deletion_cron_worker in the namespace default"}1095gitlab # [ 173.224210] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:32:41.094Z","message":"Cron Jobs - added job with name repository_archive_cache_worker in the namespace default"}1096gitlab # [ 173.226751] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:32:41.096Z","message":"Cron Jobs - added job with name import_export_project_cleanup_worker in the namespace default"}1097gitlab # [ 173.229550] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:32:41.099Z","message":"Cron Jobs - added job with name gitlab_import_import_file_cleanup_worker in the namespace default"}1098gitlab # [ 173.232095] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:32:41.101Z","message":"Cron Jobs - added job with name ci_archive_traces_cron_worker in the namespace default"}1099gitlab # [ 173.234414] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:32:41.104Z","message":"Cron Jobs - added job with name members_expiring_worker in the namespace default"}1100gitlab # [ 173.236718] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:32:41.107Z","message":"Cron Jobs - added job with name remove_expired_members_worker in the namespace default"}1101gitlab # [ 173.238950] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:32:41.110Z","message":"Cron Jobs - added job with name remove_expired_group_links_worker in the namespace default"}1102gitlab # [ 173.241352] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:32:41.113Z","message":"Cron Jobs - added job with name remove_unaccepted_member_invites_worker in the namespace default"}1103gitlab # [ 173.243671] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:32:41.116Z","message":"Cron Jobs - added job with name prune_old_events_worker in the namespace default"}1104gitlab # [ 173.246010] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:32:41.118Z","message":"Cron Jobs - added job with name gitlab_export_prune_project_export_jobs_worker in the namespace default"}1105gitlab # [ 173.248466] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:32:41.121Z","message":"Cron Jobs - added job with name trending_projects_worker in the namespace default"}1106gitlab # [ 173.250560] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:32:41.123Z","message":"Cron Jobs - added job with name remove_unreferenced_lfs_objects_worker in the namespace default"}1107gitlab # [ 173.252858] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:32:41.126Z","message":"Cron Jobs - added job with name bulk_imports_stale_import_worker in the namespace default"}1108gitlab # [ 173.254992] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:32:41.128Z","message":"Cron Jobs - added job with name import_stuck_project_import_jobs in the namespace default"}1109gitlab # [ 173.257248] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:32:41.130Z","message":"Cron Jobs - added job with name jira_import_stuck_jira_import_jobs in the namespace default"}1110gitlab # [ 173.259451] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:32:41.132Z","message":"Cron Jobs - added job with name stuck_export_jobs_worker in the namespace default"}1111gitlab # [ 173.261659] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:32:41.134Z","message":"Cron Jobs - added job with name gitlab_service_ping_worker in the namespace default"}1112gitlab # [ 173.263724] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:32:41.136Z","message":"Cron Jobs - added job with name stuck_merge_jobs_worker in the namespace default"}1113gitlab # [ 173.265930] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:32:41.138Z","message":"Cron Jobs - added job with name pages_domain_verification_cron_worker in the namespace default"}1114gitlab # [ 173.268142] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:32:41.141Z","message":"Cron Jobs - added job with name pages_domain_removal_cron_worker in the namespace default"}1115gitlab # [ 173.270228] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:32:41.143Z","message":"Cron Jobs - added job with name pages_domain_ssl_renewal_cron_worker in the namespace default"}1116gitlab # [ 173.272371] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:32:41.145Z","message":"Cron Jobs - added job with name issue_due_scheduler_worker in the namespace default"}1117gitlab # [ 173.274384] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:32:41.147Z","message":"Cron Jobs - added job with name schedule_migrate_external_diffs_worker in the namespace default"}1118gitlab # [ 173.276579] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:32:41.149Z","message":"Cron Jobs - added job with name namespaces_prune_aggregation_schedules_worker in the namespace default"}1119gitlab # [ 173.278805] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:32:41.152Z","message":"Cron Jobs - added job with name container_expiration_policy_worker in the namespace default"}1120gitlab # [ 173.281029] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:32:41.154Z","message":"Cron Jobs - added job with name cleanup_container_registry_worker in the namespace default"}1121gitlab # [ 173.283131] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:32:41.156Z","message":"Cron Jobs - added job with name image_ttl_group_policy_worker in the namespace default"}1122gitlab # [ 173.285302] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:32:41.158Z","message":"Cron Jobs - added job with name cleanup_dependency_proxy_worker in the namespace default"}1123gitlab # [ 173.287373] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:32:41.161Z","message":"Cron Jobs - added job with name cleanup_package_registry_worker in the namespace default"}1124gitlab # [ 173.290668] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:32:41.163Z","message":"Cron Jobs - added job with name x509_issuer_crl_check_worker in the namespace default"}1125gitlab # [ 173.292833] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:32:41.165Z","message":"Cron Jobs - added job with name users_create_statistics_worker in the namespace default"}1126gitlab # [ 173.294931] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:32:41.177Z","message":"Cron Jobs - added job with name authorized_project_update_periodic_recalculate_worker in the namespace default"}1127gitlab # [ 173.297420] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:32:41.184Z","message":"Cron Jobs - added job with name update_container_registry_info_worker in the namespace default"}1128gitlab # [ 173.299612] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:32:41.187Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_manager in the namespace default"}1129gitlab # [ 173.301927] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:32:41.189Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_dropper in the namespace default"}1130gitlab # [ 173.304154] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:32:41.193Z","message":"Cron Jobs - added job with name analytics_usage_trends_count_job_trigger_worker in the namespace default"}1131gitlab # [ 173.306603] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:32:41.195Z","message":"Cron Jobs - added job with name member_invitation_reminder_emails_worker in the namespace default"}1132gitlab # [ 173.308895] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:32:41.197Z","message":"Cron Jobs - added job with name schedule_merge_request_cleanup_refs_worker in the namespace default"}1133gitlab # [ 173.311126] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:32:41.200Z","message":"Cron Jobs - added job with name manage_evidence_worker in the namespace default"}1134gitlab # [ 173.316174] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:32:41.202Z","message":"Cron Jobs - added job with name publish_release_worker in the namespace default"}1135gitlab # [ 173.318283] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:32:41.204Z","message":"Cron Jobs - added job with name user_status_cleanup_batch_worker in the namespace default"}1136gitlab # [ 173.320475] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:32:41.206Z","message":"Cron Jobs - added job with name ssh_keys_expired_notification_worker in the namespace default"}1137gitlab # [ 173.322622] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:32:41.209Z","message":"Cron Jobs - added job with name ssh_keys_expiring_soon_notification_worker in the namespace default"}1138gitlab # [ 173.325055] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:32:41.211Z","message":"Cron Jobs - added job with name users_deactivate_dormant_users_worker in the namespace default"}1139gitlab # [ 173.327415] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:32:41.214Z","message":"Cron Jobs - added job with name ci_delete_unit_tests_worker in the namespace default"}1140gitlab # [ 173.329746] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:32:41.216Z","message":"Cron Jobs - added job with name batched_background_migrations_worker in the namespace default"}1141gitlab # [ 173.331979] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:32:41.218Z","message":"Cron Jobs - added job with name batched_background_migration_worker_ci_database in the namespace default"}1142gitlab # [ 173.334628] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:32:41.220Z","message":"Cron Jobs - added job with name batched_background_migration_worker_sec_database in the namespace default"}1143gitlab # [ 173.337123] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:32:41.222Z","message":"Cron Jobs - added job with name background_operations_worker_main_database in the namespace default"}1144gitlab # [ 173.339380] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:32:41.223Z","message":"Cron Jobs - added job with name background_operations_worker_ci_database in the namespace default"}1145gitlab # [ 173.341756] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:32:41.225Z","message":"Cron Jobs - added job with name background_operations_worker_sec_database in the namespace default"}1146gitlab # [ 173.344002] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:32:41.227Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_main_database in the namespace default"}1147gitlab # [ 173.346516] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:32:41.229Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_ci_database in the namespace default"}1148gitlab # [ 173.348940] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:32:41.231Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_sec_database in the namespace default"}1149gitlab # [ 173.351268] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:32:41.233Z","message":"Cron Jobs - added job with name issues_reschedule_stuck_issue_rebalances in the namespace default"}1150gitlab # [ 173.353635] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:32:41.234Z","message":"Cron Jobs - added job with name projects_schedule_refresh_build_artifacts_size_statistics_worker in the namespace default"}1151gitlab # [ 173.356113] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:32:41.236Z","message":"Cron Jobs - added job with name inactive_projects_deletion_cron_worker in the namespace default"}1152gitlab # [ 173.358306] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:32:41.238Z","message":"Cron Jobs - added job with name loose_foreign_keys_cleanup_worker in the namespace default"}1153gitlab # [ 173.360487] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:32:41.239Z","message":"Cron Jobs - added job with name loose_foreign_keys_ci_pipelines_builds_cleanup_worker in the namespace default"}1154gitlab # [ 173.362863] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:32:41.241Z","message":"Cron Jobs - added job with name loose_foreign_keys_merge_request_diff_commit_cleanup_worker in the namespace default"}1155gitlab # [ 173.365369] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:32:41.242Z","message":"Cron Jobs - added job with name batched_git_ref_updates_cleanup_scheduler_worker in the namespace default"}1156gitlab # [ 173.367614] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:32:41.245Z","message":"Cron Jobs - added job with name ci_runner_versions_reconciliation_worker in the namespace default"}1157gitlab # [ 173.369930] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:32:41.247Z","message":"Cron Jobs - added job with name users_migrate_records_to_ghost_user_in_batches_worker in the namespace default"}1158gitlab # [ 173.372193] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:32:41.249Z","message":"Cron Jobs - added job with name ci_runners_stale_machines_cleanup_worker in the namespace default"}1159gitlab # [ 173.374295] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:32:41.251Z","message":"Cron Jobs - added job with name packages_cleanup_delete_orphaned_dependencies_worker in the namespace default"}1160gitlab # [ 173.376592] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:32:41.253Z","message":"Cron Jobs - added job with name cleanup_dangling_debian_package_files_worker in the namespace default"}1161gitlab # [ 173.378752] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:32:41.255Z","message":"Cron Jobs - added job with name object_storage_delete_stale_direct_uploads_worker in the namespace default"}1162gitlab # [ 173.381123] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:32:41.257Z","message":"Cron Jobs - added job with name service_desk_custom_email_verification_cleanup in the namespace default"}1163gitlab # [ 173.383361] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:32:41.258Z","message":"Cron Jobs - added job with name deactivated_pages_deployments_delete_cron_worker in the namespace default"}1164gitlab # [ 173.385778] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:32:41.260Z","message":"Cron Jobs - added job with name ci_schedule_unlock_pipelines_in_queue_worker in the namespace default"}1165gitlab # [ 173.388031] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:32:41.262Z","message":"Cron Jobs - added job with name ci_catalog_resources_process_sync_events_worker in the namespace default"}1166gitlab # [ 173.390260] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:32:41.263Z","message":"Cron Jobs - added job with name namespaces_process_outdated_namespace_descendants_cron_worker in the namespace default"}1167gitlab # [ 173.392704] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:32:41.265Z","message":"Cron Jobs - added job with name performance_bar_stats in the namespace default"}1168gitlab # [ 173.394664] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:32:41.268Z","message":"Cron Jobs - added job with name ci_catalog_resources_aggregate_last30_day_usage_worker in the namespace default"}1169gitlab # [ 173.397085] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:32:41.270Z","message":"Cron Jobs - added job with name ci_catalog_resources_cleanup_last_usages_worker in the namespace default"}1170gitlab # [ 173.399343] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:32:41.272Z","message":"Cron Jobs - added job with name ci_click_house_finished_pipelines_sync_worker in the namespace default"}1171gitlab # [ 173.401740] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:32:41.274Z","message":"Cron Jobs - added job with name deactivate_expired_deployments_cron_worker in the namespace default"}1172gitlab # [ 173.403943] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:32:41.287Z","message":"Cron Jobs - added job with name database_monitor_locked_tables_cron_worker in the namespace default"}1173gitlab # [ 173.406363] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:32:41.289Z","message":"Cron Jobs - added job with name merge_requests_process_scheduled_merge in the namespace default"}1174gitlab # [ 173.408559] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:32:41.291Z","message":"Cron Jobs - added job with name ci_schedule_old_pipelines_removal_cron_worker in the namespace default"}1175gitlab # [ 173.410764] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:32:41.294Z","message":"Cron Jobs - added job with name version_version_check_cron in the namespace default"}1176gitlab # [ 173.412850] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:32:41.297Z","message":"Cron Jobs - added job with name import_placeholder_user_cleanup_worker in the namespace default"}1177gitlab # [ 173.414984] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:32:41.300Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_grant_archive_worker in the namespace default"}1178gitlab # [ 173.437186] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:32:41.349Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_token_archive_worker in the namespace default"}1179gitlab # [ 173.440334] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:32:41.352Z","message":"Cron Jobs - added job with name lost_transaction_recovery_worker in the namespace default"}1180gitlab # [ 173.442513] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:32:41.354Z","message":"Cron Jobs - added job with name topology_service_stale_requests_cleanup_worker in the namespace default"}1181gitlab # [ 173.446301] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:32:41.358Z","message":"Cron Jobs - added job with name cells_schedule_claims_verification_worker in the namespace default"}1182gitlab # [ 173.448619] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:32:41.360Z","message":"Cron Jobs - added job with name concurrency_limit_resume_worker in the namespace default"}1183gitlab # [ 179.360771] gitlab-workhorse[820]: time="2026-08-15T23:32:47Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1184gitlab # [ 189.362020] gitlab-workhorse[820]: time="2026-08-15T23:32:57Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1185gitlab # [ 199.370320] gitlab-workhorse[820]: time="2026-08-15T23:33:07Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1186gitlab # [ 209.377608] gitlab-workhorse[820]: time="2026-08-15T23:33:17Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1187gitlab # [ 212.764892] postgres[2736]: [2736] ERROR: relation "table_without_models" does not exist1188gitlab # [ 212.765305] postgres[2736]: [2736] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1189gitlab # [ 214.485013] postgres[2756]: [2756] ERROR: relation "table_without_models" does not exist1190gitlab # [ 214.485340] postgres[2756]: [2756] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1191gitlab # [ 217.790168] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:33:25.701Z","message":"Booted Rails 7.2.3.1 application in production environment"}1192gitlab # [ 217.792818] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:33:25.704Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [aarch64-linux]"}1193gitlab # [ 217.794827] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:33:25.704Z","message":"See LICENSE and the LGPL-3.0 for licensing details."}1194gitlab # [ 217.796696] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:33:25.705Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"}1195gitlab # [ 217.798644] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:33:25.709Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1196gitlab # [ 219.386296] gitlab-workhorse[820]: time="2026-08-15T23:33:27Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1197gitlab # [ 220.116876] bundle[1959]: {"timestamp":"2026-08-15T23:33:28.027Z","pid":1959,"message":"* Listening on unix:///var/gitlab/state//tmp/sockets/gitlab.socket"}1198gitlab # [ 220.117219] bundle[1959]: {"timestamp":"2026-08-15T23:33:28.027Z","pid":1959,"message":"! WARNING: Detected 2 Thread(s) started in app boot:"}1199gitlab # [ 220.117405] bundle[1959]: {"timestamp":"2026-08-15T23:33:28.027Z","pid":1959,"message":"! #\u003cThread:0x0000fbb396d94798 /nix/store/zj7sa5zsg6vhnyq28b8v0x1jajz1gpvc-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:72 sleep\u003e - /nix/store/zj7sa5zsg6vhnyq28b8v0x1jajz1gpvc-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:90:in `sleep'"}1200gitlab # [ 220.117559] bundle[1959]: {"timestamp":"2026-08-15T23:33:28.027Z","pid":1959,"message":"! #\u003cThread:0x0000fbb396fb6a80 /nix/store/lnly88svq5ykjs8ynaw5cm3g88z1lvsm-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:18 sleep\u003e - /nix/store/lnly88svq5ykjs8ynaw5cm3g88z1lvsm-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:20:in `sleep'"}1201gitlab # [ 220.117678] bundle[1959]: {"timestamp":"2026-08-15T23:33:28.028Z","pid":1959,"message":"Use Ctrl-C to stop"}1202gitlab # [ 220.117792] bundle[1959]: {"timestamp":"2026-08-15T23:33:28.028Z","pid":1959,"message":"Sending status to systemd every 1.0 sec"}1203gitlab # [ 220.486657] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:33:28.398Z","message":"Cleaning working queues"}1204gitlab # [ 220.491727] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:33:28.403Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"f972566e6c19f99274e94c36","created_at":"2026-08-15T23:31:48.611Z","trace_propagation_headers":{"sentry-trace":"fa29b3823ddd437fb204092a56236673-56fc9cd3bb484d53","baggage":"sentry-trace_id=fa29b3823ddd437fb204092a56236673,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"b73fdcc82a7aecef33376238e60a4294","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-08-15T23:31:48.623Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-f972566e6c19f99274e94c36: start","job_status":"start","queue_duration_s":99.779611,"scheduling_latency_s":99.779716}1205gitlab # [ 220.875405] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:33:28.786Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"f972566e6c19f99274e94c36","created_at":"2026-08-15T23:31:48.611Z","trace_propagation_headers":{"sentry-trace":"fa29b3823ddd437fb204092a56236673-56fc9cd3bb484d53","baggage":"sentry-trace_id=fa29b3823ddd437fb204092a56236673,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"b73fdcc82a7aecef33376238e60a4294","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-08-15T23:31:48.623Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-f972566e6c19f99274e94c36: done: 0.383598 sec","job_status":"done","queue_duration_s":99.779611,"scheduling_latency_s":99.779716,"redis_calls":24,"redis_duration_s":0.01126,"redis_read_bytes":912,"redis_write_bytes":2622,"redis_feature_flag_calls":13,"redis_feature_flag_duration_s":0.005454,"redis_feature_flag_read_bytes":902,"redis_feature_flag_write_bytes":1375,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.003432,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":688,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002374,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":559,"db_count":9,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.021,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.016,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.181984,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.21561836,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.383598,"completed_at":"2026-08-15T23:33:28.786Z","load_balancing_strategy":"primary","db_duration_s":0.114107,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1206gitlab # [ 221.204639] bundle[1959]: {"timestamp":"2026-08-15T23:33:29.115Z","pid":1959,"message":"- Worker 0 (PID: 2858) booted in 1.05s, phase: 0"}1207gitlab # [ 221.212868] bundle[1959]: {"timestamp":"2026-08-15T23:33:29.124Z","pid":1959,"message":"- Worker 1 (PID: 2862) booted in 1.02s, phase: 0"}1208gitlab # [ 221.216837] systemd[1]: Started gitlab.service.1209gitlab # [ 221.217770] systemd[1]: Reached target Common target for all GitLab services..1210gitlab # [ 221.224303] systemd[1]: Starting setup-gitlab.service...1211gitlab # [ 221.268441] setup-gitlab-start[2902]: + timeout 900 bash -c 'until curl -fs http://gitlab/users/sign_in > /dev/null; do sleep 5; done'1212gitlab # [ 224.551095] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/08/15:23:33:32 +0000] "GET /users/sign_in HTTP/1.1" 200 10655 "" "curl/8.21.0" 32431213gitlab # [ 224.556319] setup-gitlab-start[2902]: + TOKEN=nixbot-test-token-of-20-chars1214gitlab # [ 224.556924] setup-gitlab-start[2902]: + runuser -u gitlab -- /run/current-system/sw/bin/gitlab-rails runner $'\n ApplicationSetting.current.update!(allow_local_requests_from_web_hooks_and_services: true)\n Rails.cache.clear\n token = User.find_by_username(\'root\').personal_access_tokens.create!(\n name: \'nixbot\', scopes: [:api], expires_at: 7.days.from_now)\n token.set_token(\'nixbot-test-token-of-20-chars\')\n token.save!\n'1215gitlab # [ 224.576729] runuser[2925]: pam_unix(runuser:session): session opened for user gitlab(uid=165) by (uid=0)1216gitlab # [ 225.088122] setup-gitlab-start[2926]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1217gitlab # [ 225.094620] setup-gitlab-start[2926]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1218gitlab # [ 225.101094] setup-gitlab-start[2926]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1219gitlab # [ 225.918276] setup-gitlab-start[2926]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1220gitlab # [ 225.918612] setup-gitlab-start[2926]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1221gitlab # [ 225.921354] setup-gitlab-start[2926]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1222gitlab # [ 232.061338] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:33:39.971Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"f7057ff15c9f5a66202c0d84","created_at":"2026-08-15T23:33:39.870Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-0b849d46bd594c09","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1b90929f417fe0aaef6c3eaf7522cf31","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-15T23:33:39.968Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-f7057ff15c9f5a66202c0d84: start","job_status":"start","queue_duration_s":0.003114,"scheduling_latency_s":0.003163}1223gitlab # [ 232.635112] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:33:40.545Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"f7057ff15c9f5a66202c0d84","created_at":"2026-08-15T23:33:39.870Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-0b849d46bd594c09","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1b90929f417fe0aaef6c3eaf7522cf31","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-15T23:33:39.968Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-f7057ff15c9f5a66202c0d84: done: 0.574082 sec","job_status":"done","queue_duration_s":0.003114,"scheduling_latency_s":0.003163,"redis_calls":14,"redis_duration_s":0.054055,"redis_read_bytes":13,"redis_write_bytes":1883,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.008059,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":618,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.011041,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":654,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.034955,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":611,"db_count":8,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.05,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.046,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.170378,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.002784,"exclusive_lock_hold_duration_s":0.29393434,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.574082,"completed_at":"2026-08-15T23:33:40.545Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.093007,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1224gitlab # [ 232.715720] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:33:40.600Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"36348f0cc935122a414cf7b6","created_at":"2026-08-15T23:33:40.013Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-0b849d46bd594c09","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"09307b73453e5692cf5363d6be42d4d4","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-15T23:33:40.022Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-36348f0cc935122a414cf7b6: start","job_status":"start","queue_duration_s":0.578401,"scheduling_latency_s":0.578432}1225gitlab # [ 232.732846] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:33:40.628Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0}1226gitlab # [ 232.736754] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:33:40.644Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"36348f0cc935122a414cf7b6","created_at":"2026-08-15T23:33:40.013Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-0b849d46bd594c09","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"09307b73453e5692cf5363d6be42d4d4","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-15T23:33:40.022Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-36348f0cc935122a414cf7b6: done: 0.044033 sec","job_status":"done","queue_duration_s":0.578401,"scheduling_latency_s":0.578432,"redis_calls":10,"redis_duration_s":0.001876,"redis_read_bytes":9,"redis_write_bytes":1261,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000384,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":353,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001068,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":650,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000424,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":258,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.011,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015614,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00027776,"duration_s":0.044033,"completed_at":"2026-08-15T23:33:40.644Z","load_balancing_strategy":"primary","db_duration_s":0.010747,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1227gitlab # [ 232.783907] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:33:40.645Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleOldPipelinesRemovalCronWorker","jid":"690beecd89a884e029f4ff46","created_at":"2026-08-15T23:33:40.056Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-0b849d46bd594c09","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"cdf2f18a0d932abb63d3029dd3bacf6d","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5cd05815835513d57d02434c59416c33dd1bebcfa3138e1542ab850c977747b0","size_limiter":"validated","enqueued_at":"2026-08-15T23:33:40.081Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleOldPipelinesRemovalCronWorker JID-690beecd89a884e029f4ff46: start","job_status":"start","queue_duration_s":0.564805,"scheduling_latency_s":0.564824}1228gitlab # [ 232.958661] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:33:40.869Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleOldPipelinesRemovalCronWorker","jid":"690beecd89a884e029f4ff46","created_at":"2026-08-15T23:33:40.056Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-0b849d46bd594c09","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"cdf2f18a0d932abb63d3029dd3bacf6d","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5cd05815835513d57d02434c59416c33dd1bebcfa3138e1542ab850c977747b0","size_limiter":"validated","enqueued_at":"2026-08-15T23:33:40.081Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleOldPipelinesRemovalCronWorker JID-690beecd89a884e029f4ff46: done: 0.223577 sec","job_status":"done","queue_duration_s":0.564805,"scheduling_latency_s":0.564824,"redis_calls":28,"redis_duration_s":0.097832,"redis_read_bytes":36,"redis_write_bytes":10603,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000857,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":680,"redis_queues_calls":2,"redis_queues_duration_s":0.003436,"redis_queues_read_bytes":3,"redis_queues_write_bytes":8315,"redis_queues_metadata_calls":16,"redis_queues_metadata_duration_s":0.091834,"redis_queues_metadata_read_bytes":24,"redis_queues_metadata_write_bytes":1162,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001705,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":446,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.011,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.061228,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00157704,"duration_s":0.223577,"completed_at":"2026-08-15T23:33:40.869Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.023448,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1229gitlab # [ 233.053865] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:33:40.873Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"5ab7c32a7d74e7035f95a3f1","created_at":"2026-08-15T23:33:40.125Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-0b849d46bd594c09","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f5d23c91842d2768cf0619db55fb8714","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-15T23:33:40.137Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-5ab7c32a7d74e7035f95a3f1: start","job_status":"start","queue_duration_s":0.735191,"scheduling_latency_s":0.735237}1230gitlab # [ 233.563451] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:33:41.473Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"5ab7c32a7d74e7035f95a3f1","created_at":"2026-08-15T23:33:40.125Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-0b849d46bd594c09","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f5d23c91842d2768cf0619db55fb8714","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-15T23:33:40.137Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-5ab7c32a7d74e7035f95a3f1: done: 0.600928 sec","job_status":"done","queue_duration_s":0.735191,"scheduling_latency_s":0.735237,"redis_calls":565,"redis_duration_s":0.153259,"redis_read_bytes":564,"redis_write_bytes":49139,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000988,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001595,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":546,"redis_shared_state_calls":557,"redis_shared_state_duration_s":0.150676,"redis_shared_state_read_bytes":558,"redis_shared_state_write_bytes":48290,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.492119,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00042014,"duration_s":0.600928,"completed_at":"2026-08-15T23:33:41.473Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00211,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1231gitlab # [ 233.660238] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:33:41.475Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"fbd89be0d555241ed4009bcd","created_at":"2026-08-15T23:33:40.165Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-0b849d46bd594c09","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0de3e77d49d3f2abdf109fd507da3806","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-15T23:33:40.188Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-fbd89be0d555241ed4009bcd: start","job_status":"start","queue_duration_s":1.287244,"scheduling_latency_s":1.28727}1232gitlab # [ 233.678223] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:33:41.516Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"fbd89be0d555241ed4009bcd","created_at":"2026-08-15T23:33:40.165Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-0b849d46bd594c09","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0de3e77d49d3f2abdf109fd507da3806","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-15T23:33:40.188Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-fbd89be0d555241ed4009bcd: done: 0.040699 sec","job_status":"done","queue_duration_s":1.287244,"scheduling_latency_s":1.28727,"redis_calls":10,"redis_duration_s":0.002856,"redis_read_bytes":9,"redis_write_bytes":1061,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000599,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00169,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":550,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000567,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":208,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024623,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00063696,"duration_s":0.040699,"completed_at":"2026-08-15T23:33:41.516Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00388,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1233gitlab # [ 233.722231] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:33:41.518Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"419c7d716f443e8b1bad8915","created_at":"2026-08-15T23:33:40.237Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-0b849d46bd594c09","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"bad2e113f337798c097b369a7f0e845d","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-15T23:33:40.291Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-419c7d716f443e8b1bad8915: start","job_status":"start","queue_duration_s":1.227108,"scheduling_latency_s":1.227133}1234gitlab # [ 233.736708] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:33:41.585Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"419c7d716f443e8b1bad8915","created_at":"2026-08-15T23:33:40.237Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-0b849d46bd594c09","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"bad2e113f337798c097b369a7f0e845d","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-15T23:33:40.291Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-419c7d716f443e8b1bad8915: done: 0.067018 sec","job_status":"done","queue_duration_s":1.227108,"scheduling_latency_s":1.227133,"redis_calls":10,"redis_duration_s":0.0035900000000000003,"redis_read_bytes":9,"redis_write_bytes":1289,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000573,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002229,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000788,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.025,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.025,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025693,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00117126,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.067018,"completed_at":"2026-08-15T23:33:41.585Z","load_balancing_strategy":"primary","db_duration_s":0.028335,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1235gitlab # [ 233.781844] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:33:41.588Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"PipelineScheduleWorker","jid":"7b8006ef7c7e3885150cebc1","created_at":"2026-08-15T23:33:40.313Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-0b849d46bd594c09","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2cf2e5892716f8b7ae60518feca87ae7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f6baa6e6d21754c4b13358fe49f8c31a08729a9dd276fb680a810caf1bc7fab5","size_limiter":"validated","enqueued_at":"2026-08-15T23:33:40.326Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineScheduleWorker JID-7b8006ef7c7e3885150cebc1: start","job_status":"start","queue_duration_s":1.262264,"scheduling_latency_s":1.262295}1236gitlab # [ 233.795273] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:33:41.652Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"PipelineScheduleWorker","jid":"7b8006ef7c7e3885150cebc1","created_at":"2026-08-15T23:33:40.313Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-0b849d46bd594c09","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2cf2e5892716f8b7ae60518feca87ae7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f6baa6e6d21754c4b13358fe49f8c31a08729a9dd276fb680a810caf1bc7fab5","size_limiter":"validated","enqueued_at":"2026-08-15T23:33:40.326Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineScheduleWorker JID-7b8006ef7c7e3885150cebc1: done: 0.063499 sec","job_status":"done","queue_duration_s":1.262264,"scheduling_latency_s":1.262295,"redis_calls":12,"redis_duration_s":0.007202,"redis_read_bytes":11,"redis_write_bytes":1281,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000697,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":287,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002525,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":518,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00398,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":476,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.034989,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00078092,"exclusive_lock_hold_duration_s":0.01866168,"duration_s":0.063499,"completed_at":"2026-08-15T23:33:41.651Z","load_balancing_strategy":"primary","db_duration_s":0.00736,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1237gitlab # [ 233.837302] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:33:41.655Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"551b5915524a94715e1c69be","created_at":"2026-08-15T23:33:40.334Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-0b849d46bd594c09","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d5b1fe1df54351d653489998e99a211b","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-15T23:33:40.347Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-551b5915524a94715e1c69be: start","job_status":"start","queue_duration_s":1.30849,"scheduling_latency_s":1.308532}1238gitlab # [ 233.851774] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:33:41.719Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"551b5915524a94715e1c69be","created_at":"2026-08-15T23:33:40.334Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-0b849d46bd594c09","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d5b1fe1df54351d653489998e99a211b","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-15T23:33:40.347Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-551b5915524a94715e1c69be: done: 0.063916 sec","job_status":"done","queue_duration_s":1.30849,"scheduling_latency_s":1.308532,"redis_calls":16,"redis_duration_s":0.003807,"redis_read_bytes":15,"redis_write_bytes":1942,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.001788,"redis_feature_flag_read_bytes":8,"redis_feature_flag_write_bytes":1148,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001462,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":574,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000557,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":220,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.011,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.037816,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00054334,"duration_s":0.063916,"completed_at":"2026-08-15T23:33:41.719Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.01273,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1239gitlab # [ 233.894757] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:33:41.721Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"cd6bff5d9172beb4a6612ced","created_at":"2026-08-15T23:33:40.361Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-0b849d46bd594c09","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"aa268121bcdbae9f0b72e52cdce69043","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-15T23:33:40.371Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-cd6bff5d9172beb4a6612ced: start","job_status":"start","queue_duration_s":1.350211,"scheduling_latency_s":1.350231}1240gitlab # [ 233.909872] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:33:41.745Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"cd6bff5d9172beb4a6612ced","created_at":"2026-08-15T23:33:40.361Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-0b849d46bd594c09","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"aa268121bcdbae9f0b72e52cdce69043","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-15T23:33:40.371Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-cd6bff5d9172beb4a6612ced: done: 0.024347 sec","job_status":"done","queue_duration_s":1.350211,"scheduling_latency_s":1.350231,"redis_calls":12,"redis_duration_s":0.001849,"redis_read_bytes":11,"redis_write_bytes":1566,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000681,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":628,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00084,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":670,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000328,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":268,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015649,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00025358,"duration_s":0.024347,"completed_at":"2026-08-15T23:33:41.745Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000684,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1241gitlab # [ 233.954406] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:33:41.746Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"dcc7f648d60a5864e5b21f75","created_at":"2026-08-15T23:33:40.377Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-0b849d46bd594c09","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"370099deac9446510792588cc3f866b7","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-15T23:33:40.393Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-dcc7f648d60a5864e5b21f75: start","job_status":"start","queue_duration_s":1.35371,"scheduling_latency_s":1.353728}1242gitlab # [ 233.969383] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:33:41.758Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0}1243gitlab # [ 233.973317] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:33:41.765Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"dcc7f648d60a5864e5b21f75","created_at":"2026-08-15T23:33:40.377Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-0b849d46bd594c09","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"370099deac9446510792588cc3f866b7","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-15T23:33:40.393Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-dcc7f648d60a5864e5b21f75: done: 0.01882 sec","job_status":"done","queue_duration_s":1.35371,"scheduling_latency_s":1.353728,"redis_calls":10,"redis_duration_s":0.001353,"redis_read_bytes":9,"redis_write_bytes":1283,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000278,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000761,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":662,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000314,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":264,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011241,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00023212,"duration_s":0.01882,"completed_at":"2026-08-15T23:33:41.765Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000316,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1244gitlab # [ 234.017373] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:33:41.767Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"2da495fb0d813ff9d137d1d5","created_at":"2026-08-15T23:33:40.427Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-0b849d46bd594c09","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"47593a9a08e3e509df1d8187425b8831","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-15T23:33:40.437Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-2da495fb0d813ff9d137d1d5: start","job_status":"start","queue_duration_s":1.329402,"scheduling_latency_s":1.329419}1245gitlab # [ 234.032246] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:33:41.797Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"2da495fb0d813ff9d137d1d5","created_at":"2026-08-15T23:33:40.427Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-0b849d46bd594c09","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"47593a9a08e3e509df1d8187425b8831","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-15T23:33:40.437Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-2da495fb0d813ff9d137d1d5: done: 0.030752 sec","job_status":"done","queue_duration_s":1.329402,"scheduling_latency_s":1.329419,"redis_calls":13,"redis_duration_s":0.002006,"redis_read_bytes":12,"redis_write_bytes":1668,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000293,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.000902,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":728,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000811,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":603,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021187,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00953598,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.030752,"completed_at":"2026-08-15T23:33:41.797Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002238,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1246gitlab # [ 234.077494] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:33:41.798Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"08ff1b25a8f7370415cda9d5","created_at":"2026-08-15T23:33:40.458Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-0b849d46bd594c09","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"bee46b8dc7f9ca337aa91c3eddf051f7","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-15T23:33:40.482Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-08ff1b25a8f7370415cda9d5: start","job_status":"start","queue_duration_s":1.31684,"scheduling_latency_s":1.316857}1247gitlab # [ 234.091270] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:33:41.810Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0}1248gitlab # [ 234.095223] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:33:41.817Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"08ff1b25a8f7370415cda9d5","created_at":"2026-08-15T23:33:40.458Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-0b849d46bd594c09","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"bee46b8dc7f9ca337aa91c3eddf051f7","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-15T23:33:40.482Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-08ff1b25a8f7370415cda9d5: done: 0.01887 sec","job_status":"done","queue_duration_s":1.31684,"scheduling_latency_s":1.316857,"redis_calls":10,"redis_duration_s":0.0013570000000000001,"redis_read_bytes":9,"redis_write_bytes":1253,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000288,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":351,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000763,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":646,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000306,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":256,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01129,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00022842,"duration_s":0.01887,"completed_at":"2026-08-15T23:33:41.817Z","load_balancing_strategy":"primary","db_duration_s":0.000298,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1249gitlab # [ 234.137188] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:33:41.819Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"0dc62d161879410aadbd0fbc","created_at":"2026-08-15T23:33:40.524Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-0b849d46bd594c09","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c9f485a536ab2b7117ea6fa1e6f50349","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-15T23:33:40.554Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-0dc62d161879410aadbd0fbc: start","job_status":"start","queue_duration_s":1.265149,"scheduling_latency_s":1.265168}1250gitlab # [ 234.152112] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:33:41.844Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"0dc62d161879410aadbd0fbc","created_at":"2026-08-15T23:33:40.524Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-0b849d46bd594c09","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c9f485a536ab2b7117ea6fa1e6f50349","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-15T23:33:40.554Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-0dc62d161879410aadbd0fbc: done: 0.025476 sec","job_status":"done","queue_duration_s":1.265149,"scheduling_latency_s":1.265168,"redis_calls":12,"redis_duration_s":0.0016359999999999999,"redis_read_bytes":11,"redis_write_bytes":1489,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000272,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000735,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000629,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":560,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016232,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.0004553,"exclusive_lock_hold_duration_s":0.00655384,"duration_s":0.025476,"completed_at":"2026-08-15T23:33:41.844Z","load_balancing_strategy":"primary","db_duration_s":0.002512,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1251gitlab # [ 234.194323] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:33:41.845Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"425825c888cb3562264c728b","created_at":"2026-08-15T23:33:40.559Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-0b849d46bd594c09","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"22b236da2ee3a122f2c9784763341374","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-15T23:33:40.567Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-425825c888cb3562264c728b: start","job_status":"start","queue_duration_s":1.278173,"scheduling_latency_s":1.27819}1252gitlab # [ 234.208361] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:33:41.954Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"425825c888cb3562264c728b","created_at":"2026-08-15T23:33:40.559Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-0b849d46bd594c09","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"22b236da2ee3a122f2c9784763341374","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-15T23:33:40.567Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-425825c888cb3562264c728b: done: 0.109086 sec","job_status":"done","queue_duration_s":1.278173,"scheduling_latency_s":1.27819,"redis_calls":71,"redis_duration_s":0.010277,"redis_read_bytes":120,"redis_write_bytes":42624,"redis_feature_flag_calls":10,"redis_feature_flag_duration_s":0.001401,"redis_feature_flag_read_bytes":10,"redis_feature_flag_write_bytes":1471,"redis_queues_calls":2,"redis_queues_duration_s":0.00072,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37435,"redis_queues_metadata_calls":56,"redis_queues_metadata_duration_s":0.007717,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3418,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000439,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":300,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.097026,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00023146,"duration_s":0.109086,"completed_at":"2026-08-15T23:33:41.954Z","load_balancing_strategy":"primary","db_duration_s":0.001459,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1253gitlab # [ 234.252187] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:33:41.955Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"e74bc0fc8368a3d993056dab","created_at":"2026-08-15T23:33:40.572Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-0b849d46bd594c09","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3528cdafe44a625df162370b50e8c9ef","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-15T23:33:40.579Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-e74bc0fc8368a3d993056dab: start","job_status":"start","queue_duration_s":1.376455,"scheduling_latency_s":1.376472}1254gitlab # [ 234.266765] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:33:41.977Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"e74bc0fc8368a3d993056dab","created_at":"2026-08-15T23:33:40.572Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-0b849d46bd594c09","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3528cdafe44a625df162370b50e8c9ef","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-15T23:33:40.579Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-e74bc0fc8368a3d993056dab: done: 0.021302 sec","job_status":"done","queue_duration_s":1.376455,"scheduling_latency_s":1.376472,"redis_calls":12,"redis_duration_s":0.0016150000000000001,"redis_read_bytes":11,"redis_write_bytes":1511,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000272,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000703,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00064,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":566,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013193,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00044238,"exclusive_lock_hold_duration_s":0.00304806,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.021302,"completed_at":"2026-08-15T23:33:41.977Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001166,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1255gitlab # [ 234.310921] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:33:41.978Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"71714674dd9b2e081ef96e8a","created_at":"2026-08-15T23:33:40.594Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-0b849d46bd594c09","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"64ace37e135eae04d5b24f5892fe20bb","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-15T23:33:40.617Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-71714674dd9b2e081ef96e8a: start","job_status":"start","queue_duration_s":1.361103,"scheduling_latency_s":1.36112}1256gitlab # [ 234.325769] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:33:41.990Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0}1257gitlab # [ 234.329435] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:33:41.997Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"71714674dd9b2e081ef96e8a","created_at":"2026-08-15T23:33:40.594Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-0b849d46bd594c09","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"64ace37e135eae04d5b24f5892fe20bb","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-15T23:33:40.617Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-71714674dd9b2e081ef96e8a: done: 0.019008 sec","job_status":"done","queue_duration_s":1.361103,"scheduling_latency_s":1.36112,"redis_calls":10,"redis_duration_s":0.001542,"redis_read_bytes":9,"redis_write_bytes":1199,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000307,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000948,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":618,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000287,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":242,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011575,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00022932,"duration_s":0.019008,"completed_at":"2026-08-15T23:33:41.997Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000321,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1258gitlab # [ 234.373406] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:33:41.998Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"72d545145ec399f88ad8d803","created_at":"2026-08-15T23:33:40.625Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-0b849d46bd594c09","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"46288c50b5f5ee33cf9c07a53a1f9332","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-15T23:33:40.640Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-72d545145ec399f88ad8d803: start","job_status":"start","queue_duration_s":1.358467,"scheduling_latency_s":1.358483}1259gitlab # [ 234.388217] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:33:42.036Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"72d545145ec399f88ad8d803","created_at":"2026-08-15T23:33:40.625Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-0b849d46bd594c09","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"46288c50b5f5ee33cf9c07a53a1f9332","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-15T23:33:40.640Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-72d545145ec399f88ad8d803: done: 0.038374 sec","job_status":"done","queue_duration_s":1.358467,"scheduling_latency_s":1.358483,"redis_calls":12,"redis_duration_s":0.001984,"redis_read_bytes":11,"redis_write_bytes":1622,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000271,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":349,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000975,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":658,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000738,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":615,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.01,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021294,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00054636,"exclusive_lock_hold_duration_s":0.0139715,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.038374,"completed_at":"2026-08-15T23:33:42.036Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.011218,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1260gitlab # [ 234.433243] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:33:42.038Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"bc407851369dab03a7231170","created_at":"2026-08-15T23:33:40.642Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-0b849d46bd594c09","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5eed5313345943576e26459f4af50113","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-15T23:33:40.660Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-bc407851369dab03a7231170: start","job_status":"start","queue_duration_s":1.378265,"scheduling_latency_s":1.378282}1261gitlab # [ 234.447513] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:33:42.280Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"bc407851369dab03a7231170","created_at":"2026-08-15T23:33:40.642Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-0b849d46bd594c09","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5eed5313345943576e26459f4af50113","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-15T23:33:40.660Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-bc407851369dab03a7231170: done: 0.242055 sec","job_status":"done","queue_duration_s":1.378265,"scheduling_latency_s":1.378282,"redis_calls":12,"redis_duration_s":0.003045,"redis_read_bytes":11,"redis_write_bytes":1370,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000271,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001241,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001533,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":511,"db_count":130,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":130,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.029,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":129,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":84,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.029,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.195712,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.0004571,"exclusive_lock_hold_duration_s":0.22107502,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"ci","turbo_mode":false},"duration_s":0.242055,"completed_at":"2026-08-15T23:33:42.280Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.048056,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1262gitlab # [ 234.492300] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:33:42.282Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"39f3d7abff6328b3421105a0","created_at":"2026-08-15T23:33:40.664Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-0b849d46bd594c09","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b1208e518bc7312aa7b301e446be5705","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-15T23:33:40.678Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-39f3d7abff6328b3421105a0: start","job_status":"start","queue_duration_s":1.603366,"scheduling_latency_s":1.603383}1263gitlab # [ 234.506909] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:33:42.302Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"39f3d7abff6328b3421105a0","created_at":"2026-08-15T23:33:40.664Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-0b849d46bd594c09","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b1208e518bc7312aa7b301e446be5705","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-15T23:33:40.678Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-39f3d7abff6328b3421105a0: done: 0.020557 sec","job_status":"done","queue_duration_s":1.603366,"scheduling_latency_s":1.603383,"redis_calls":10,"redis_duration_s":0.00296,"redis_read_bytes":9,"redis_write_bytes":1215,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000761,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":343,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001341,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":626,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000858,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":246,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011574,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00049734,"duration_s":0.020557,"completed_at":"2026-08-15T23:33:42.302Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000336,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1264gitlab # [ 234.549892] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:33:42.304Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"eb4b2b7c7902f310025ae6f6","created_at":"2026-08-15T23:33:40.700Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-0b849d46bd594c09","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"608c82707db13f560f8470ce03e792a7","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-15T23:33:40.730Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-eb4b2b7c7902f310025ae6f6: start","job_status":"start","queue_duration_s":1.573707,"scheduling_latency_s":1.573725}1265gitlab # [ 234.566358] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:33:42.316Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0}1266gitlab # [ 234.569864] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:33:42.323Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"eb4b2b7c7902f310025ae6f6","created_at":"2026-08-15T23:33:40.700Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-0b849d46bd594c09","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"608c82707db13f560f8470ce03e792a7","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-15T23:33:40.730Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-eb4b2b7c7902f310025ae6f6: done: 0.019268 sec","job_status":"done","queue_duration_s":1.573707,"scheduling_latency_s":1.573725,"redis_calls":10,"redis_duration_s":0.002652,"redis_read_bytes":9,"redis_write_bytes":1291,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00051,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":359,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001444,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000698,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01125,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00033236,"duration_s":0.019268,"completed_at":"2026-08-15T23:33:42.323Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000327,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1267gitlab # [ 234.613369] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:33:42.325Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"d1db456fe6d134d6dcc1fc2a","created_at":"2026-08-15T23:33:40.689Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-9a8faf48ad074bb5","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"cdf2f18a0d932abb63d3029dd3bacf6d","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:33:40.799Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-d1db456fe6d134d6dcc1fc2a: start","job_status":"start","queue_duration_s":1.526167,"scheduling_latency_s":1.526183}1268gitlab # [ 234.627108] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:33:42.366Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"d1db456fe6d134d6dcc1fc2a","created_at":"2026-08-15T23:33:40.689Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-9a8faf48ad074bb5","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"cdf2f18a0d932abb63d3029dd3bacf6d","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:33:40.799Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-d1db456fe6d134d6dcc1fc2a: done: 0.04141 sec","job_status":"done","queue_duration_s":1.526167,"scheduling_latency_s":1.526183,"redis_calls":16,"redis_duration_s":0.003942,"redis_read_bytes":14,"redis_write_bytes":1526,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000457,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":301,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001096,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":423,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002389,"redis_shared_state_read_bytes":9,"redis_shared_state_write_bytes":802,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022582,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0003258,"duration_s":0.04141,"completed_at":"2026-08-15T23:33:42.366Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.008964,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1269gitlab # [ 234.669348] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:33:42.368Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"1ba6cee7d60223954b2599db","created_at":"2026-08-15T23:33:40.689Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-9a8faf48ad074bb5","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"cdf2f18a0d932abb63d3029dd3bacf6d","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:33:40.799Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-1ba6cee7d60223954b2599db: start","job_status":"start","queue_duration_s":1.569305,"scheduling_latency_s":1.56932}1270gitlab # [ 234.683062] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:33:42.386Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"1ba6cee7d60223954b2599db","created_at":"2026-08-15T23:33:40.689Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-9a8faf48ad074bb5","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"cdf2f18a0d932abb63d3029dd3bacf6d","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:33:40.799Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-1ba6cee7d60223954b2599db: done: 0.01812 sec","job_status":"done","queue_duration_s":1.569305,"scheduling_latency_s":1.56932,"redis_calls":13,"redis_duration_s":0.00294,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000951,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001989,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010454,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01812,"completed_at":"2026-08-15T23:33:42.386Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001926,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1271gitlab # [ 234.723606] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:33:42.388Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"d01eec3dcedd305a5d48a4a7","created_at":"2026-08-15T23:33:40.689Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-9a8faf48ad074bb5","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"cdf2f18a0d932abb63d3029dd3bacf6d","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:33:40.799Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-d01eec3dcedd305a5d48a4a7: start","job_status":"start","queue_duration_s":1.589105,"scheduling_latency_s":1.589121}1272gitlab # [ 234.737405] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:33:42.406Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"d01eec3dcedd305a5d48a4a7","created_at":"2026-08-15T23:33:40.689Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-9a8faf48ad074bb5","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"cdf2f18a0d932abb63d3029dd3bacf6d","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:33:40.799Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-d01eec3dcedd305a5d48a4a7: done: 0.018027 sec","job_status":"done","queue_duration_s":1.589105,"scheduling_latency_s":1.589121,"redis_calls":13,"redis_duration_s":0.003164,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000983,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002181,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010531,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018027,"completed_at":"2026-08-15T23:33:42.406Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001777,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1273gitlab # [ 234.778935] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:33:42.407Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"b84bc54d054c4f25c6764a97","created_at":"2026-08-15T23:33:40.689Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-9a8faf48ad074bb5","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"cdf2f18a0d932abb63d3029dd3bacf6d","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:33:40.799Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-b84bc54d054c4f25c6764a97: start","job_status":"start","queue_duration_s":1.608436,"scheduling_latency_s":1.608452}1274gitlab # [ 234.793582] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:33:42.425Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"b84bc54d054c4f25c6764a97","created_at":"2026-08-15T23:33:40.689Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-9a8faf48ad074bb5","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"cdf2f18a0d932abb63d3029dd3bacf6d","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:33:40.799Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-b84bc54d054c4f25c6764a97: done: 0.017643 sec","job_status":"done","queue_duration_s":1.608436,"scheduling_latency_s":1.608452,"redis_calls":13,"redis_duration_s":0.0029909999999999997,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000939,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002052,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010072,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017643,"completed_at":"2026-08-15T23:33:42.425Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001669,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1275gitlab # [ 234.833915] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:33:42.426Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"bc5ae30bd6e809fc1705c381","created_at":"2026-08-15T23:33:40.689Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-9a8faf48ad074bb5","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"cdf2f18a0d932abb63d3029dd3bacf6d","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:33:40.799Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-bc5ae30bd6e809fc1705c381: start","job_status":"start","queue_duration_s":1.627518,"scheduling_latency_s":1.627534}1276gitlab # [ 234.847516] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:33:42.444Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"bc5ae30bd6e809fc1705c381","created_at":"2026-08-15T23:33:40.689Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-9a8faf48ad074bb5","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"cdf2f18a0d932abb63d3029dd3bacf6d","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:33:40.799Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-bc5ae30bd6e809fc1705c381: done: 0.018067 sec","job_status":"done","queue_duration_s":1.627518,"scheduling_latency_s":1.627534,"redis_calls":13,"redis_duration_s":0.0030039999999999997,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000992,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002012,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010434,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018067,"completed_at":"2026-08-15T23:33:42.444Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001727,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1277gitlab # [ 234.888420] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:33:42.446Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"8fa9d07cb8012de668411d7e","created_at":"2026-08-15T23:33:40.689Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-9a8faf48ad074bb5","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"cdf2f18a0d932abb63d3029dd3bacf6d","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:33:40.799Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-8fa9d07cb8012de668411d7e: start","job_status":"start","queue_duration_s":1.647431,"scheduling_latency_s":1.647449}1278gitlab # [ 234.901684] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:33:42.464Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"8fa9d07cb8012de668411d7e","created_at":"2026-08-15T23:33:40.689Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-9a8faf48ad074bb5","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"cdf2f18a0d932abb63d3029dd3bacf6d","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:33:40.799Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-8fa9d07cb8012de668411d7e: done: 0.017836 sec","job_status":"done","queue_duration_s":1.647431,"scheduling_latency_s":1.647449,"redis_calls":13,"redis_duration_s":0.00301,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000947,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002063,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010322,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017836,"completed_at":"2026-08-15T23:33:42.464Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001747,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1279gitlab # [ 234.942236] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:33:42.465Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"fb7eb17e998b87a24c852e11","created_at":"2026-08-15T23:33:40.689Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-9a8faf48ad074bb5","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"cdf2f18a0d932abb63d3029dd3bacf6d","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:33:40.799Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-fb7eb17e998b87a24c852e11: start","job_status":"start","queue_duration_s":1.666426,"scheduling_latency_s":1.666442}1280gitlab # [ 234.955920] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:33:42.483Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"fb7eb17e998b87a24c852e11","created_at":"2026-08-15T23:33:40.689Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-9a8faf48ad074bb5","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"cdf2f18a0d932abb63d3029dd3bacf6d","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:33:40.799Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-fb7eb17e998b87a24c852e11: done: 0.017609 sec","job_status":"done","queue_duration_s":1.666426,"scheduling_latency_s":1.666442,"redis_calls":13,"redis_duration_s":0.003063,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000968,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002095,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010423,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017609,"completed_at":"2026-08-15T23:33:42.483Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001151,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1281gitlab # [ 234.998068] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:33:42.484Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"8668114f5452dda4ce849123","created_at":"2026-08-15T23:33:40.689Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-9a8faf48ad074bb5","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"cdf2f18a0d932abb63d3029dd3bacf6d","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:33:40.799Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-8668114f5452dda4ce849123: start","job_status":"start","queue_duration_s":1.685449,"scheduling_latency_s":1.685466}1282gitlab # [ 235.011611] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:33:42.502Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"8668114f5452dda4ce849123","created_at":"2026-08-15T23:33:40.689Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-9a8faf48ad074bb5","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"cdf2f18a0d932abb63d3029dd3bacf6d","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:33:40.799Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-8668114f5452dda4ce849123: done: 0.017437 sec","job_status":"done","queue_duration_s":1.685449,"scheduling_latency_s":1.685466,"redis_calls":13,"redis_duration_s":0.0028380000000000002,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001007,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001831,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010468,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017437,"completed_at":"2026-08-15T23:33:42.502Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001144,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1283gitlab # [ 235.054128] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:33:42.503Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"c6f02c35a7d07412ccc89502","created_at":"2026-08-15T23:33:40.689Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-9a8faf48ad074bb5","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"cdf2f18a0d932abb63d3029dd3bacf6d","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:33:40.799Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-c6f02c35a7d07412ccc89502: start","job_status":"start","queue_duration_s":1.704364,"scheduling_latency_s":1.70438}1284gitlab # [ 235.067744] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:33:42.520Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"c6f02c35a7d07412ccc89502","created_at":"2026-08-15T23:33:40.689Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-9a8faf48ad074bb5","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"cdf2f18a0d932abb63d3029dd3bacf6d","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:33:40.799Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-c6f02c35a7d07412ccc89502: done: 0.017017 sec","job_status":"done","queue_duration_s":1.704364,"scheduling_latency_s":1.70438,"redis_calls":13,"redis_duration_s":0.003046,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00093,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002116,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010323,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017017,"completed_at":"2026-08-15T23:33:42.520Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001115,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1285gitlab # [ 235.108133] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:33:42.521Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"2b7000695dfef3ab8067801e","created_at":"2026-08-15T23:33:40.689Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-9a8faf48ad074bb5","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"cdf2f18a0d932abb63d3029dd3bacf6d","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:33:40.799Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-2b7000695dfef3ab8067801e: start","job_status":"start","queue_duration_s":1.72279,"scheduling_latency_s":1.722806}1286gitlab # [ 235.121991] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:33:42.539Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"2b7000695dfef3ab8067801e","created_at":"2026-08-15T23:33:40.689Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-9a8faf48ad074bb5","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"cdf2f18a0d932abb63d3029dd3bacf6d","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:33:40.799Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-2b7000695dfef3ab8067801e: done: 0.017428 sec","job_status":"done","queue_duration_s":1.72279,"scheduling_latency_s":1.722806,"redis_calls":13,"redis_duration_s":0.0030830000000000002,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000955,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002128,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010153,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017428,"completed_at":"2026-08-15T23:33:42.539Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001137,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1287gitlab # [ 235.162869] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:33:42.540Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"06a460459f9fb0afd8f45645","created_at":"2026-08-15T23:33:40.782Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-0b849d46bd594c09","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"33b3e13a67bd89c8e542fb75fc8a95cb","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-15T23:33:40.802Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-06a460459f9fb0afd8f45645: start","job_status":"start","queue_duration_s":1.738338,"scheduling_latency_s":1.738354}1288gitlab # [ 235.179078] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:33:42.552Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0}1289gitlab # [ 235.182530] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:33:42.560Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"06a460459f9fb0afd8f45645","created_at":"2026-08-15T23:33:40.782Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-0b849d46bd594c09","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"33b3e13a67bd89c8e542fb75fc8a95cb","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-15T23:33:40.802Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-06a460459f9fb0afd8f45645: done: 0.019313 sec","job_status":"done","queue_duration_s":1.738338,"scheduling_latency_s":1.738354,"redis_calls":10,"redis_duration_s":0.002392,"redis_read_bytes":9,"redis_write_bytes":1207,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000542,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001378,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000472,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010992,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00032196,"duration_s":0.019313,"completed_at":"2026-08-15T23:33:42.560Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000663,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1290gitlab # [ 235.225460] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:33:42.561Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"b6183973dc75014da3cd133c","created_at":"2026-08-15T23:33:40.859Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-0b849d46bd594c09","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"938c179c8f3b9dbca395a8a94ee08147","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-08-15T23:33:40.879Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-b6183973dc75014da3cd133c: start","job_status":"start","queue_duration_s":1.681881,"scheduling_latency_s":1.681897}1291gitlab # [ 235.239138] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:33:42.599Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"b6183973dc75014da3cd133c","created_at":"2026-08-15T23:33:40.859Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-0b849d46bd594c09","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"938c179c8f3b9dbca395a8a94ee08147","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-08-15T23:33:40.879Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-b6183973dc75014da3cd133c: done: 0.037626 sec","job_status":"done","queue_duration_s":1.681881,"scheduling_latency_s":1.681897,"redis_calls":19,"redis_duration_s":0.004795,"redis_read_bytes":22,"redis_write_bytes":4789,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001101,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":672,"redis_queues_calls":2,"redis_queues_duration_s":0.000352,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3019,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.002506,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":814,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000836,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":284,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024927,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00031566,"duration_s":0.037626,"completed_at":"2026-08-15T23:33:42.599Z","load_balancing_strategy":"primary","db_duration_s":0.00338,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1292gitlab # [ 235.282853] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:33:42.600Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"5d6faa4315edf3ed2e6b2e6c","created_at":"2026-08-15T23:33:40.998Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-0b849d46bd594c09","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e40b1d684ab52af6874580f05e82144e","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-15T23:33:41.017Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-5d6faa4315edf3ed2e6b2e6c: start","job_status":"start","queue_duration_s":1.583629,"scheduling_latency_s":1.583644}1293gitlab # [ 235.296745] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:33:42.635Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"5d6faa4315edf3ed2e6b2e6c","created_at":"2026-08-15T23:33:40.998Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-0b849d46bd594c09","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e40b1d684ab52af6874580f05e82144e","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-15T23:33:41.017Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-5d6faa4315edf3ed2e6b2e6c: done: 0.035028 sec","job_status":"done","queue_duration_s":1.583629,"scheduling_latency_s":1.583644,"redis_calls":10,"redis_duration_s":0.002844,"redis_read_bytes":9,"redis_write_bytes":1157,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000559,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001712,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000573,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020218,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00036232,"duration_s":0.035028,"completed_at":"2026-08-15T23:33:42.635Z","load_balancing_strategy":"primary","db_duration_s":0.006698,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1294gitlab # [ 235.338883] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:33:42.637Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"aafbf10ec48e84acec80f1d2","created_at":"2026-08-15T23:33:41.865Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-76de9df31b114f3f","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"22b236da2ee3a122f2c9784763341374","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:33:41.945Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-aafbf10ec48e84acec80f1d2: start","job_status":"start","queue_duration_s":0.691538,"scheduling_latency_s":0.691555}1295gitlab # [ 235.351702] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:33:42.660Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"aafbf10ec48e84acec80f1d2","created_at":"2026-08-15T23:33:41.865Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-76de9df31b114f3f","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"22b236da2ee3a122f2c9784763341374","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:33:41.945Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-aafbf10ec48e84acec80f1d2: done: 0.022822 sec","job_status":"done","queue_duration_s":0.691538,"scheduling_latency_s":0.691555,"redis_calls":16,"redis_duration_s":0.003748,"redis_read_bytes":14,"redis_write_bytes":1544,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000522,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.0011,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":439,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002126,"redis_shared_state_read_bytes":9,"redis_shared_state_write_bytes":798,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013043,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00031246,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.022822,"completed_at":"2026-08-15T23:33:42.660Z","load_balancing_strategy":"primary","db_duration_s":0.000652,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1296gitlab # [ 235.394980] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:33:42.661Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1a800152edecd22506d8e5cb","created_at":"2026-08-15T23:33:41.865Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-76de9df31b114f3f","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"22b236da2ee3a122f2c9784763341374","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:33:41.945Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1a800152edecd22506d8e5cb: start","job_status":"start","queue_duration_s":0.715632,"scheduling_latency_s":0.715648}1297gitlab # [ 235.407729] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:33:42.687Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1a800152edecd22506d8e5cb","created_at":"2026-08-15T23:33:41.865Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-76de9df31b114f3f","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"22b236da2ee3a122f2c9784763341374","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:33:41.945Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1a800152edecd22506d8e5cb: done: 0.026587 sec","job_status":"done","queue_duration_s":0.715632,"scheduling_latency_s":0.715648,"redis_calls":13,"redis_duration_s":0.012346,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001887,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.010459,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011156,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.026587,"completed_at":"2026-08-15T23:33:42.687Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1298gitlab # [ 235.447434] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:33:42.689Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2400ad66b68d4e9fdaa18f35","created_at":"2026-08-15T23:33:41.865Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-76de9df31b114f3f","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"22b236da2ee3a122f2c9784763341374","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:33:41.945Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2400ad66b68d4e9fdaa18f35: start","job_status":"start","queue_duration_s":0.7437,"scheduling_latency_s":0.743717}1299gitlab # [ 235.460185] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:33:42.707Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2400ad66b68d4e9fdaa18f35","created_at":"2026-08-15T23:33:41.865Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-76de9df31b114f3f","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"22b236da2ee3a122f2c9784763341374","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:33:41.945Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2400ad66b68d4e9fdaa18f35: done: 0.017986 sec","job_status":"done","queue_duration_s":0.7437,"scheduling_latency_s":0.743717,"redis_calls":13,"redis_duration_s":0.004421,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000981,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00344,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010437,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017986,"completed_at":"2026-08-15T23:33:42.707Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1300gitlab # [ 235.499335] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:33:42.709Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b4d28c2f837a79760c1dddc1","created_at":"2026-08-15T23:33:41.865Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-76de9df31b114f3f","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"22b236da2ee3a122f2c9784763341374","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:33:41.945Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b4d28c2f837a79760c1dddc1: start","job_status":"start","queue_duration_s":0.763812,"scheduling_latency_s":0.76383}1301gitlab # [ 235.512197] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:33:42.726Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b4d28c2f837a79760c1dddc1","created_at":"2026-08-15T23:33:41.865Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-76de9df31b114f3f","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"22b236da2ee3a122f2c9784763341374","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:33:41.945Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b4d28c2f837a79760c1dddc1: done: 0.016489 sec","job_status":"done","queue_duration_s":0.763812,"scheduling_latency_s":0.76383,"redis_calls":13,"redis_duration_s":0.003096,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000996,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.0021,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009785,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016489,"completed_at":"2026-08-15T23:33:42.725Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1302gitlab # [ 235.551994] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:33:42.727Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"20d1d3a3470dec690535ff34","created_at":"2026-08-15T23:33:41.865Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-76de9df31b114f3f","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"22b236da2ee3a122f2c9784763341374","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:33:41.945Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-20d1d3a3470dec690535ff34: start","job_status":"start","queue_duration_s":0.781796,"scheduling_latency_s":0.781812}1303gitlab # [ 235.564564] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:33:42.742Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"20d1d3a3470dec690535ff34","created_at":"2026-08-15T23:33:41.865Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-76de9df31b114f3f","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"22b236da2ee3a122f2c9784763341374","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:33:41.945Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-20d1d3a3470dec690535ff34: done: 0.015262 sec","job_status":"done","queue_duration_s":0.781796,"scheduling_latency_s":0.781812,"redis_calls":13,"redis_duration_s":0.002788,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000899,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001889,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009513,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015262,"completed_at":"2026-08-15T23:33:42.742Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1304gitlab # [ 235.606736] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:33:42.744Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"108cda2d4e177cd6e6d050d6","created_at":"2026-08-15T23:33:41.865Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-76de9df31b114f3f","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"22b236da2ee3a122f2c9784763341374","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:33:41.945Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-108cda2d4e177cd6e6d050d6: start","job_status":"start","queue_duration_s":0.798392,"scheduling_latency_s":0.798409}1305gitlab # [ 235.619586] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:33:42.759Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"108cda2d4e177cd6e6d050d6","created_at":"2026-08-15T23:33:41.865Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-76de9df31b114f3f","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"22b236da2ee3a122f2c9784763341374","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:33:41.945Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-108cda2d4e177cd6e6d050d6: done: 0.015058 sec","job_status":"done","queue_duration_s":0.798392,"scheduling_latency_s":0.798409,"redis_calls":13,"redis_duration_s":0.002614,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000899,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001715,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009661,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015058,"completed_at":"2026-08-15T23:33:42.759Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1306gitlab # [ 235.659803] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:33:42.760Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"59fdead3c400885dfa098cfa","created_at":"2026-08-15T23:33:41.865Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-76de9df31b114f3f","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"22b236da2ee3a122f2c9784763341374","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:33:41.945Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-59fdead3c400885dfa098cfa: start","job_status":"start","queue_duration_s":0.815105,"scheduling_latency_s":0.81512}1307gitlab # [ 235.672744] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:33:42.776Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"59fdead3c400885dfa098cfa","created_at":"2026-08-15T23:33:41.865Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-76de9df31b114f3f","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"22b236da2ee3a122f2c9784763341374","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:33:41.945Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-59fdead3c400885dfa098cfa: done: 0.015179 sec","job_status":"done","queue_duration_s":0.815105,"scheduling_latency_s":0.81512,"redis_calls":13,"redis_duration_s":0.002758,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000971,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001787,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00961,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015179,"completed_at":"2026-08-15T23:33:42.775Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1308gitlab # [ 235.712477] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:33:42.777Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9a9e4d58bfc8f990376458be","created_at":"2026-08-15T23:33:41.865Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-76de9df31b114f3f","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"22b236da2ee3a122f2c9784763341374","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:33:41.945Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9a9e4d58bfc8f990376458be: start","job_status":"start","queue_duration_s":0.831734,"scheduling_latency_s":0.83175}1309gitlab # [ 235.725162] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:33:42.794Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9a9e4d58bfc8f990376458be","created_at":"2026-08-15T23:33:41.865Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-76de9df31b114f3f","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"22b236da2ee3a122f2c9784763341374","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:33:41.945Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9a9e4d58bfc8f990376458be: done: 0.016798 sec","job_status":"done","queue_duration_s":0.831734,"scheduling_latency_s":0.83175,"redis_calls":13,"redis_duration_s":0.003483,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001567,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001916,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010432,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016798,"completed_at":"2026-08-15T23:33:42.794Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1310gitlab # [ 235.765178] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:33:42.795Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"33e11cc13f2eb516da91aa16","created_at":"2026-08-15T23:33:41.865Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-76de9df31b114f3f","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"22b236da2ee3a122f2c9784763341374","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:33:41.945Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-33e11cc13f2eb516da91aa16: start","job_status":"start","queue_duration_s":0.850122,"scheduling_latency_s":0.85014}1311gitlab # [ 235.779319] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:33:42.812Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"33e11cc13f2eb516da91aa16","created_at":"2026-08-15T23:33:41.865Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-76de9df31b114f3f","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"22b236da2ee3a122f2c9784763341374","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:33:41.945Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-33e11cc13f2eb516da91aa16: done: 0.016218 sec","job_status":"done","queue_duration_s":0.850122,"scheduling_latency_s":0.85014,"redis_calls":13,"redis_duration_s":0.0029749999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000947,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002028,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010353,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016218,"completed_at":"2026-08-15T23:33:42.812Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1312gitlab # [ 235.820345] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:33:42.813Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c873d15eeb46bcfe9fab6556","created_at":"2026-08-15T23:33:41.865Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-76de9df31b114f3f","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"22b236da2ee3a122f2c9784763341374","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:33:41.945Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c873d15eeb46bcfe9fab6556: start","job_status":"start","queue_duration_s":0.867638,"scheduling_latency_s":0.867654}1313gitlab # [ 235.833076] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:33:42.829Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c873d15eeb46bcfe9fab6556","created_at":"2026-08-15T23:33:41.865Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-76de9df31b114f3f","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"22b236da2ee3a122f2c9784763341374","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:33:41.945Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c873d15eeb46bcfe9fab6556: done: 0.015959 sec","job_status":"done","queue_duration_s":0.867638,"scheduling_latency_s":0.867654,"redis_calls":13,"redis_duration_s":0.002945,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000987,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001958,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010078,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015959,"completed_at":"2026-08-15T23:33:42.829Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1314gitlab # [ 235.873410] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:33:42.830Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c2a06690f57273b427360cdc","created_at":"2026-08-15T23:33:41.865Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-76de9df31b114f3f","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"22b236da2ee3a122f2c9784763341374","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:33:41.945Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c2a06690f57273b427360cdc: start","job_status":"start","queue_duration_s":0.885004,"scheduling_latency_s":0.88502}1315gitlab # [ 235.886133] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:33:42.846Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c2a06690f57273b427360cdc","created_at":"2026-08-15T23:33:41.865Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-76de9df31b114f3f","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"22b236da2ee3a122f2c9784763341374","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:33:41.945Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c2a06690f57273b427360cdc: done: 0.016237 sec","job_status":"done","queue_duration_s":0.885004,"scheduling_latency_s":0.88502,"redis_calls":13,"redis_duration_s":0.003048,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00097,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002078,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009965,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016237,"completed_at":"2026-08-15T23:33:42.846Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1316gitlab # [ 235.925845] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:33:42.848Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6040999fc06e03e718c18a54","created_at":"2026-08-15T23:33:41.865Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-76de9df31b114f3f","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"22b236da2ee3a122f2c9784763341374","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:33:41.945Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6040999fc06e03e718c18a54: start","job_status":"start","queue_duration_s":0.902667,"scheduling_latency_s":0.902684}1317gitlab # [ 235.938544] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:33:42.864Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6040999fc06e03e718c18a54","created_at":"2026-08-15T23:33:41.865Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-76de9df31b114f3f","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"22b236da2ee3a122f2c9784763341374","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:33:41.945Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6040999fc06e03e718c18a54: done: 0.016558 sec","job_status":"done","queue_duration_s":0.902667,"scheduling_latency_s":0.902684,"redis_calls":13,"redis_duration_s":0.0032579999999999996,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001001,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002257,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010118,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016558,"completed_at":"2026-08-15T23:33:42.864Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1318gitlab # [ 235.979158] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:33:42.866Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"052f358227480b7139742317","created_at":"2026-08-15T23:33:41.865Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-76de9df31b114f3f","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"22b236da2ee3a122f2c9784763341374","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:33:41.945Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-052f358227480b7139742317: start","job_status":"start","queue_duration_s":0.920713,"scheduling_latency_s":0.920729}1319gitlab # [ 235.993125] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:33:42.883Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"052f358227480b7139742317","created_at":"2026-08-15T23:33:41.865Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-76de9df31b114f3f","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"22b236da2ee3a122f2c9784763341374","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:33:41.945Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-052f358227480b7139742317: done: 0.016654 sec","job_status":"done","queue_duration_s":0.920713,"scheduling_latency_s":0.920729,"redis_calls":13,"redis_duration_s":0.003112,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001105,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002007,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010278,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016654,"completed_at":"2026-08-15T23:33:42.883Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1320gitlab # [ 236.032586] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:33:42.884Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6bfb982b2fdcf20368aa751b","created_at":"2026-08-15T23:33:41.865Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-76de9df31b114f3f","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"22b236da2ee3a122f2c9784763341374","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:33:41.945Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6bfb982b2fdcf20368aa751b: start","job_status":"start","queue_duration_s":0.93882,"scheduling_latency_s":0.938837}1321gitlab # [ 236.045217] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:33:42.901Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6bfb982b2fdcf20368aa751b","created_at":"2026-08-15T23:33:41.865Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-76de9df31b114f3f","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"22b236da2ee3a122f2c9784763341374","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:33:41.945Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6bfb982b2fdcf20368aa751b: done: 0.016978 sec","job_status":"done","queue_duration_s":0.93882,"scheduling_latency_s":0.938837,"redis_calls":13,"redis_duration_s":0.0033480000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001312,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002036,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010276,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016978,"completed_at":"2026-08-15T23:33:42.901Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1322gitlab # [ 236.084774] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:33:42.903Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"075475c550bc27830e621778","created_at":"2026-08-15T23:33:41.865Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-76de9df31b114f3f","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"22b236da2ee3a122f2c9784763341374","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:33:41.945Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-075475c550bc27830e621778: start","job_status":"start","queue_duration_s":0.957531,"scheduling_latency_s":0.957547}1323gitlab # [ 236.097351] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:33:42.919Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"075475c550bc27830e621778","created_at":"2026-08-15T23:33:41.865Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-76de9df31b114f3f","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"22b236da2ee3a122f2c9784763341374","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:33:41.945Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-075475c550bc27830e621778: done: 0.016437 sec","job_status":"done","queue_duration_s":0.957531,"scheduling_latency_s":0.957547,"redis_calls":13,"redis_duration_s":0.003364,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001114,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00225,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010028,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016437,"completed_at":"2026-08-15T23:33:42.919Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1324gitlab # [ 236.137716] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:33:42.921Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9ea80bfbc706ed54f2288fc9","created_at":"2026-08-15T23:33:41.865Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-76de9df31b114f3f","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"22b236da2ee3a122f2c9784763341374","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:33:41.945Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9ea80bfbc706ed54f2288fc9: start","job_status":"start","queue_duration_s":0.975523,"scheduling_latency_s":0.97554}1325gitlab # [ 236.150419] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:33:42.937Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9ea80bfbc706ed54f2288fc9","created_at":"2026-08-15T23:33:41.865Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-76de9df31b114f3f","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"22b236da2ee3a122f2c9784763341374","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:33:41.945Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9ea80bfbc706ed54f2288fc9: done: 0.016499 sec","job_status":"done","queue_duration_s":0.975523,"scheduling_latency_s":0.97554,"redis_calls":13,"redis_duration_s":0.003419,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001105,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002314,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010221,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016499,"completed_at":"2026-08-15T23:33:42.937Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1326gitlab # [ 236.191872] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:33:42.939Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"39e68b14b7d717489365f137","created_at":"2026-08-15T23:33:41.865Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-76de9df31b114f3f","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"22b236da2ee3a122f2c9784763341374","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:33:41.945Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-39e68b14b7d717489365f137: start","job_status":"start","queue_duration_s":0.993788,"scheduling_latency_s":0.993804}1327gitlab # [ 236.204940] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:33:42.956Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"39e68b14b7d717489365f137","created_at":"2026-08-15T23:33:41.865Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-76de9df31b114f3f","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"22b236da2ee3a122f2c9784763341374","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:33:41.945Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-39e68b14b7d717489365f137: done: 0.016503 sec","job_status":"done","queue_duration_s":0.993788,"scheduling_latency_s":0.993804,"redis_calls":13,"redis_duration_s":0.003346,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001104,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002242,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010281,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016503,"completed_at":"2026-08-15T23:33:42.955Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1328gitlab # [ 236.244621] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:33:42.957Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7cfea277eead0ff578a9aead","created_at":"2026-08-15T23:33:41.865Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-76de9df31b114f3f","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"22b236da2ee3a122f2c9784763341374","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:33:41.945Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7cfea277eead0ff578a9aead: start","job_status":"start","queue_duration_s":1.012164,"scheduling_latency_s":1.01218}1329gitlab # [ 236.257323] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:33:42.974Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7cfea277eead0ff578a9aead","created_at":"2026-08-15T23:33:41.865Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-76de9df31b114f3f","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"22b236da2ee3a122f2c9784763341374","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:33:41.945Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7cfea277eead0ff578a9aead: done: 0.01685 sec","job_status":"done","queue_duration_s":1.012164,"scheduling_latency_s":1.01218,"redis_calls":13,"redis_duration_s":0.003522,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001179,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002343,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010423,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01685,"completed_at":"2026-08-15T23:33:42.974Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1330gitlab # [ 236.297209] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:33:42.976Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3630733aec20611fbdddca3a","created_at":"2026-08-15T23:33:41.865Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-76de9df31b114f3f","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"22b236da2ee3a122f2c9784763341374","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:33:41.945Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3630733aec20611fbdddca3a: start","job_status":"start","queue_duration_s":1.030777,"scheduling_latency_s":1.030795}1331gitlab # [ 236.309947] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:33:42.993Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3630733aec20611fbdddca3a","created_at":"2026-08-15T23:33:41.865Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-76de9df31b114f3f","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"22b236da2ee3a122f2c9784763341374","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:33:41.945Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3630733aec20611fbdddca3a: done: 0.016935 sec","job_status":"done","queue_duration_s":1.030777,"scheduling_latency_s":1.030795,"redis_calls":13,"redis_duration_s":0.0033299999999999996,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001256,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002074,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010757,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016935,"completed_at":"2026-08-15T23:33:42.993Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1332gitlab # [ 236.350123] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:33:42.994Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"63da0a16231c00785b01cae9","created_at":"2026-08-15T23:33:41.865Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-76de9df31b114f3f","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"22b236da2ee3a122f2c9784763341374","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:33:41.945Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-63da0a16231c00785b01cae9: start","job_status":"start","queue_duration_s":1.049152,"scheduling_latency_s":1.049168}1333gitlab # [ 236.362935] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:33:43.011Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"63da0a16231c00785b01cae9","created_at":"2026-08-15T23:33:41.865Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-76de9df31b114f3f","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"22b236da2ee3a122f2c9784763341374","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:33:41.945Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-63da0a16231c00785b01cae9: done: 0.016632 sec","job_status":"done","queue_duration_s":1.049152,"scheduling_latency_s":1.049168,"redis_calls":13,"redis_duration_s":0.003015,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00096,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002055,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01056,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016632,"completed_at":"2026-08-15T23:33:43.011Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1334gitlab # [ 236.404183] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:33:43.013Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"96d100c4d64c8bd209bc4ce2","created_at":"2026-08-15T23:33:41.865Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-76de9df31b114f3f","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"22b236da2ee3a122f2c9784763341374","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:33:41.945Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-96d100c4d64c8bd209bc4ce2: start","job_status":"start","queue_duration_s":1.067262,"scheduling_latency_s":1.067278}1335gitlab # [ 236.416653] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:33:43.034Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"96d100c4d64c8bd209bc4ce2","created_at":"2026-08-15T23:33:41.865Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-76de9df31b114f3f","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"22b236da2ee3a122f2c9784763341374","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:33:41.945Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-96d100c4d64c8bd209bc4ce2: done: 0.02107 sec","job_status":"done","queue_duration_s":1.067262,"scheduling_latency_s":1.067278,"redis_calls":13,"redis_duration_s":0.0030550000000000004,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001093,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001962,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012572,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.02107,"completed_at":"2026-08-15T23:33:43.034Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1336gitlab # [ 236.456476] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:33:43.037Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dc05f9f2030b4d6f6c424e11","created_at":"2026-08-15T23:33:41.865Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-76de9df31b114f3f","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"22b236da2ee3a122f2c9784763341374","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:33:41.945Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dc05f9f2030b4d6f6c424e11: start","job_status":"start","queue_duration_s":1.091477,"scheduling_latency_s":1.091519}1337gitlab # [ 236.469027] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:33:43.069Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dc05f9f2030b4d6f6c424e11","created_at":"2026-08-15T23:33:41.865Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-76de9df31b114f3f","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"22b236da2ee3a122f2c9784763341374","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:33:41.945Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dc05f9f2030b4d6f6c424e11: done: 0.032278 sec","job_status":"done","queue_duration_s":1.091477,"scheduling_latency_s":1.091519,"redis_calls":13,"redis_duration_s":0.003806,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00112,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002686,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021994,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.032278,"completed_at":"2026-08-15T23:33:43.069Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1338gitlab # [ 236.508486] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:33:43.070Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b0e12b5b23f14149d9bb0345","created_at":"2026-08-15T23:33:41.865Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-76de9df31b114f3f","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"22b236da2ee3a122f2c9784763341374","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:33:41.945Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b0e12b5b23f14149d9bb0345: start","job_status":"start","queue_duration_s":1.125215,"scheduling_latency_s":1.125234}1339gitlab # [ 236.521142] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:33:43.090Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b0e12b5b23f14149d9bb0345","created_at":"2026-08-15T23:33:41.865Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-76de9df31b114f3f","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"22b236da2ee3a122f2c9784763341374","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:33:41.945Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b0e12b5b23f14149d9bb0345: done: 0.019663 sec","job_status":"done","queue_duration_s":1.125215,"scheduling_latency_s":1.125234,"redis_calls":13,"redis_duration_s":0.003219,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001006,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002213,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01257,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019663,"completed_at":"2026-08-15T23:33:43.090Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1340gitlab # [ 236.561144] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:33:43.092Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b330994bc0b46220099bf6bb","created_at":"2026-08-15T23:33:41.865Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-76de9df31b114f3f","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"22b236da2ee3a122f2c9784763341374","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:33:41.945Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b330994bc0b46220099bf6bb: start","job_status":"start","queue_duration_s":1.146504,"scheduling_latency_s":1.146526}1341gitlab # [ 236.573632] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:33:43.112Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b330994bc0b46220099bf6bb","created_at":"2026-08-15T23:33:41.865Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-76de9df31b114f3f","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"22b236da2ee3a122f2c9784763341374","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:33:41.945Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b330994bc0b46220099bf6bb: done: 0.019963 sec","job_status":"done","queue_duration_s":1.146504,"scheduling_latency_s":1.146526,"redis_calls":13,"redis_duration_s":0.003258,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00113,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002128,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012579,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019963,"completed_at":"2026-08-15T23:33:43.112Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1342gitlab # [ 236.614928] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:33:43.113Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7145d16099f0db34ebe77c10","created_at":"2026-08-15T23:33:41.865Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-76de9df31b114f3f","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"22b236da2ee3a122f2c9784763341374","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:33:41.945Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7145d16099f0db34ebe77c10: start","job_status":"start","queue_duration_s":1.16821,"scheduling_latency_s":1.168232}1343gitlab # [ 236.627778] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:33:43.130Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7145d16099f0db34ebe77c10","created_at":"2026-08-15T23:33:41.865Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-76de9df31b114f3f","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"22b236da2ee3a122f2c9784763341374","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:33:41.945Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7145d16099f0db34ebe77c10: done: 0.016279 sec","job_status":"done","queue_duration_s":1.16821,"scheduling_latency_s":1.168232,"redis_calls":13,"redis_duration_s":0.002768,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000944,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001824,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010103,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016279,"completed_at":"2026-08-15T23:33:43.130Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1344gitlab # [ 236.668034] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:33:43.131Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3602519ec8670c610d496ed2","created_at":"2026-08-15T23:33:41.865Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-76de9df31b114f3f","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"22b236da2ee3a122f2c9784763341374","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:33:41.945Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3602519ec8670c610d496ed2: start","job_status":"start","queue_duration_s":1.186039,"scheduling_latency_s":1.186056}1345gitlab # [ 236.680443] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:33:43.147Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3602519ec8670c610d496ed2","created_at":"2026-08-15T23:33:41.865Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-76de9df31b114f3f","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"22b236da2ee3a122f2c9784763341374","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:33:41.945Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3602519ec8670c610d496ed2: done: 0.01587 sec","job_status":"done","queue_duration_s":1.186039,"scheduling_latency_s":1.186056,"redis_calls":13,"redis_duration_s":0.002714,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000922,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001792,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010204,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01587,"completed_at":"2026-08-15T23:33:43.147Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1346gitlab # [ 236.719798] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:33:43.149Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a4b9373d72a81880be72447a","created_at":"2026-08-15T23:33:41.865Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-76de9df31b114f3f","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"22b236da2ee3a122f2c9784763341374","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:33:41.945Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a4b9373d72a81880be72447a: start","job_status":"start","queue_duration_s":1.203517,"scheduling_latency_s":1.203535}1347gitlab # [ 236.732559] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:33:43.166Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a4b9373d72a81880be72447a","created_at":"2026-08-15T23:33:41.865Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-76de9df31b114f3f","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"22b236da2ee3a122f2c9784763341374","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:33:41.945Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a4b9373d72a81880be72447a: done: 0.016778 sec","job_status":"done","queue_duration_s":1.203517,"scheduling_latency_s":1.203535,"redis_calls":13,"redis_duration_s":0.002839,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000968,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001871,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010638,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016778,"completed_at":"2026-08-15T23:33:43.165Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1348gitlab # [ 236.772001] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:33:43.167Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"38a93479af4d17d92186771b","created_at":"2026-08-15T23:33:41.865Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-76de9df31b114f3f","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"22b236da2ee3a122f2c9784763341374","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:33:41.945Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-38a93479af4d17d92186771b: start","job_status":"start","queue_duration_s":1.221736,"scheduling_latency_s":1.221751}1349gitlab # [ 236.784579] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:33:43.183Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"38a93479af4d17d92186771b","created_at":"2026-08-15T23:33:41.865Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-76de9df31b114f3f","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"22b236da2ee3a122f2c9784763341374","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:33:41.945Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-38a93479af4d17d92186771b: done: 0.016013 sec","job_status":"done","queue_duration_s":1.221736,"scheduling_latency_s":1.221751,"redis_calls":13,"redis_duration_s":0.002697,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000904,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001793,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010461,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016013,"completed_at":"2026-08-15T23:33:43.183Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1350gitlab # [ 236.825482] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:33:43.185Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f5b795c5311280a2716a1c93","created_at":"2026-08-15T23:33:41.865Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-76de9df31b114f3f","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"22b236da2ee3a122f2c9784763341374","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:33:41.945Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f5b795c5311280a2716a1c93: start","job_status":"start","queue_duration_s":1.239283,"scheduling_latency_s":1.239303}1351gitlab # [ 236.863200] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:33:43.201Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f5b795c5311280a2716a1c93","created_at":"2026-08-15T23:33:41.865Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-76de9df31b114f3f","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"22b236da2ee3a122f2c9784763341374","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:33:41.945Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f5b795c5311280a2716a1c93: done: 0.01637 sec","job_status":"done","queue_duration_s":1.239283,"scheduling_latency_s":1.239303,"redis_calls":13,"redis_duration_s":0.003039,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000959,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00208,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01044,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01637,"completed_at":"2026-08-15T23:33:43.201Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1352gitlab # [ 236.945211] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:33:43.202Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"51083de3334d835cc4dbbec2","created_at":"2026-08-15T23:33:41.865Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-76de9df31b114f3f","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"22b236da2ee3a122f2c9784763341374","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:33:41.945Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-51083de3334d835cc4dbbec2: start","job_status":"start","queue_duration_s":1.256984,"scheduling_latency_s":1.256998}1353gitlab # [ 236.983252] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:33:43.218Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"51083de3334d835cc4dbbec2","created_at":"2026-08-15T23:33:41.865Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-76de9df31b114f3f","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"22b236da2ee3a122f2c9784763341374","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:33:41.945Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-51083de3334d835cc4dbbec2: done: 0.015772 sec","job_status":"done","queue_duration_s":1.256984,"scheduling_latency_s":1.256998,"redis_calls":13,"redis_duration_s":0.002679,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000911,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001768,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01006,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015772,"completed_at":"2026-08-15T23:33:43.218Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1354gitlab # [ 237.055445] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:33:43.220Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"662e3e491a9d89e97ab8ffe2","created_at":"2026-08-15T23:33:41.865Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-76de9df31b114f3f","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"22b236da2ee3a122f2c9784763341374","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:33:41.945Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-662e3e491a9d89e97ab8ffe2: start","job_status":"start","queue_duration_s":1.274382,"scheduling_latency_s":1.274399}1355gitlab # [ 237.070693] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:33:43.236Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"662e3e491a9d89e97ab8ffe2","created_at":"2026-08-15T23:33:41.865Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-76de9df31b114f3f","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"22b236da2ee3a122f2c9784763341374","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:33:41.945Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-662e3e491a9d89e97ab8ffe2: done: 0.016125 sec","job_status":"done","queue_duration_s":1.274382,"scheduling_latency_s":1.274399,"redis_calls":13,"redis_duration_s":0.002943,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000984,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001959,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010136,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016125,"completed_at":"2026-08-15T23:33:43.236Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1356gitlab # [ 237.112531] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:33:43.237Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"51c026b6ed13a445c136da75","created_at":"2026-08-15T23:33:41.865Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-76de9df31b114f3f","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"22b236da2ee3a122f2c9784763341374","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:33:41.945Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-51c026b6ed13a445c136da75: start","job_status":"start","queue_duration_s":1.291906,"scheduling_latency_s":1.291922}1357gitlab # [ 237.125213] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:33:43.253Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"51c026b6ed13a445c136da75","created_at":"2026-08-15T23:33:41.865Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-76de9df31b114f3f","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"22b236da2ee3a122f2c9784763341374","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:33:41.945Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-51c026b6ed13a445c136da75: done: 0.015837 sec","job_status":"done","queue_duration_s":1.291906,"scheduling_latency_s":1.291922,"redis_calls":13,"redis_duration_s":0.002728,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000929,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001799,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009919,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015837,"completed_at":"2026-08-15T23:33:43.253Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1358gitlab # [ 237.164768] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:33:43.254Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"769f913f439e01811ab9799b","created_at":"2026-08-15T23:33:41.865Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-76de9df31b114f3f","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"22b236da2ee3a122f2c9784763341374","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:33:41.945Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-769f913f439e01811ab9799b: start","job_status":"start","queue_duration_s":1.309075,"scheduling_latency_s":1.309092}1359gitlab # [ 237.177719] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:33:43.270Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"769f913f439e01811ab9799b","created_at":"2026-08-15T23:33:41.865Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-76de9df31b114f3f","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"22b236da2ee3a122f2c9784763341374","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:33:41.945Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-769f913f439e01811ab9799b: done: 0.015914 sec","job_status":"done","queue_duration_s":1.309075,"scheduling_latency_s":1.309092,"redis_calls":13,"redis_duration_s":0.002661,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000963,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001698,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010077,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015914,"completed_at":"2026-08-15T23:33:43.270Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1360gitlab # [ 237.218205] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:33:43.272Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4598b1b704e00e2c596a22a8","created_at":"2026-08-15T23:33:41.865Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-76de9df31b114f3f","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"22b236da2ee3a122f2c9784763341374","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:33:41.945Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4598b1b704e00e2c596a22a8: start","job_status":"start","queue_duration_s":1.326348,"scheduling_latency_s":1.326363}1361gitlab # [ 237.231031] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:33:43.288Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4598b1b704e00e2c596a22a8","created_at":"2026-08-15T23:33:41.865Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-76de9df31b114f3f","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"22b236da2ee3a122f2c9784763341374","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:33:41.945Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4598b1b704e00e2c596a22a8: done: 0.016192 sec","job_status":"done","queue_duration_s":1.326348,"scheduling_latency_s":1.326363,"redis_calls":13,"redis_duration_s":0.002823,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000935,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001888,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010157,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016192,"completed_at":"2026-08-15T23:33:43.288Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1362gitlab # [ 237.271796] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:33:43.289Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1836b5d1ba4fc6d08ce5aef0","created_at":"2026-08-15T23:33:41.865Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-76de9df31b114f3f","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"22b236da2ee3a122f2c9784763341374","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:33:41.945Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1836b5d1ba4fc6d08ce5aef0: start","job_status":"start","queue_duration_s":1.344136,"scheduling_latency_s":1.344152}1363gitlab # [ 237.284609] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:33:43.306Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1836b5d1ba4fc6d08ce5aef0","created_at":"2026-08-15T23:33:41.865Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-76de9df31b114f3f","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"22b236da2ee3a122f2c9784763341374","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:33:41.945Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1836b5d1ba4fc6d08ce5aef0: done: 0.016831 sec","job_status":"done","queue_duration_s":1.344136,"scheduling_latency_s":1.344152,"redis_calls":13,"redis_duration_s":0.0034130000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001429,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001984,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010353,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016831,"completed_at":"2026-08-15T23:33:43.306Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1364gitlab # [ 237.324728] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:33:43.308Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f0efd13c674f9a37efb4d6ff","created_at":"2026-08-15T23:33:41.865Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-76de9df31b114f3f","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"22b236da2ee3a122f2c9784763341374","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:33:41.945Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f0efd13c674f9a37efb4d6ff: start","job_status":"start","queue_duration_s":1.362437,"scheduling_latency_s":1.362454}1365gitlab # [ 237.337309] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:33:43.323Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f0efd13c674f9a37efb4d6ff","created_at":"2026-08-15T23:33:41.865Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-76de9df31b114f3f","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"22b236da2ee3a122f2c9784763341374","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:33:41.945Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f0efd13c674f9a37efb4d6ff: done: 0.015791 sec","job_status":"done","queue_duration_s":1.362437,"scheduling_latency_s":1.362454,"redis_calls":13,"redis_duration_s":0.002563,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000953,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00161,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010366,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015791,"completed_at":"2026-08-15T23:33:43.323Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1366gitlab # [ 237.376568] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:33:43.325Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"70d2e172fc6ed578d90e7685","created_at":"2026-08-15T23:33:41.865Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-76de9df31b114f3f","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"22b236da2ee3a122f2c9784763341374","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:33:41.945Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-70d2e172fc6ed578d90e7685: start","job_status":"start","queue_duration_s":1.379773,"scheduling_latency_s":1.37979}1367gitlab # [ 237.389242] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:33:43.341Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"70d2e172fc6ed578d90e7685","created_at":"2026-08-15T23:33:41.865Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-76de9df31b114f3f","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"22b236da2ee3a122f2c9784763341374","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:33:41.945Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-70d2e172fc6ed578d90e7685: done: 0.015902 sec","job_status":"done","queue_duration_s":1.379773,"scheduling_latency_s":1.37979,"redis_calls":13,"redis_duration_s":0.002717,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000918,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001799,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010047,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015902,"completed_at":"2026-08-15T23:33:43.341Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1368gitlab # [ 237.429629] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:33:43.342Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9453943b708a3cbf2cf3f39e","created_at":"2026-08-15T23:33:41.865Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-76de9df31b114f3f","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"22b236da2ee3a122f2c9784763341374","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:33:41.945Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9453943b708a3cbf2cf3f39e: start","job_status":"start","queue_duration_s":1.397186,"scheduling_latency_s":1.397201}1369gitlab # [ 237.443304] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:33:43.358Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9453943b708a3cbf2cf3f39e","created_at":"2026-08-15T23:33:41.865Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-76de9df31b114f3f","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"22b236da2ee3a122f2c9784763341374","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:33:41.945Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9453943b708a3cbf2cf3f39e: done: 0.015509 sec","job_status":"done","queue_duration_s":1.397186,"scheduling_latency_s":1.397201,"redis_calls":13,"redis_duration_s":0.0026899999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000962,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001728,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010011,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015509,"completed_at":"2026-08-15T23:33:43.358Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1370gitlab # [ 237.483925] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:33:43.360Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"38070cc81f9b8fa95fb9bf21","created_at":"2026-08-15T23:33:41.865Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-76de9df31b114f3f","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"22b236da2ee3a122f2c9784763341374","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:33:41.945Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-38070cc81f9b8fa95fb9bf21: start","job_status":"start","queue_duration_s":1.414263,"scheduling_latency_s":1.414279}1371gitlab # [ 237.497016] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:33:43.375Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"38070cc81f9b8fa95fb9bf21","created_at":"2026-08-15T23:33:41.865Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-76de9df31b114f3f","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"22b236da2ee3a122f2c9784763341374","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:33:41.945Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-38070cc81f9b8fa95fb9bf21: done: 0.015242 sec","job_status":"done","queue_duration_s":1.414263,"scheduling_latency_s":1.414279,"redis_calls":13,"redis_duration_s":0.001873,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000746,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001127,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01049,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015242,"completed_at":"2026-08-15T23:33:43.375Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1372gitlab # [ 237.537722] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:33:43.376Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"74dfac731b3c81e69bfea68d","created_at":"2026-08-15T23:33:41.865Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-76de9df31b114f3f","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"22b236da2ee3a122f2c9784763341374","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:33:41.945Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-74dfac731b3c81e69bfea68d: start","job_status":"start","queue_duration_s":1.430656,"scheduling_latency_s":1.430673}1373gitlab # [ 237.550504] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:33:43.391Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"74dfac731b3c81e69bfea68d","created_at":"2026-08-15T23:33:41.865Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-76de9df31b114f3f","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"22b236da2ee3a122f2c9784763341374","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:33:41.945Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-74dfac731b3c81e69bfea68d: done: 0.01552 sec","job_status":"done","queue_duration_s":1.430656,"scheduling_latency_s":1.430673,"redis_calls":13,"redis_duration_s":0.001448,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000522,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000926,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01086,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01552,"completed_at":"2026-08-15T23:33:43.391Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1374gitlab # [ 237.591102] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:33:43.393Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"54091a640cc9ccf98c9d6493","created_at":"2026-08-15T23:33:41.865Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-76de9df31b114f3f","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"22b236da2ee3a122f2c9784763341374","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:33:41.945Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-54091a640cc9ccf98c9d6493: start","job_status":"start","queue_duration_s":1.44724,"scheduling_latency_s":1.447257}1375gitlab # [ 237.604073] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:33:43.408Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"54091a640cc9ccf98c9d6493","created_at":"2026-08-15T23:33:41.865Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-76de9df31b114f3f","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"22b236da2ee3a122f2c9784763341374","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:33:41.945Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-54091a640cc9ccf98c9d6493: done: 0.015617 sec","job_status":"done","queue_duration_s":1.44724,"scheduling_latency_s":1.447257,"redis_calls":13,"redis_duration_s":0.0014810000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000529,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000952,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010503,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015617,"completed_at":"2026-08-15T23:33:43.408Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1376gitlab # [ 237.645352] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:33:43.409Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"269b395c41baf5bd349e7814","created_at":"2026-08-15T23:33:41.865Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-76de9df31b114f3f","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"22b236da2ee3a122f2c9784763341374","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:33:41.945Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-269b395c41baf5bd349e7814: start","job_status":"start","queue_duration_s":1.463956,"scheduling_latency_s":1.463973}1377gitlab # [ 237.657897] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:33:43.424Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"269b395c41baf5bd349e7814","created_at":"2026-08-15T23:33:41.865Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-76de9df31b114f3f","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"22b236da2ee3a122f2c9784763341374","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:33:41.945Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-269b395c41baf5bd349e7814: done: 0.015269 sec","job_status":"done","queue_duration_s":1.463956,"scheduling_latency_s":1.463973,"redis_calls":13,"redis_duration_s":0.001488,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00054,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000948,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01038,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015269,"completed_at":"2026-08-15T23:33:43.424Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1378gitlab # [ 237.697917] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:33:43.426Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d6aaf7320fea5da22d513f93","created_at":"2026-08-15T23:33:41.865Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-76de9df31b114f3f","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"22b236da2ee3a122f2c9784763341374","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:33:41.945Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d6aaf7320fea5da22d513f93: start","job_status":"start","queue_duration_s":1.480255,"scheduling_latency_s":1.480271}1379gitlab # [ 237.710941] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:33:43.441Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d6aaf7320fea5da22d513f93","created_at":"2026-08-15T23:33:41.865Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-76de9df31b114f3f","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"22b236da2ee3a122f2c9784763341374","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:33:41.945Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d6aaf7320fea5da22d513f93: done: 0.015441 sec","job_status":"done","queue_duration_s":1.480255,"scheduling_latency_s":1.480271,"redis_calls":13,"redis_duration_s":0.001571,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000646,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000925,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010338,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015441,"completed_at":"2026-08-15T23:33:43.441Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1380gitlab # [ 237.750337] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:33:43.442Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8b5b713b69f2f0625ee85f5a","created_at":"2026-08-15T23:33:41.865Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-76de9df31b114f3f","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"22b236da2ee3a122f2c9784763341374","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:33:41.945Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8b5b713b69f2f0625ee85f5a: start","job_status":"start","queue_duration_s":1.496731,"scheduling_latency_s":1.496749}1381gitlab # [ 237.763068] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:33:43.457Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8b5b713b69f2f0625ee85f5a","created_at":"2026-08-15T23:33:41.865Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-76de9df31b114f3f","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"22b236da2ee3a122f2c9784763341374","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:33:41.945Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8b5b713b69f2f0625ee85f5a: done: 0.015173 sec","job_status":"done","queue_duration_s":1.496731,"scheduling_latency_s":1.496749,"redis_calls":13,"redis_duration_s":0.001707,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000544,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001163,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010461,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015173,"completed_at":"2026-08-15T23:33:43.457Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1382gitlab # [ 237.802558] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:33:43.458Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a9421563857e22e382d69577","created_at":"2026-08-15T23:33:41.865Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-76de9df31b114f3f","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"22b236da2ee3a122f2c9784763341374","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:33:41.945Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a9421563857e22e382d69577: start","job_status":"start","queue_duration_s":1.512948,"scheduling_latency_s":1.512964}1383gitlab # [ 237.815353] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:33:43.473Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a9421563857e22e382d69577","created_at":"2026-08-15T23:33:41.865Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-76de9df31b114f3f","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"22b236da2ee3a122f2c9784763341374","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:33:41.945Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a9421563857e22e382d69577: done: 0.014784 sec","job_status":"done","queue_duration_s":1.512948,"scheduling_latency_s":1.512964,"redis_calls":13,"redis_duration_s":0.0014429999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000521,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000922,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010275,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014784,"completed_at":"2026-08-15T23:33:43.473Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1384gitlab # [ 237.856081] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:33:43.474Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"67fa01c77e734155b821d889","created_at":"2026-08-15T23:33:41.865Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-76de9df31b114f3f","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"22b236da2ee3a122f2c9784763341374","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:33:41.945Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-67fa01c77e734155b821d889: start","job_status":"start","queue_duration_s":1.528973,"scheduling_latency_s":1.528991}1385gitlab # [ 237.868545] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:33:43.489Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"67fa01c77e734155b821d889","created_at":"2026-08-15T23:33:41.865Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-76de9df31b114f3f","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"22b236da2ee3a122f2c9784763341374","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:33:41.945Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-67fa01c77e734155b821d889: done: 0.014829 sec","job_status":"done","queue_duration_s":1.528973,"scheduling_latency_s":1.528991,"redis_calls":13,"redis_duration_s":0.00147,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000531,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000939,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010299,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014829,"completed_at":"2026-08-15T23:33:43.489Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1386gitlab # [ 237.908761] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:33:43.490Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7d593bdf4e3fc678e1388cd1","created_at":"2026-08-15T23:33:41.865Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-76de9df31b114f3f","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"22b236da2ee3a122f2c9784763341374","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:33:41.945Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7d593bdf4e3fc678e1388cd1: start","job_status":"start","queue_duration_s":1.545158,"scheduling_latency_s":1.545175}1387gitlab # [ 237.921334] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:33:43.506Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7d593bdf4e3fc678e1388cd1","created_at":"2026-08-15T23:33:41.865Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-76de9df31b114f3f","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"22b236da2ee3a122f2c9784763341374","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:33:41.945Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7d593bdf4e3fc678e1388cd1: done: 0.015329 sec","job_status":"done","queue_duration_s":1.545158,"scheduling_latency_s":1.545175,"redis_calls":13,"redis_duration_s":0.001714,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000737,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000977,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010792,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015329,"completed_at":"2026-08-15T23:33:43.506Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1388gitlab # [ 237.961166] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:33:43.507Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5bd9a678fab9146f41655fbb","created_at":"2026-08-15T23:33:41.865Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-76de9df31b114f3f","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"22b236da2ee3a122f2c9784763341374","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:33:41.945Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5bd9a678fab9146f41655fbb: start","job_status":"start","queue_duration_s":1.561717,"scheduling_latency_s":1.561734}1389gitlab # [ 237.973679] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:33:43.522Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5bd9a678fab9146f41655fbb","created_at":"2026-08-15T23:33:41.865Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-76de9df31b114f3f","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"22b236da2ee3a122f2c9784763341374","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:33:41.945Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5bd9a678fab9146f41655fbb: done: 0.014941 sec","job_status":"done","queue_duration_s":1.561717,"scheduling_latency_s":1.561734,"redis_calls":13,"redis_duration_s":0.001434,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000516,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000918,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010522,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014941,"completed_at":"2026-08-15T23:33:43.522Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1390gitlab # [ 238.022143] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:33:43.523Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"972c1f8c88ad22eb7c6f09a1","created_at":"2026-08-15T23:33:41.865Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-76de9df31b114f3f","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"22b236da2ee3a122f2c9784763341374","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:33:41.945Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-972c1f8c88ad22eb7c6f09a1: start","job_status":"start","queue_duration_s":1.577868,"scheduling_latency_s":1.577884}1391gitlab # [ 238.034813] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:33:43.538Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"972c1f8c88ad22eb7c6f09a1","created_at":"2026-08-15T23:33:41.865Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-76de9df31b114f3f","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"22b236da2ee3a122f2c9784763341374","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:33:41.945Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-972c1f8c88ad22eb7c6f09a1: done: 0.014941 sec","job_status":"done","queue_duration_s":1.577868,"scheduling_latency_s":1.577884,"redis_calls":13,"redis_duration_s":0.0014750000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000554,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000921,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010636,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014941,"completed_at":"2026-08-15T23:33:43.538Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1392gitlab # [ 238.075771] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:33:43.539Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"753349d21e015e57f76b21b0","created_at":"2026-08-15T23:33:41.865Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-76de9df31b114f3f","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"22b236da2ee3a122f2c9784763341374","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:33:41.945Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-753349d21e015e57f76b21b0: start","job_status":"start","queue_duration_s":1.59403,"scheduling_latency_s":1.594049}1393gitlab # [ 238.088525] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:33:43.555Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"753349d21e015e57f76b21b0","created_at":"2026-08-15T23:33:41.865Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-76de9df31b114f3f","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"22b236da2ee3a122f2c9784763341374","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:33:41.945Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-753349d21e015e57f76b21b0: done: 0.015336 sec","job_status":"done","queue_duration_s":1.59403,"scheduling_latency_s":1.594049,"redis_calls":13,"redis_duration_s":0.001487,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000539,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000948,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010623,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015336,"completed_at":"2026-08-15T23:33:43.555Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1394gitlab # [ 238.128274] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:33:43.556Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"f7e7b0c69145578009fde392","created_at":"2026-08-15T23:33:42.578Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-2eaf2facee7a448f","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"938c179c8f3b9dbca395a8a94ee08147","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:33:42.591Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-f7e7b0c69145578009fde392: start","job_status":"start","queue_duration_s":0.964412,"scheduling_latency_s":0.964429}1395gitlab # [ 238.140710] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:33:43.574Z","message":"No existing merge request to be cleaned up."}1396gitlab # [ 238.142382] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:33:43.588Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"f7e7b0c69145578009fde392","created_at":"2026-08-15T23:33:42.578Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-2eaf2facee7a448f","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"938c179c8f3b9dbca395a8a94ee08147","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:33:42.591Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-f7e7b0c69145578009fde392: done: 0.032766 sec","job_status":"done","queue_duration_s":0.964412,"scheduling_latency_s":0.964429,"redis_calls":13,"redis_duration_s":0.001729,"redis_read_bytes":12,"redis_write_bytes":1401,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000285,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":301,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000617,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":431,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000827,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":669,"db_count":4,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02061,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00024684,"duration_s":0.032766,"completed_at":"2026-08-15T23:33:43.588Z","load_balancing_strategy":"primary","db_duration_s":0.006437,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1397gitlab # [ 238.183410] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:33:43.590Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"4cd3aa5f9d60aa6dead8fb8a","created_at":"2026-08-15T23:33:42.578Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-2eaf2facee7a448f","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"938c179c8f3b9dbca395a8a94ee08147","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:33:42.591Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-4cd3aa5f9d60aa6dead8fb8a: start","job_status":"start","queue_duration_s":0.998437,"scheduling_latency_s":0.998455}1398gitlab # [ 238.196043] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:33:43.602Z","message":"No existing merge request to be cleaned up."}1399gitlab # [ 238.197712] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:33:43.610Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"4cd3aa5f9d60aa6dead8fb8a","created_at":"2026-08-15T23:33:42.578Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-2eaf2facee7a448f","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"938c179c8f3b9dbca395a8a94ee08147","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:33:42.591Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-4cd3aa5f9d60aa6dead8fb8a: done: 0.02013 sec","job_status":"done","queue_duration_s":0.998437,"scheduling_latency_s":0.998455,"redis_calls":10,"redis_duration_s":0.001565,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00059,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000975,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013681,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.02013,"completed_at":"2026-08-15T23:33:43.610Z","load_balancing_strategy":"primary","db_duration_s":0.002484,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1400gitlab # [ 238.236161] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:33:43.611Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"813a1e6686cc4cb7a0b9d2f4","created_at":"2026-08-15T23:33:42.578Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-2eaf2facee7a448f","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"938c179c8f3b9dbca395a8a94ee08147","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:33:42.591Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-813a1e6686cc4cb7a0b9d2f4: start","job_status":"start","queue_duration_s":1.019779,"scheduling_latency_s":1.019796}1401gitlab # [ 238.248456] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:33:43.622Z","message":"No existing merge request to be cleaned up."}1402gitlab # [ 238.250089] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:33:43.630Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"813a1e6686cc4cb7a0b9d2f4","created_at":"2026-08-15T23:33:42.578Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-2eaf2facee7a448f","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"938c179c8f3b9dbca395a8a94ee08147","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:33:42.591Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-813a1e6686cc4cb7a0b9d2f4: done: 0.019096 sec","job_status":"done","queue_duration_s":1.019779,"scheduling_latency_s":1.019796,"redis_calls":10,"redis_duration_s":0.0013289999999999999,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000581,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000748,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01301,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019096,"completed_at":"2026-08-15T23:33:43.630Z","load_balancing_strategy":"primary","db_duration_s":0.002191,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1403gitlab # [ 238.290317] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:33:43.631Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"7883f2e2ce8ac63cf1310719","created_at":"2026-08-15T23:33:42.578Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-2eaf2facee7a448f","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"938c179c8f3b9dbca395a8a94ee08147","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:33:42.591Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-7883f2e2ce8ac63cf1310719: start","job_status":"start","queue_duration_s":1.039967,"scheduling_latency_s":1.040024}1404gitlab # [ 238.303184] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:33:43.642Z","message":"No existing merge request to be cleaned up."}1405gitlab # [ 238.305178] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:33:43.650Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"7883f2e2ce8ac63cf1310719","created_at":"2026-08-15T23:33:42.578Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-2eaf2facee7a448f","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"938c179c8f3b9dbca395a8a94ee08147","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:33:42.591Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-7883f2e2ce8ac63cf1310719: done: 0.018976 sec","job_status":"done","queue_duration_s":1.039967,"scheduling_latency_s":1.040024,"redis_calls":10,"redis_duration_s":0.001311,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000563,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000748,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012919,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018976,"completed_at":"2026-08-15T23:33:43.650Z","load_balancing_strategy":"primary","db_duration_s":0.002179,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1406gitlab # [ 257.722239] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:34:05.631Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"d0dfbbe9f7cc6a6a1d3703e2","created_at":"2026-08-15T23:34:05.611Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-0b849d46bd594c09","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"af132bbd2cdbcd595df885e1f9f4f47c","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-15T23:34:05.627Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-d0dfbbe9f7cc6a6a1d3703e2: start","job_status":"start","queue_duration_s":0.004236,"scheduling_latency_s":0.004294}1407gitlab # [ 258.082435] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:34:05.992Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"d0dfbbe9f7cc6a6a1d3703e2","created_at":"2026-08-15T23:34:05.611Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-0b849d46bd594c09","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"af132bbd2cdbcd595df885e1f9f4f47c","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-15T23:34:05.627Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-d0dfbbe9f7cc6a6a1d3703e2: done: 0.360972 sec","job_status":"done","queue_duration_s":0.004236,"scheduling_latency_s":0.004294,"redis_calls":9,"redis_duration_s":0.051267999999999994,"redis_read_bytes":7,"redis_write_bytes":1162,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.042981,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":551,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.008287,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":611,"db_count":6,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.037,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.037,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.06877,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00446398,"exclusive_lock_hold_duration_s":0.11907864,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.360972,"completed_at":"2026-08-15T23:34:05.992Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.069654,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1408gitlab # [ 258.176806] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:34:06.010Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"a3e61dffd6e3ea77fc939a5d","created_at":"2026-08-15T23:34:05.690Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-0b849d46bd594c09","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"bc1f74584211a6d94f24a1b44e1a3241","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-08-15T23:34:05.715Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-a3e61dffd6e3ea77fc939a5d: start","job_status":"start","queue_duration_s":0.294924,"scheduling_latency_s":0.294975}1409gitlab # [ 258.240369] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:34:06.151Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"a3e61dffd6e3ea77fc939a5d","created_at":"2026-08-15T23:34:05.690Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-0b849d46bd594c09","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"bc1f74584211a6d94f24a1b44e1a3241","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-08-15T23:34:05.715Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-a3e61dffd6e3ea77fc939a5d: done: 0.140915 sec","job_status":"done","queue_duration_s":0.294924,"scheduling_latency_s":0.294975,"redis_calls":10,"redis_duration_s":0.023894,"redis_read_bytes":9,"redis_write_bytes":1225,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.002326,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.019164,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":634,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002404,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":250,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.012,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.049544,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00172812,"duration_s":0.140915,"completed_at":"2026-08-15T23:34:06.151Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.018466,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1410gitlab # [ 258.332941] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:34:06.162Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"ea76f8eaaa7022ed32b7388b","created_at":"2026-08-15T23:34:05.753Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-0b849d46bd594c09","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7c46a02acd03fcfe221703400878421d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-15T23:34:05.758Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-ea76f8eaaa7022ed32b7388b: start","job_status":"start","queue_duration_s":0.404022,"scheduling_latency_s":0.404068}1411gitlab # [ 258.349771] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:34:06.206Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0}1412gitlab # [ 258.353610] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:34:06.253Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"ea76f8eaaa7022ed32b7388b","created_at":"2026-08-15T23:34:05.753Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-0b849d46bd594c09","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7c46a02acd03fcfe221703400878421d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-15T23:34:05.758Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-ea76f8eaaa7022ed32b7388b: done: 0.090892 sec","job_status":"done","queue_duration_s":0.404022,"scheduling_latency_s":0.404068,"redis_calls":7,"redis_duration_s":0.013059000000000001,"redis_read_bytes":5,"redis_write_bytes":806,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.010916,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":548,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002143,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":258,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025553,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.090892,"completed_at":"2026-08-15T23:34:06.253Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1413gitlab # [ 258.395306] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:34:06.257Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"2fdeb4ff50e4966ae6497d19","created_at":"2026-08-15T23:34:05.820Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-0b849d46bd594c09","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f9b534134a3ab33a43f3bacbff003b5d","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-08-15T23:34:05.867Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-2fdeb4ff50e4966ae6497d19: start","job_status":"start","queue_duration_s":0.390054,"scheduling_latency_s":0.390099}1414gitlab # [ 258.443586] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:34:06.354Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"2fdeb4ff50e4966ae6497d19","created_at":"2026-08-15T23:34:05.820Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-0b849d46bd594c09","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f9b534134a3ab33a43f3bacbff003b5d","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-08-15T23:34:05.867Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-2fdeb4ff50e4966ae6497d19: done: 0.097226 sec","job_status":"done","queue_duration_s":0.390054,"scheduling_latency_s":0.390099,"redis_calls":12,"redis_duration_s":0.01114,"redis_read_bytes":11,"redis_write_bytes":1562,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000691,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.006508,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":634,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.003941,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":591,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.01,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.042684,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00112736,"exclusive_lock_hold_duration_s":0.02222302,"duration_s":0.097226,"completed_at":"2026-08-15T23:34:06.354Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.015016,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1415gitlab # [ 258.536829] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:34:06.358Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"e3a010f133c0f8918973dfb6","created_at":"2026-08-15T23:34:05.898Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-0b849d46bd594c09","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"af966904615288f4e5446be6dccbd66a","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-15T23:34:05.906Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-e3a010f133c0f8918973dfb6: start","job_status":"start","queue_duration_s":0.45144,"scheduling_latency_s":0.451486}1416gitlab # [ 259.281585] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:34:07.192Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"e3a010f133c0f8918973dfb6","created_at":"2026-08-15T23:34:05.898Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-0b849d46bd594c09","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"af966904615288f4e5446be6dccbd66a","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-15T23:34:05.906Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-e3a010f133c0f8918973dfb6: done: 0.834049 sec","job_status":"done","queue_duration_s":0.45144,"scheduling_latency_s":0.451486,"redis_calls":562,"redis_duration_s":0.340814,"redis_read_bytes":560,"redis_write_bytes":48760,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001487,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":470,"redis_shared_state_calls":557,"redis_shared_state_duration_s":0.339327,"redis_shared_state_read_bytes":556,"redis_shared_state_write_bytes":48290,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.54453,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.834049,"completed_at":"2026-08-15T23:34:07.192Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1417gitlab # [ 259.369169] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:34:07.193Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"cb87b29934c324591cb92fb7","created_at":"2026-08-15T23:34:05.949Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-0b849d46bd594c09","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1cf6589d9128070cf3278ff1335c2043","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-15T23:34:05.960Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-cb87b29934c324591cb92fb7: start","job_status":"start","queue_duration_s":1.233105,"scheduling_latency_s":1.233128}1418gitlab # [ 259.388516] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:34:07.210Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"cb87b29934c324591cb92fb7","created_at":"2026-08-15T23:34:05.949Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-0b849d46bd594c09","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1cf6589d9128070cf3278ff1335c2043","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-15T23:34:05.960Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-cb87b29934c324591cb92fb7: done: 0.016754 sec","job_status":"done","queue_duration_s":1.233105,"scheduling_latency_s":1.233128,"redis_calls":7,"redis_duration_s":0.001011,"redis_read_bytes":5,"redis_write_bytes":681,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000736,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":473,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000275,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":208,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010117,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016754,"completed_at":"2026-08-15T23:34:07.210Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002012,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1419gitlab # [ 259.432120] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:34:07.211Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"426ad8329c7a22bc7435f508","created_at":"2026-08-15T23:34:05.982Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-0b849d46bd594c09","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"05ad743c9173344295c22d4e619eddc5","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-15T23:34:05.988Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-426ad8329c7a22bc7435f508: start","job_status":"start","queue_duration_s":1.223044,"scheduling_latency_s":1.223066}1420gitlab # [ 259.446329] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:34:07.242Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"426ad8329c7a22bc7435f508","created_at":"2026-08-15T23:34:05.982Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-0b849d46bd594c09","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"05ad743c9173344295c22d4e619eddc5","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-15T23:34:05.988Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-426ad8329c7a22bc7435f508: done: 0.031457 sec","job_status":"done","queue_duration_s":1.223044,"scheduling_latency_s":1.223066,"redis_calls":7,"redis_duration_s":0.001071,"redis_read_bytes":5,"redis_write_bytes":826,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000776,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000295,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.016,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.016,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010452,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.031457,"completed_at":"2026-08-15T23:34:07.242Z","load_balancing_strategy":"primary","db_duration_s":0.016409,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1421gitlab # [ 259.522925] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:34:07.244Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"13e1c8f4bd55bde3120d6e08","created_at":"2026-08-15T23:34:06.011Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-0b849d46bd594c09","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"664b134dda8ece14dcfc3b29eb90fa11","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-15T23:34:06.019Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-13e1c8f4bd55bde3120d6e08: start","job_status":"start","queue_duration_s":1.224816,"scheduling_latency_s":1.224837}1422gitlab # [ 259.558452] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:34:07.277Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"13e1c8f4bd55bde3120d6e08","created_at":"2026-08-15T23:34:06.011Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-0b849d46bd594c09","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"664b134dda8ece14dcfc3b29eb90fa11","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-15T23:34:06.019Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-13e1c8f4bd55bde3120d6e08: done: 0.033715 sec","job_status":"done","queue_duration_s":1.224816,"scheduling_latency_s":1.224837,"redis_calls":7,"redis_duration_s":0.0011099999999999999,"redis_read_bytes":5,"redis_write_bytes":711,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000803,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":491,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000307,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":220,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.015,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.015,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013302,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.033715,"completed_at":"2026-08-15T23:34:07.277Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.015798,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1423gitlab # [ 259.617192] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:34:07.279Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"a68672c8f9fa125b4e3bd904","created_at":"2026-08-15T23:34:06.057Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-0b849d46bd594c09","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"25b16c30d83faa0c61e1766361cbbe06","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-15T23:34:06.074Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-a68672c8f9fa125b4e3bd904: start","job_status":"start","queue_duration_s":1.204431,"scheduling_latency_s":1.204458}1424gitlab # [ 259.633009] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:34:07.296Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"a68672c8f9fa125b4e3bd904","created_at":"2026-08-15T23:34:06.057Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-0b849d46bd594c09","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"25b16c30d83faa0c61e1766361cbbe06","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-15T23:34:06.074Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-a68672c8f9fa125b4e3bd904: done: 0.016821 sec","job_status":"done","queue_duration_s":1.204431,"scheduling_latency_s":1.204458,"redis_calls":7,"redis_duration_s":0.0011849999999999999,"redis_read_bytes":5,"redis_write_bytes":831,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000842,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":563,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000343,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":268,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010772,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016821,"completed_at":"2026-08-15T23:34:07.296Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1425gitlab # [ 259.674499] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:34:07.297Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"13c539a464572c64ed76c93e","created_at":"2026-08-15T23:34:06.096Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-0b849d46bd594c09","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b5898894503dcc7fe614deeeea4330cd","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-15T23:34:06.107Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-13c539a464572c64ed76c93e: start","job_status":"start","queue_duration_s":1.190245,"scheduling_latency_s":1.190263}1426gitlab # [ 259.689482] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:34:07.305Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0}1427gitlab # [ 259.693269] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:34:07.311Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"13c539a464572c64ed76c93e","created_at":"2026-08-15T23:34:06.096Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-0b849d46bd594c09","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b5898894503dcc7fe614deeeea4330cd","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-15T23:34:06.107Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-13c539a464572c64ed76c93e: done: 0.013662 sec","job_status":"done","queue_duration_s":1.190245,"scheduling_latency_s":1.190263,"redis_calls":7,"redis_duration_s":0.001006,"redis_read_bytes":5,"redis_write_bytes":821,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000716,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":557,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00029,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":264,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008828,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013662,"completed_at":"2026-08-15T23:34:07.311Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1428gitlab # [ 259.735516] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:34:07.312Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"bdb8944e49fe568048ffaca1","created_at":"2026-08-15T23:34:06.142Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-0b849d46bd594c09","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e7f3edd36a1aecf618c77b6f9a219e05","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-15T23:34:06.157Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-bdb8944e49fe568048ffaca1: start","job_status":"start","queue_duration_s":1.154969,"scheduling_latency_s":1.154986}1429gitlab # [ 259.750532] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:34:07.334Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"bdb8944e49fe568048ffaca1","created_at":"2026-08-15T23:34:06.142Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-0b849d46bd594c09","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e7f3edd36a1aecf618c77b6f9a219e05","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-15T23:34:06.157Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-bdb8944e49fe568048ffaca1: done: 0.022606 sec","job_status":"done","queue_duration_s":1.154969,"scheduling_latency_s":1.154986,"redis_calls":10,"redis_duration_s":0.0015739999999999999,"redis_read_bytes":8,"redis_write_bytes":1239,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000895,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":636,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000679,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":603,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014306,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00671288,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.022606,"completed_at":"2026-08-15T23:34:07.334Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00397,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1430gitlab # [ 259.793323] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:34:07.336Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"53777c564122005d9e9f2ec8","created_at":"2026-08-15T23:34:06.189Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-0b849d46bd594c09","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0f3c6e5ec647e7c311ba6c0e8706eba6","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-15T23:34:06.202Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-53777c564122005d9e9f2ec8: start","job_status":"start","queue_duration_s":1.133476,"scheduling_latency_s":1.133495}1431gitlab # [ 259.806991] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:34:07.343Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0}1432gitlab # [ 259.810951] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:34:07.348Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"53777c564122005d9e9f2ec8","created_at":"2026-08-15T23:34:06.189Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-0b849d46bd594c09","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0f3c6e5ec647e7c311ba6c0e8706eba6","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-15T23:34:06.202Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-53777c564122005d9e9f2ec8: done: 0.012871 sec","job_status":"done","queue_duration_s":1.133476,"scheduling_latency_s":1.133495,"redis_calls":7,"redis_duration_s":0.0009480000000000001,"redis_read_bytes":5,"redis_write_bytes":801,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000673,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":545,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000275,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":256,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008285,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.012871,"completed_at":"2026-08-15T23:34:07.348Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1433gitlab # [ 259.851278] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:34:07.350Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"ab938e604566e427dc0d79cf","created_at":"2026-08-15T23:34:06.258Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-0b849d46bd594c09","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"03f3b35a952d4b3ebdf6d3603685e0d3","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-15T23:34:06.265Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-ab938e604566e427dc0d79cf: start","job_status":"start","queue_duration_s":1.084391,"scheduling_latency_s":1.084409}1434gitlab # [ 259.865717] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:34:07.367Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"ab938e604566e427dc0d79cf","created_at":"2026-08-15T23:34:06.258Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-0b849d46bd594c09","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"03f3b35a952d4b3ebdf6d3603685e0d3","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-15T23:34:06.265Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-ab938e604566e427dc0d79cf: done: 0.017155 sec","job_status":"done","queue_duration_s":1.084391,"scheduling_latency_s":1.084409,"redis_calls":9,"redis_duration_s":0.0013349999999999998,"redis_read_bytes":7,"redis_write_bytes":1072,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000717,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000618,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":560,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011057,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00045212,"exclusive_lock_hold_duration_s":0.00383208,"duration_s":0.017155,"completed_at":"2026-08-15T23:34:07.367Z","load_balancing_strategy":"primary","db_duration_s":0.001654,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1435gitlab # [ 259.906392] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:34:07.368Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"a0a86b526a19bf24253e2064","created_at":"2026-08-15T23:34:06.312Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-0b849d46bd594c09","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"52ad70cb138131bb1a50fb906b6b21fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-15T23:34:06.319Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-a0a86b526a19bf24253e2064: start","job_status":"start","queue_duration_s":1.04875,"scheduling_latency_s":1.048768}1436gitlab # [ 259.920203] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:34:07.464Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"a0a86b526a19bf24253e2064","created_at":"2026-08-15T23:34:06.312Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-0b849d46bd594c09","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"52ad70cb138131bb1a50fb906b6b21fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-15T23:34:06.319Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-a0a86b526a19bf24253e2064: done: 0.096476 sec","job_status":"done","queue_duration_s":1.04875,"scheduling_latency_s":1.048768,"redis_calls":60,"redis_duration_s":0.008737,"redis_read_bytes":108,"redis_write_bytes":41109,"redis_queues_calls":2,"redis_queues_duration_s":0.000527,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37485,"redis_queues_metadata_calls":55,"redis_queues_metadata_duration_s":0.007813,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3324,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000397,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":300,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.081664,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.096476,"completed_at":"2026-08-15T23:34:07.464Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1437gitlab # [ 259.962827] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:34:07.465Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"6c4ae686907b8410199d83f7","created_at":"2026-08-15T23:34:06.345Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-0b849d46bd594c09","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2983f72be7719e0e98b63aa89289d154","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-15T23:34:06.350Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-6c4ae686907b8410199d83f7: start","job_status":"start","queue_duration_s":1.115845,"scheduling_latency_s":1.115862}1438gitlab # [ 259.977593] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:34:07.482Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"6c4ae686907b8410199d83f7","created_at":"2026-08-15T23:34:06.345Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-0b849d46bd594c09","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2983f72be7719e0e98b63aa89289d154","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-15T23:34:06.350Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-6c4ae686907b8410199d83f7: done: 0.016337 sec","job_status":"done","queue_duration_s":1.115845,"scheduling_latency_s":1.115862,"redis_calls":9,"redis_duration_s":0.001284,"redis_read_bytes":7,"redis_write_bytes":1087,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000692,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000592,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":566,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010266,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00044544,"exclusive_lock_hold_duration_s":0.00324306,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.016337,"completed_at":"2026-08-15T23:34:07.482Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001602,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1439gitlab # [ 260.019781] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:34:07.483Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"e1a70fabe8fd1ef7cdddaee0","created_at":"2026-08-15T23:34:06.375Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-0b849d46bd594c09","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4168f06b3a2f1d0eb1cfa04caca4e91d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-15T23:34:06.380Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-e1a70fabe8fd1ef7cdddaee0: start","job_status":"start","queue_duration_s":1.103014,"scheduling_latency_s":1.103031}1440gitlab # [ 260.034715] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:34:07.490Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0}1441gitlab # [ 260.038428] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:34:07.496Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"e1a70fabe8fd1ef7cdddaee0","created_at":"2026-08-15T23:34:06.375Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-0b849d46bd594c09","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4168f06b3a2f1d0eb1cfa04caca4e91d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-15T23:34:06.380Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-e1a70fabe8fd1ef7cdddaee0: done: 0.012846 sec","job_status":"done","queue_duration_s":1.103014,"scheduling_latency_s":1.103031,"redis_calls":7,"redis_duration_s":0.001179,"redis_read_bytes":5,"redis_write_bytes":766,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000708,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":524,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000471,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":242,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008144,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.012846,"completed_at":"2026-08-15T23:34:07.496Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1442gitlab # [ 260.079102] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:34:07.497Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"a37cbc06f496403308c4d3d1","created_at":"2026-08-15T23:34:06.490Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-0b849d46bd594c09","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3e3268ba1914a2f8612184d1f95209c3","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-15T23:34:06.499Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-a37cbc06f496403308c4d3d1: start","job_status":"start","queue_duration_s":0.997637,"scheduling_latency_s":0.997653}1443gitlab # [ 260.094346] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:34:07.547Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"a37cbc06f496403308c4d3d1","created_at":"2026-08-15T23:34:06.490Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-0b849d46bd594c09","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3e3268ba1914a2f8612184d1f95209c3","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-15T23:34:06.499Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-a37cbc06f496403308c4d3d1: done: 0.049678 sec","job_status":"done","queue_duration_s":0.997637,"scheduling_latency_s":0.997653,"redis_calls":9,"redis_duration_s":0.0015760000000000001,"redis_read_bytes":7,"redis_write_bytes":1169,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000866,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00071,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":615,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.027,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.027,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018211,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00051752,"exclusive_lock_hold_duration_s":0.02643268,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.049678,"completed_at":"2026-08-15T23:34:07.546Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.02775,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1444gitlab # [ 260.138503] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:34:07.548Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"1c4ee62d1b2d6c8ed6541e4e","created_at":"2026-08-15T23:34:06.518Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-0b849d46bd594c09","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"df000c97d39ba3059c8ad3cd6d0347eb","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-15T23:34:06.527Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-1c4ee62d1b2d6c8ed6541e4e: start","job_status":"start","queue_duration_s":1.021097,"scheduling_latency_s":1.021116}1445gitlab # [ 260.153515] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:34:07.838Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"1c4ee62d1b2d6c8ed6541e4e","created_at":"2026-08-15T23:34:06.518Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-0b849d46bd594c09","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"df000c97d39ba3059c8ad3cd6d0347eb","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-15T23:34:06.527Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-1c4ee62d1b2d6c8ed6541e4e: done: 0.290379 sec","job_status":"done","queue_duration_s":1.021097,"scheduling_latency_s":1.021116,"redis_calls":11,"redis_duration_s":0.0017410000000000001,"redis_read_bytes":9,"redis_write_bytes":1262,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00032,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":275,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00075,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":476,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000671,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":511,"db_count":130,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":130,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.055,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":130,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":84,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.055,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.214094,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00049958,"exclusive_lock_hold_duration_s":0.27177758,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"main","turbo_mode":false},"duration_s":0.290379,"completed_at":"2026-08-15T23:34:07.838Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.088655,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1446gitlab # [ 260.199077] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:34:07.840Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"73cc6018103e2aa34b71a3bd","created_at":"2026-08-15T23:34:06.547Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-0b849d46bd594c09","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b3cd53930d0449dbc25f995336fb1237","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-15T23:34:06.557Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-73cc6018103e2aa34b71a3bd: start","job_status":"start","queue_duration_s":1.283001,"scheduling_latency_s":1.283019}1447gitlab # [ 260.214057] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:34:07.853Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"73cc6018103e2aa34b71a3bd","created_at":"2026-08-15T23:34:06.547Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-0b849d46bd594c09","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b3cd53930d0449dbc25f995336fb1237","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-15T23:34:06.557Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-73cc6018103e2aa34b71a3bd: done: 0.013492 sec","job_status":"done","queue_duration_s":1.283001,"scheduling_latency_s":1.283019,"redis_calls":7,"redis_duration_s":0.000998,"redis_read_bytes":5,"redis_write_bytes":776,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000692,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000306,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":246,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008919,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013492,"completed_at":"2026-08-15T23:34:07.853Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1448gitlab # [ 260.255568] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:34:07.854Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"0a4899f67fc920afe2f07579","created_at":"2026-08-15T23:34:06.576Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-0b849d46bd594c09","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a4aa0ca52eed416e35b3d99933b4bed3","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-08-15T23:34:06.596Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-0a4899f67fc920afe2f07579: start","job_status":"start","queue_duration_s":1.258231,"scheduling_latency_s":1.258248}1449gitlab # [ 260.269835] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:34:07.873Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"0a4899f67fc920afe2f07579","created_at":"2026-08-15T23:34:06.576Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-0b849d46bd594c09","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a4aa0ca52eed416e35b3d99933b4bed3","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-08-15T23:34:06.596Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-0a4899f67fc920afe2f07579: done: 0.018573 sec","job_status":"done","queue_duration_s":1.258231,"scheduling_latency_s":1.258248,"redis_calls":12,"redis_duration_s":0.001655,"redis_read_bytes":10,"redis_write_bytes":1174,"redis_cache_calls":2,"redis_cache_duration_s":0.000369,"redis_cache_read_bytes":1,"redis_cache_write_bytes":93,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000272,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000725,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":562,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000289,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":214,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011706,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00023866,"duration_s":0.018573,"completed_at":"2026-08-15T23:34:07.873Z","load_balancing_strategy":"primary","db_duration_s":0.000618,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1450gitlab # [ 260.313549] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:34:07.874Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"646ee2e5090529466cf84794","created_at":"2026-08-15T23:34:06.619Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-0b849d46bd594c09","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a585440d7101fed1106ebf060b12f544","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-15T23:34:06.628Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-646ee2e5090529466cf84794: start","job_status":"start","queue_duration_s":1.245395,"scheduling_latency_s":1.245413}1451gitlab # [ 260.328558] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:34:07.881Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0}1452gitlab # [ 260.331914] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:34:07.886Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"646ee2e5090529466cf84794","created_at":"2026-08-15T23:34:06.619Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-0b849d46bd594c09","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a585440d7101fed1106ebf060b12f544","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-15T23:34:06.628Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-646ee2e5090529466cf84794: done: 0.012576 sec","job_status":"done","queue_duration_s":1.245395,"scheduling_latency_s":1.245413,"redis_calls":7,"redis_duration_s":0.000966,"redis_read_bytes":5,"redis_write_bytes":826,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000694,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000272,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008146,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.012576,"completed_at":"2026-08-15T23:34:07.886Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1453gitlab # [ 260.374482] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:34:07.888Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"855afacb27f536ff869cb8ce","created_at":"2026-08-15T23:34:06.682Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-0b849d46bd594c09","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c6314e45c7fb51e448612354489cbcb3","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-15T23:34:06.692Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-855afacb27f536ff869cb8ce: start","job_status":"start","queue_duration_s":1.196048,"scheduling_latency_s":1.196066}1454gitlab # [ 260.389221] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:34:07.895Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0}1455gitlab # [ 260.392541] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:34:07.901Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"855afacb27f536ff869cb8ce","created_at":"2026-08-15T23:34:06.682Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-0b849d46bd594c09","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c6314e45c7fb51e448612354489cbcb3","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-15T23:34:06.692Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-855afacb27f536ff869cb8ce: done: 0.013083 sec","job_status":"done","queue_duration_s":1.196048,"scheduling_latency_s":1.196066,"redis_calls":7,"redis_duration_s":0.0012959999999999998,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001016,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00028,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008277,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013083,"completed_at":"2026-08-15T23:34:07.901Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1456gitlab # [ 260.433669] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:34:07.902Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"aa2a46df3ef9299e08d7017d","created_at":"2026-08-15T23:34:06.771Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-0b849d46bd594c09","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a736a7a272c53f95dfdfa25d9df7f7c0","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-08-15T23:34:06.781Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-aa2a46df3ef9299e08d7017d: start","job_status":"start","queue_duration_s":1.121161,"scheduling_latency_s":1.121177}1457gitlab # [ 260.447487] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:34:07.928Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"aa2a46df3ef9299e08d7017d","created_at":"2026-08-15T23:34:06.771Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-0b849d46bd594c09","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a736a7a272c53f95dfdfa25d9df7f7c0","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-08-15T23:34:06.781Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-aa2a46df3ef9299e08d7017d: done: 0.025798 sec","job_status":"done","queue_duration_s":1.121161,"scheduling_latency_s":1.121177,"redis_calls":14,"redis_duration_s":0.001952,"redis_read_bytes":16,"redis_write_bytes":4030,"redis_queues_calls":2,"redis_queues_duration_s":0.000209,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3019,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.001318,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":727,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000425,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":284,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01905,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.025798,"completed_at":"2026-08-15T23:34:07.928Z","load_balancing_strategy":"primary","db_duration_s":0.00212,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1458gitlab # [ 260.488756] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:34:07.929Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"ee730ff17634ebc30678bb41","created_at":"2026-08-15T23:34:06.803Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-0b849d46bd594c09","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6a85e1377ad31a7a455df221681d6a71","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-15T23:34:06.812Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-ee730ff17634ebc30678bb41: start","job_status":"start","queue_duration_s":1.117247,"scheduling_latency_s":1.117265}1459gitlab # [ 260.502163] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:34:07.950Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"ee730ff17634ebc30678bb41","created_at":"2026-08-15T23:34:06.803Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-0b849d46bd594c09","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6a85e1377ad31a7a455df221681d6a71","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-15T23:34:06.812Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-ee730ff17634ebc30678bb41: done: 0.021194 sec","job_status":"done","queue_duration_s":1.117247,"scheduling_latency_s":1.117265,"redis_calls":7,"redis_duration_s":0.001009,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000722,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000287,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013915,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.021194,"completed_at":"2026-08-15T23:34:07.950Z","load_balancing_strategy":"primary","db_duration_s":0.00293,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1460gitlab # [ 260.541818] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:34:07.951Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2b0d704bda906c8c86689a5d","created_at":"2026-08-15T23:34:07.377Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-f93aadb19b8f4ecd","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52ad70cb138131bb1a50fb906b6b21fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:34:07.458Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2b0d704bda906c8c86689a5d: start","job_status":"start","queue_duration_s":0.493287,"scheduling_latency_s":0.493305}1461gitlab # [ 260.555648] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:34:07.966Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2b0d704bda906c8c86689a5d","created_at":"2026-08-15T23:34:07.377Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-f93aadb19b8f4ecd","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52ad70cb138131bb1a50fb906b6b21fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:34:07.458Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2b0d704bda906c8c86689a5d: done: 0.01482 sec","job_status":"done","queue_duration_s":0.493287,"scheduling_latency_s":0.493305,"redis_calls":13,"redis_duration_s":0.001506,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000526,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00098,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010192,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01482,"completed_at":"2026-08-15T23:34:07.966Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1462gitlab # [ 260.595516] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:34:07.967Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6749c9ab1599ac8e03088871","created_at":"2026-08-15T23:34:07.377Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-f93aadb19b8f4ecd","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52ad70cb138131bb1a50fb906b6b21fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:34:07.458Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6749c9ab1599ac8e03088871: start","job_status":"start","queue_duration_s":0.509205,"scheduling_latency_s":0.509223}1463gitlab # [ 260.608731] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:34:07.982Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6749c9ab1599ac8e03088871","created_at":"2026-08-15T23:34:07.377Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-f93aadb19b8f4ecd","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52ad70cb138131bb1a50fb906b6b21fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:34:07.458Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6749c9ab1599ac8e03088871: done: 0.014588 sec","job_status":"done","queue_duration_s":0.509205,"scheduling_latency_s":0.509223,"redis_calls":13,"redis_duration_s":0.0014810000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000536,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000945,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010027,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014588,"completed_at":"2026-08-15T23:34:07.982Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1464gitlab # [ 260.648651] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:34:07.983Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f712f8a60524795327445131","created_at":"2026-08-15T23:34:07.377Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-f93aadb19b8f4ecd","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52ad70cb138131bb1a50fb906b6b21fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:34:07.458Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f712f8a60524795327445131: start","job_status":"start","queue_duration_s":0.524853,"scheduling_latency_s":0.524871}1465gitlab # [ 260.661345] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:34:07.997Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f712f8a60524795327445131","created_at":"2026-08-15T23:34:07.377Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-f93aadb19b8f4ecd","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52ad70cb138131bb1a50fb906b6b21fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:34:07.458Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f712f8a60524795327445131: done: 0.01465 sec","job_status":"done","queue_duration_s":0.524853,"scheduling_latency_s":0.524871,"redis_calls":13,"redis_duration_s":0.001666,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000522,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001144,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010009,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01465,"completed_at":"2026-08-15T23:34:07.997Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1466gitlab # [ 260.700724] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:34:07.998Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bd64dd7f1638545f71950632","created_at":"2026-08-15T23:34:07.377Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-f93aadb19b8f4ecd","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52ad70cb138131bb1a50fb906b6b21fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:34:07.458Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bd64dd7f1638545f71950632: start","job_status":"start","queue_duration_s":0.540566,"scheduling_latency_s":0.540582}1467gitlab # [ 260.713347] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:34:08.013Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bd64dd7f1638545f71950632","created_at":"2026-08-15T23:34:07.377Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-f93aadb19b8f4ecd","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52ad70cb138131bb1a50fb906b6b21fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:34:07.458Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bd64dd7f1638545f71950632: done: 0.014616 sec","job_status":"done","queue_duration_s":0.540566,"scheduling_latency_s":0.540582,"redis_calls":13,"redis_duration_s":0.0014629999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000529,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000934,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010137,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014616,"completed_at":"2026-08-15T23:34:08.013Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1468gitlab # [ 260.754711] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:34:08.014Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3740ce8d7b147a6522bded1f","created_at":"2026-08-15T23:34:07.377Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-f93aadb19b8f4ecd","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52ad70cb138131bb1a50fb906b6b21fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:34:07.458Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3740ce8d7b147a6522bded1f: start","job_status":"start","queue_duration_s":0.556297,"scheduling_latency_s":0.556314}1469gitlab # [ 260.767585] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:34:08.028Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3740ce8d7b147a6522bded1f","created_at":"2026-08-15T23:34:07.377Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-f93aadb19b8f4ecd","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52ad70cb138131bb1a50fb906b6b21fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:34:07.458Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3740ce8d7b147a6522bded1f: done: 0.014321 sec","job_status":"done","queue_duration_s":0.556297,"scheduling_latency_s":0.556314,"redis_calls":13,"redis_duration_s":0.0014039999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000513,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000891,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009909,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014321,"completed_at":"2026-08-15T23:34:08.028Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1470gitlab # [ 260.807953] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:34:08.029Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fdc0aca2427933c402eecdc9","created_at":"2026-08-15T23:34:07.377Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-f93aadb19b8f4ecd","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52ad70cb138131bb1a50fb906b6b21fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:34:07.458Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fdc0aca2427933c402eecdc9: start","job_status":"start","queue_duration_s":0.571672,"scheduling_latency_s":0.571688}1471gitlab # [ 260.820947] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:34:08.044Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fdc0aca2427933c402eecdc9","created_at":"2026-08-15T23:34:07.377Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-f93aadb19b8f4ecd","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52ad70cb138131bb1a50fb906b6b21fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:34:07.458Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fdc0aca2427933c402eecdc9: done: 0.014417 sec","job_status":"done","queue_duration_s":0.571672,"scheduling_latency_s":0.571688,"redis_calls":13,"redis_duration_s":0.001435,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000528,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000907,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009974,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014417,"completed_at":"2026-08-15T23:34:08.044Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1472gitlab # [ 260.860663] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:34:08.045Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"608cd30e6f039c4b75651e45","created_at":"2026-08-15T23:34:07.377Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-f93aadb19b8f4ecd","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52ad70cb138131bb1a50fb906b6b21fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:34:07.458Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-608cd30e6f039c4b75651e45: start","job_status":"start","queue_duration_s":0.587125,"scheduling_latency_s":0.587142}1473gitlab # [ 260.873342] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:34:08.060Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"608cd30e6f039c4b75651e45","created_at":"2026-08-15T23:34:07.377Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-f93aadb19b8f4ecd","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52ad70cb138131bb1a50fb906b6b21fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:34:07.458Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-608cd30e6f039c4b75651e45: done: 0.014719 sec","job_status":"done","queue_duration_s":0.587125,"scheduling_latency_s":0.587142,"redis_calls":13,"redis_duration_s":0.0015539999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000615,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000939,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010251,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014719,"completed_at":"2026-08-15T23:34:08.060Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1474gitlab # [ 260.913892] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:34:08.061Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"82b141fc601773799a020465","created_at":"2026-08-15T23:34:07.377Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-f93aadb19b8f4ecd","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52ad70cb138131bb1a50fb906b6b21fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:34:07.458Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-82b141fc601773799a020465: start","job_status":"start","queue_duration_s":0.602996,"scheduling_latency_s":0.603013}1475gitlab # [ 260.926737] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:34:08.075Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"82b141fc601773799a020465","created_at":"2026-08-15T23:34:07.377Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-f93aadb19b8f4ecd","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52ad70cb138131bb1a50fb906b6b21fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:34:07.458Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-82b141fc601773799a020465: done: 0.014532 sec","job_status":"done","queue_duration_s":0.602996,"scheduling_latency_s":0.603013,"redis_calls":13,"redis_duration_s":0.0015010000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000514,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000987,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010134,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014532,"completed_at":"2026-08-15T23:34:08.075Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1476gitlab # [ 260.968966] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:34:08.076Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b2c719365775fa281ad263c0","created_at":"2026-08-15T23:34:07.377Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-f93aadb19b8f4ecd","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52ad70cb138131bb1a50fb906b6b21fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:34:07.458Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b2c719365775fa281ad263c0: start","job_status":"start","queue_duration_s":0.618675,"scheduling_latency_s":0.618691}1477gitlab # [ 260.981785] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:34:08.091Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b2c719365775fa281ad263c0","created_at":"2026-08-15T23:34:07.377Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-f93aadb19b8f4ecd","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52ad70cb138131bb1a50fb906b6b21fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:34:07.458Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b2c719365775fa281ad263c0: done: 0.014958 sec","job_status":"done","queue_duration_s":0.618675,"scheduling_latency_s":0.618691,"redis_calls":13,"redis_duration_s":0.001481,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000542,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000939,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010417,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014958,"completed_at":"2026-08-15T23:34:08.091Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1478gitlab # [ 261.021647] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:34:08.093Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f36b3d5b6cd03b72ef1d99c8","created_at":"2026-08-15T23:34:07.377Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-f93aadb19b8f4ecd","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52ad70cb138131bb1a50fb906b6b21fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:34:07.458Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f36b3d5b6cd03b72ef1d99c8: start","job_status":"start","queue_duration_s":0.634741,"scheduling_latency_s":0.634759}1479gitlab # [ 261.034471] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:34:08.108Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f36b3d5b6cd03b72ef1d99c8","created_at":"2026-08-15T23:34:07.377Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-f93aadb19b8f4ecd","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52ad70cb138131bb1a50fb906b6b21fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:34:07.458Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f36b3d5b6cd03b72ef1d99c8: done: 0.015003 sec","job_status":"done","queue_duration_s":0.634741,"scheduling_latency_s":0.634759,"redis_calls":13,"redis_duration_s":0.0014269999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000512,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000915,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0102,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015003,"completed_at":"2026-08-15T23:34:08.107Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1480gitlab # [ 261.074797] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:34:08.109Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3fbcf03915f844f2ed262b79","created_at":"2026-08-15T23:34:07.377Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-f93aadb19b8f4ecd","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52ad70cb138131bb1a50fb906b6b21fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:34:07.458Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3fbcf03915f844f2ed262b79: start","job_status":"start","queue_duration_s":0.650805,"scheduling_latency_s":0.650823}1481gitlab # [ 261.087648] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:34:08.123Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3fbcf03915f844f2ed262b79","created_at":"2026-08-15T23:34:07.377Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-f93aadb19b8f4ecd","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52ad70cb138131bb1a50fb906b6b21fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:34:07.458Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3fbcf03915f844f2ed262b79: done: 0.014538 sec","job_status":"done","queue_duration_s":0.650805,"scheduling_latency_s":0.650823,"redis_calls":13,"redis_duration_s":0.001418,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000512,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000906,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010086,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014538,"completed_at":"2026-08-15T23:34:08.123Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1482gitlab # [ 261.127440] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:34:08.124Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"33bd4cddac2be02ae6f099c0","created_at":"2026-08-15T23:34:07.377Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-f93aadb19b8f4ecd","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52ad70cb138131bb1a50fb906b6b21fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:34:07.458Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-33bd4cddac2be02ae6f099c0: start","job_status":"start","queue_duration_s":0.666411,"scheduling_latency_s":0.666428}1483gitlab # [ 261.140354] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:34:08.139Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"33bd4cddac2be02ae6f099c0","created_at":"2026-08-15T23:34:07.377Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-f93aadb19b8f4ecd","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52ad70cb138131bb1a50fb906b6b21fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:34:07.458Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-33bd4cddac2be02ae6f099c0: done: 0.014821 sec","job_status":"done","queue_duration_s":0.666411,"scheduling_latency_s":0.666428,"redis_calls":13,"redis_duration_s":0.00148,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000539,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000941,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010253,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014821,"completed_at":"2026-08-15T23:34:08.139Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1484gitlab # [ 261.181743] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:34:08.140Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0f14c0b9e5827d3378e90d0c","created_at":"2026-08-15T23:34:07.377Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-f93aadb19b8f4ecd","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52ad70cb138131bb1a50fb906b6b21fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:34:07.458Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0f14c0b9e5827d3378e90d0c: start","job_status":"start","queue_duration_s":0.68232,"scheduling_latency_s":0.682337}1485gitlab # [ 261.219270] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:34:08.155Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0f14c0b9e5827d3378e90d0c","created_at":"2026-08-15T23:34:07.377Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-f93aadb19b8f4ecd","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52ad70cb138131bb1a50fb906b6b21fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:34:07.458Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0f14c0b9e5827d3378e90d0c: done: 0.014591 sec","job_status":"done","queue_duration_s":0.68232,"scheduling_latency_s":0.682337,"redis_calls":13,"redis_duration_s":0.001445,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000529,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000916,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010082,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014591,"completed_at":"2026-08-15T23:34:08.155Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1486gitlab # [ 261.284412] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:34:08.156Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8c05aa2c18f9f1dc590ce33e","created_at":"2026-08-15T23:34:07.377Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-f93aadb19b8f4ecd","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52ad70cb138131bb1a50fb906b6b21fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:34:07.458Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8c05aa2c18f9f1dc590ce33e: start","job_status":"start","queue_duration_s":0.697988,"scheduling_latency_s":0.698006}1487gitlab # [ 261.298792] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:34:08.171Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8c05aa2c18f9f1dc590ce33e","created_at":"2026-08-15T23:34:07.377Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-f93aadb19b8f4ecd","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52ad70cb138131bb1a50fb906b6b21fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:34:07.458Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8c05aa2c18f9f1dc590ce33e: done: 0.014826 sec","job_status":"done","queue_duration_s":0.697988,"scheduling_latency_s":0.698006,"redis_calls":13,"redis_duration_s":0.001563,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000546,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001017,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010267,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014826,"completed_at":"2026-08-15T23:34:08.171Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1488gitlab # [ 261.339737] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:34:08.172Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ea999711d48cae22b277a31e","created_at":"2026-08-15T23:34:07.377Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-f93aadb19b8f4ecd","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52ad70cb138131bb1a50fb906b6b21fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:34:07.458Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ea999711d48cae22b277a31e: start","job_status":"start","queue_duration_s":0.713898,"scheduling_latency_s":0.713941}1489gitlab # [ 261.352763] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:34:08.186Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ea999711d48cae22b277a31e","created_at":"2026-08-15T23:34:07.377Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-f93aadb19b8f4ecd","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52ad70cb138131bb1a50fb906b6b21fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:34:07.458Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ea999711d48cae22b277a31e: done: 0.014819 sec","job_status":"done","queue_duration_s":0.713898,"scheduling_latency_s":0.713941,"redis_calls":13,"redis_duration_s":0.001546,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000522,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001024,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010242,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014819,"completed_at":"2026-08-15T23:34:08.186Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1490gitlab # [ 261.394026] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:34:08.188Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"63d2be7376ee8dc30cef42e8","created_at":"2026-08-15T23:34:07.377Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-f93aadb19b8f4ecd","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52ad70cb138131bb1a50fb906b6b21fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:34:07.458Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-63d2be7376ee8dc30cef42e8: start","job_status":"start","queue_duration_s":0.729949,"scheduling_latency_s":0.729966}1491gitlab # [ 261.406762] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:34:08.203Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"63d2be7376ee8dc30cef42e8","created_at":"2026-08-15T23:34:07.377Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-f93aadb19b8f4ecd","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52ad70cb138131bb1a50fb906b6b21fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:34:07.458Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-63d2be7376ee8dc30cef42e8: done: 0.015473 sec","job_status":"done","queue_duration_s":0.729949,"scheduling_latency_s":0.729966,"redis_calls":13,"redis_duration_s":0.001773,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000709,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001064,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010831,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015473,"completed_at":"2026-08-15T23:34:08.203Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1492gitlab # [ 261.446781] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:34:08.204Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cb85fb3241b0dab8b1a5c200","created_at":"2026-08-15T23:34:07.377Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-f93aadb19b8f4ecd","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52ad70cb138131bb1a50fb906b6b21fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:34:07.458Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cb85fb3241b0dab8b1a5c200: start","job_status":"start","queue_duration_s":0.746619,"scheduling_latency_s":0.746636}1493gitlab # [ 261.459823] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:34:08.220Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cb85fb3241b0dab8b1a5c200","created_at":"2026-08-15T23:34:07.377Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-f93aadb19b8f4ecd","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52ad70cb138131bb1a50fb906b6b21fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:34:07.458Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cb85fb3241b0dab8b1a5c200: done: 0.015518 sec","job_status":"done","queue_duration_s":0.746619,"scheduling_latency_s":0.746636,"redis_calls":13,"redis_duration_s":0.001695,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000542,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001153,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010859,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015518,"completed_at":"2026-08-15T23:34:08.220Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1494gitlab # [ 261.500623] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:34:08.221Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1b6c0d834c6e672fa03333f7","created_at":"2026-08-15T23:34:07.377Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-f93aadb19b8f4ecd","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52ad70cb138131bb1a50fb906b6b21fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:34:07.458Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1b6c0d834c6e672fa03333f7: start","job_status":"start","queue_duration_s":0.763487,"scheduling_latency_s":0.763504}1495gitlab # [ 261.513148] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:34:08.237Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1b6c0d834c6e672fa03333f7","created_at":"2026-08-15T23:34:07.377Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-f93aadb19b8f4ecd","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52ad70cb138131bb1a50fb906b6b21fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:34:07.458Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1b6c0d834c6e672fa03333f7: done: 0.015486 sec","job_status":"done","queue_duration_s":0.763487,"scheduling_latency_s":0.763504,"redis_calls":13,"redis_duration_s":0.001466,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000536,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00093,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011051,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015486,"completed_at":"2026-08-15T23:34:08.237Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1496gitlab # [ 261.552404] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:34:08.238Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bf6b1c83ba1061f653cb2820","created_at":"2026-08-15T23:34:07.377Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-f93aadb19b8f4ecd","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52ad70cb138131bb1a50fb906b6b21fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:34:07.458Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bf6b1c83ba1061f653cb2820: start","job_status":"start","queue_duration_s":0.780228,"scheduling_latency_s":0.780245}1497gitlab # [ 261.564956] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:34:08.254Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bf6b1c83ba1061f653cb2820","created_at":"2026-08-15T23:34:07.377Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-f93aadb19b8f4ecd","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52ad70cb138131bb1a50fb906b6b21fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:34:07.458Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bf6b1c83ba1061f653cb2820: done: 0.015629 sec","job_status":"done","queue_duration_s":0.780228,"scheduling_latency_s":0.780245,"redis_calls":13,"redis_duration_s":0.001532,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000563,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000969,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010755,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015629,"completed_at":"2026-08-15T23:34:08.254Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1498gitlab # [ 261.604758] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:34:08.255Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"98417213b06b7821c937e7c8","created_at":"2026-08-15T23:34:07.377Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-f93aadb19b8f4ecd","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52ad70cb138131bb1a50fb906b6b21fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:34:07.458Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-98417213b06b7821c937e7c8: start","job_status":"start","queue_duration_s":0.797282,"scheduling_latency_s":0.797301}1499gitlab # [ 261.617404] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:34:08.270Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"98417213b06b7821c937e7c8","created_at":"2026-08-15T23:34:07.377Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-f93aadb19b8f4ecd","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52ad70cb138131bb1a50fb906b6b21fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:34:07.458Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-98417213b06b7821c937e7c8: done: 0.015229 sec","job_status":"done","queue_duration_s":0.797282,"scheduling_latency_s":0.797301,"redis_calls":13,"redis_duration_s":0.001632,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000688,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000944,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010504,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015229,"completed_at":"2026-08-15T23:34:08.270Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1500gitlab # [ 261.656868] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:34:08.271Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6988e473b685ed8891a1d598","created_at":"2026-08-15T23:34:07.377Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-f93aadb19b8f4ecd","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52ad70cb138131bb1a50fb906b6b21fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:34:07.458Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6988e473b685ed8891a1d598: start","job_status":"start","queue_duration_s":0.813549,"scheduling_latency_s":0.813566}1501gitlab # [ 261.669423] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:34:08.287Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6988e473b685ed8891a1d598","created_at":"2026-08-15T23:34:07.377Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-f93aadb19b8f4ecd","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52ad70cb138131bb1a50fb906b6b21fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:34:07.458Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6988e473b685ed8891a1d598: done: 0.015277 sec","job_status":"done","queue_duration_s":0.813549,"scheduling_latency_s":0.813566,"redis_calls":13,"redis_duration_s":0.001607,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000523,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001084,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010765,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015277,"completed_at":"2026-08-15T23:34:08.287Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1502gitlab # [ 261.708330] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:34:08.288Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a22ecdaec8f77f1deb2b0b91","created_at":"2026-08-15T23:34:07.377Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-f93aadb19b8f4ecd","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52ad70cb138131bb1a50fb906b6b21fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:34:07.458Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a22ecdaec8f77f1deb2b0b91: start","job_status":"start","queue_duration_s":0.829884,"scheduling_latency_s":0.829902}1503gitlab # [ 261.720923] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:34:08.304Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a22ecdaec8f77f1deb2b0b91","created_at":"2026-08-15T23:34:07.377Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-f93aadb19b8f4ecd","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52ad70cb138131bb1a50fb906b6b21fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:34:07.458Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a22ecdaec8f77f1deb2b0b91: done: 0.016224 sec","job_status":"done","queue_duration_s":0.829884,"scheduling_latency_s":0.829902,"redis_calls":13,"redis_duration_s":0.001669,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000543,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001126,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010804,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016224,"completed_at":"2026-08-15T23:34:08.304Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1504gitlab # [ 261.761668] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:34:08.305Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"08a34915de6d0180fc57a5f2","created_at":"2026-08-15T23:34:07.377Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-f93aadb19b8f4ecd","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52ad70cb138131bb1a50fb906b6b21fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:34:07.458Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-08a34915de6d0180fc57a5f2: start","job_status":"start","queue_duration_s":0.847119,"scheduling_latency_s":0.847135}1505gitlab # [ 261.774794] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:34:08.321Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"08a34915de6d0180fc57a5f2","created_at":"2026-08-15T23:34:07.377Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-f93aadb19b8f4ecd","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52ad70cb138131bb1a50fb906b6b21fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:34:07.458Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-08a34915de6d0180fc57a5f2: done: 0.015698 sec","job_status":"done","queue_duration_s":0.847119,"scheduling_latency_s":0.847135,"redis_calls":13,"redis_duration_s":0.001635,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000546,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001089,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010755,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015698,"completed_at":"2026-08-15T23:34:08.321Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1506gitlab # [ 261.816508] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:34:08.322Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9f2541f7d2f844cbdb30d2df","created_at":"2026-08-15T23:34:07.377Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-f93aadb19b8f4ecd","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52ad70cb138131bb1a50fb906b6b21fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:34:07.458Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9f2541f7d2f844cbdb30d2df: start","job_status":"start","queue_duration_s":0.863834,"scheduling_latency_s":0.86385}1507gitlab # [ 261.829249] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:34:08.337Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9f2541f7d2f844cbdb30d2df","created_at":"2026-08-15T23:34:07.377Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-f93aadb19b8f4ecd","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52ad70cb138131bb1a50fb906b6b21fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:34:07.458Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9f2541f7d2f844cbdb30d2df: done: 0.015534 sec","job_status":"done","queue_duration_s":0.863834,"scheduling_latency_s":0.86385,"redis_calls":13,"redis_duration_s":0.001536,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00055,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000986,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010585,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015534,"completed_at":"2026-08-15T23:34:08.337Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1508gitlab # [ 261.869620] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:34:08.338Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"000bfda61e06beda55e36256","created_at":"2026-08-15T23:34:07.377Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-f93aadb19b8f4ecd","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52ad70cb138131bb1a50fb906b6b21fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:34:07.458Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-000bfda61e06beda55e36256: start","job_status":"start","queue_duration_s":0.880561,"scheduling_latency_s":0.880577}1509gitlab # [ 261.882448] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:34:08.354Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"000bfda61e06beda55e36256","created_at":"2026-08-15T23:34:07.377Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-f93aadb19b8f4ecd","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52ad70cb138131bb1a50fb906b6b21fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:34:07.458Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-000bfda61e06beda55e36256: done: 0.015178 sec","job_status":"done","queue_duration_s":0.880561,"scheduling_latency_s":0.880577,"redis_calls":13,"redis_duration_s":0.001751,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000795,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000956,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010591,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015178,"completed_at":"2026-08-15T23:34:08.353Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1510gitlab # [ 261.922827] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:34:08.355Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fce881a63aefd614a98c5e98","created_at":"2026-08-15T23:34:07.377Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-f93aadb19b8f4ecd","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52ad70cb138131bb1a50fb906b6b21fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:34:07.458Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fce881a63aefd614a98c5e98: start","job_status":"start","queue_duration_s":0.897061,"scheduling_latency_s":0.897078}1511gitlab # [ 261.935696] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:34:08.370Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fce881a63aefd614a98c5e98","created_at":"2026-08-15T23:34:07.377Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-f93aadb19b8f4ecd","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52ad70cb138131bb1a50fb906b6b21fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:34:07.458Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fce881a63aefd614a98c5e98: done: 0.015171 sec","job_status":"done","queue_duration_s":0.897061,"scheduling_latency_s":0.897078,"redis_calls":13,"redis_duration_s":0.00147,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000546,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000924,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010395,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015171,"completed_at":"2026-08-15T23:34:08.370Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1512gitlab # [ 261.976602] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:34:08.372Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b5f07845695685623763c392","created_at":"2026-08-15T23:34:07.377Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-f93aadb19b8f4ecd","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52ad70cb138131bb1a50fb906b6b21fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:34:07.458Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b5f07845695685623763c392: start","job_status":"start","queue_duration_s":0.913726,"scheduling_latency_s":0.913744}1513gitlab # [ 261.990448] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:34:08.387Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b5f07845695685623763c392","created_at":"2026-08-15T23:34:07.377Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-f93aadb19b8f4ecd","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52ad70cb138131bb1a50fb906b6b21fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:34:07.458Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b5f07845695685623763c392: done: 0.015262 sec","job_status":"done","queue_duration_s":0.913726,"scheduling_latency_s":0.913744,"redis_calls":13,"redis_duration_s":0.001498,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000553,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000945,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010869,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015262,"completed_at":"2026-08-15T23:34:08.387Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1514gitlab # [ 262.030872] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:34:08.388Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"840dc2d0b2df47a42c28e999","created_at":"2026-08-15T23:34:07.377Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-f93aadb19b8f4ecd","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52ad70cb138131bb1a50fb906b6b21fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:34:07.458Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-840dc2d0b2df47a42c28e999: start","job_status":"start","queue_duration_s":0.930216,"scheduling_latency_s":0.930233}1515gitlab # [ 262.043865] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:34:08.403Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"840dc2d0b2df47a42c28e999","created_at":"2026-08-15T23:34:07.377Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-f93aadb19b8f4ecd","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52ad70cb138131bb1a50fb906b6b21fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:34:07.458Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-840dc2d0b2df47a42c28e999: done: 0.015394 sec","job_status":"done","queue_duration_s":0.930216,"scheduling_latency_s":0.930233,"redis_calls":13,"redis_duration_s":0.001618,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000521,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001097,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010706,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015394,"completed_at":"2026-08-15T23:34:08.403Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1516gitlab # [ 262.084494] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:34:08.405Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"36acbdca3417b8c9ed7c2513","created_at":"2026-08-15T23:34:07.377Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-f93aadb19b8f4ecd","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52ad70cb138131bb1a50fb906b6b21fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:34:07.458Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-36acbdca3417b8c9ed7c2513: start","job_status":"start","queue_duration_s":0.947036,"scheduling_latency_s":0.947054}1517gitlab # [ 262.097131] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:34:08.420Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"36acbdca3417b8c9ed7c2513","created_at":"2026-08-15T23:34:07.377Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-f93aadb19b8f4ecd","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52ad70cb138131bb1a50fb906b6b21fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:34:07.458Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-36acbdca3417b8c9ed7c2513: done: 0.015438 sec","job_status":"done","queue_duration_s":0.947036,"scheduling_latency_s":0.947054,"redis_calls":13,"redis_duration_s":0.0018470000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000734,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001113,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011004,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015438,"completed_at":"2026-08-15T23:34:08.420Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1518gitlab # [ 262.137507] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:34:08.422Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f5c5603f7ac21ceb8302d64e","created_at":"2026-08-15T23:34:07.377Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-f93aadb19b8f4ecd","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52ad70cb138131bb1a50fb906b6b21fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:34:07.458Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f5c5603f7ac21ceb8302d64e: start","job_status":"start","queue_duration_s":0.96371,"scheduling_latency_s":0.963727}1519gitlab # [ 262.150307] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:34:08.437Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f5c5603f7ac21ceb8302d64e","created_at":"2026-08-15T23:34:07.377Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-f93aadb19b8f4ecd","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52ad70cb138131bb1a50fb906b6b21fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:34:07.458Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f5c5603f7ac21ceb8302d64e: done: 0.015093 sec","job_status":"done","queue_duration_s":0.96371,"scheduling_latency_s":0.963727,"redis_calls":13,"redis_duration_s":0.001616,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000693,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000923,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010515,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015093,"completed_at":"2026-08-15T23:34:08.437Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1520gitlab # [ 262.189824] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:34:08.438Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"64ff0ce76ecbdb8071408357","created_at":"2026-08-15T23:34:07.377Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-f93aadb19b8f4ecd","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52ad70cb138131bb1a50fb906b6b21fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:34:07.458Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-64ff0ce76ecbdb8071408357: start","job_status":"start","queue_duration_s":0.980008,"scheduling_latency_s":0.980026}1521gitlab # [ 262.203925] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:34:08.453Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"64ff0ce76ecbdb8071408357","created_at":"2026-08-15T23:34:07.377Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-f93aadb19b8f4ecd","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52ad70cb138131bb1a50fb906b6b21fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:34:07.458Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-64ff0ce76ecbdb8071408357: done: 0.015334 sec","job_status":"done","queue_duration_s":0.980008,"scheduling_latency_s":0.980026,"redis_calls":13,"redis_duration_s":0.00148,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000526,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000954,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010758,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015334,"completed_at":"2026-08-15T23:34:08.453Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1522gitlab # [ 262.244424] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:34:08.454Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"deadc66b56987f65b4a08114","created_at":"2026-08-15T23:34:07.377Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-f93aadb19b8f4ecd","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52ad70cb138131bb1a50fb906b6b21fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:34:07.458Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-deadc66b56987f65b4a08114: start","job_status":"start","queue_duration_s":0.996356,"scheduling_latency_s":0.996372}1523gitlab # [ 262.256883] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:34:08.473Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"deadc66b56987f65b4a08114","created_at":"2026-08-15T23:34:07.377Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-f93aadb19b8f4ecd","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52ad70cb138131bb1a50fb906b6b21fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:34:07.458Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-deadc66b56987f65b4a08114: done: 0.018976 sec","job_status":"done","queue_duration_s":0.996356,"scheduling_latency_s":0.996372,"redis_calls":13,"redis_duration_s":0.001568,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000572,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000996,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010603,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018976,"completed_at":"2026-08-15T23:34:08.473Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1524gitlab # [ 262.297042] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:34:08.478Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5ff629aa8fdbb1947ab6c433","created_at":"2026-08-15T23:34:07.377Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-f93aadb19b8f4ecd","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52ad70cb138131bb1a50fb906b6b21fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:34:07.458Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5ff629aa8fdbb1947ab6c433: start","job_status":"start","queue_duration_s":1.019762,"scheduling_latency_s":1.019779}1525gitlab # [ 262.309621] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:34:08.506Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5ff629aa8fdbb1947ab6c433","created_at":"2026-08-15T23:34:07.377Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-f93aadb19b8f4ecd","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52ad70cb138131bb1a50fb906b6b21fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:34:07.458Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5ff629aa8fdbb1947ab6c433: done: 0.02842 sec","job_status":"done","queue_duration_s":1.019762,"scheduling_latency_s":1.019779,"redis_calls":13,"redis_duration_s":0.003037,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001026,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002011,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010247,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.02842,"completed_at":"2026-08-15T23:34:08.506Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1526gitlab # [ 262.349574] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:34:08.508Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8c421004b25158ac7334818b","created_at":"2026-08-15T23:34:07.377Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-f93aadb19b8f4ecd","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52ad70cb138131bb1a50fb906b6b21fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:34:07.458Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8c421004b25158ac7334818b: start","job_status":"start","queue_duration_s":1.05027,"scheduling_latency_s":1.050287}1527gitlab # [ 262.362136] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:34:08.525Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8c421004b25158ac7334818b","created_at":"2026-08-15T23:34:07.377Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-f93aadb19b8f4ecd","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52ad70cb138131bb1a50fb906b6b21fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:34:07.458Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8c421004b25158ac7334818b: done: 0.016759 sec","job_status":"done","queue_duration_s":1.05027,"scheduling_latency_s":1.050287,"redis_calls":13,"redis_duration_s":0.002849,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000961,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001888,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010775,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016759,"completed_at":"2026-08-15T23:34:08.525Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1528gitlab # [ 262.402415] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:34:08.526Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"010116a4ae589a7dc897add4","created_at":"2026-08-15T23:34:07.377Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-f93aadb19b8f4ecd","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52ad70cb138131bb1a50fb906b6b21fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:34:07.458Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-010116a4ae589a7dc897add4: start","job_status":"start","queue_duration_s":1.068529,"scheduling_latency_s":1.068545}1529gitlab # [ 262.415228] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:34:08.542Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"010116a4ae589a7dc897add4","created_at":"2026-08-15T23:34:07.377Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-f93aadb19b8f4ecd","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52ad70cb138131bb1a50fb906b6b21fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:34:07.458Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-010116a4ae589a7dc897add4: done: 0.015708 sec","job_status":"done","queue_duration_s":1.068529,"scheduling_latency_s":1.068545,"redis_calls":13,"redis_duration_s":0.002586,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000934,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001652,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010072,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015708,"completed_at":"2026-08-15T23:34:08.542Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1530gitlab # [ 262.454965] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:34:08.544Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"184b92931ad908f9be5ae6d4","created_at":"2026-08-15T23:34:07.377Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-f93aadb19b8f4ecd","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52ad70cb138131bb1a50fb906b6b21fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:34:07.458Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-184b92931ad908f9be5ae6d4: start","job_status":"start","queue_duration_s":1.085897,"scheduling_latency_s":1.085913}1531gitlab # [ 262.467788] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:34:08.560Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"184b92931ad908f9be5ae6d4","created_at":"2026-08-15T23:34:07.377Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-f93aadb19b8f4ecd","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52ad70cb138131bb1a50fb906b6b21fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:34:07.458Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-184b92931ad908f9be5ae6d4: done: 0.015965 sec","job_status":"done","queue_duration_s":1.085897,"scheduling_latency_s":1.085913,"redis_calls":13,"redis_duration_s":0.0026449999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000914,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001731,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010205,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015965,"completed_at":"2026-08-15T23:34:08.560Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1532gitlab # [ 262.507842] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:34:08.561Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2f8697e2cdbfc74b48b8eef2","created_at":"2026-08-15T23:34:07.377Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-f93aadb19b8f4ecd","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52ad70cb138131bb1a50fb906b6b21fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:34:07.458Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2f8697e2cdbfc74b48b8eef2: start","job_status":"start","queue_duration_s":1.103465,"scheduling_latency_s":1.103481}1533gitlab # [ 262.520578] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:34:08.577Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2f8697e2cdbfc74b48b8eef2","created_at":"2026-08-15T23:34:07.377Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-f93aadb19b8f4ecd","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52ad70cb138131bb1a50fb906b6b21fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:34:07.458Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2f8697e2cdbfc74b48b8eef2: done: 0.016139 sec","job_status":"done","queue_duration_s":1.103465,"scheduling_latency_s":1.103481,"redis_calls":13,"redis_duration_s":0.002886,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001146,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00174,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01027,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016139,"completed_at":"2026-08-15T23:34:08.577Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1534gitlab # [ 262.560181] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:34:08.579Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1e3045567de83b22654b5423","created_at":"2026-08-15T23:34:07.377Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-f93aadb19b8f4ecd","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52ad70cb138131bb1a50fb906b6b21fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:34:07.458Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1e3045567de83b22654b5423: start","job_status":"start","queue_duration_s":1.120907,"scheduling_latency_s":1.120923}1535gitlab # [ 262.572790] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:34:08.673Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1e3045567de83b22654b5423","created_at":"2026-08-15T23:34:07.377Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-f93aadb19b8f4ecd","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52ad70cb138131bb1a50fb906b6b21fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:34:07.458Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1e3045567de83b22654b5423: done: 0.094492 sec","job_status":"done","queue_duration_s":1.120907,"scheduling_latency_s":1.120923,"redis_calls":13,"redis_duration_s":0.002847,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000981,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001866,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010984,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.094492,"completed_at":"2026-08-15T23:34:08.673Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1536gitlab # [ 262.614002] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:34:08.675Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b8543722ed64db386e802322","created_at":"2026-08-15T23:34:07.377Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-f93aadb19b8f4ecd","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52ad70cb138131bb1a50fb906b6b21fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:34:07.458Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b8543722ed64db386e802322: start","job_status":"start","queue_duration_s":1.216913,"scheduling_latency_s":1.216929}1537gitlab # [ 262.626866] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:34:08.692Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b8543722ed64db386e802322","created_at":"2026-08-15T23:34:07.377Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-f93aadb19b8f4ecd","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52ad70cb138131bb1a50fb906b6b21fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:34:07.458Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b8543722ed64db386e802322: done: 0.016995 sec","job_status":"done","queue_duration_s":1.216913,"scheduling_latency_s":1.216929,"redis_calls":13,"redis_duration_s":0.0029449999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000998,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001947,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011086,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016995,"completed_at":"2026-08-15T23:34:08.692Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1538gitlab # [ 262.666473] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:34:08.693Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3d92f86280c9ce5216e6f08a","created_at":"2026-08-15T23:34:07.377Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-f93aadb19b8f4ecd","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52ad70cb138131bb1a50fb906b6b21fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:34:07.458Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3d92f86280c9ce5216e6f08a: start","job_status":"start","queue_duration_s":1.235204,"scheduling_latency_s":1.235218}1539gitlab # [ 262.679182] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:34:08.710Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3d92f86280c9ce5216e6f08a","created_at":"2026-08-15T23:34:07.377Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-f93aadb19b8f4ecd","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52ad70cb138131bb1a50fb906b6b21fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:34:07.458Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3d92f86280c9ce5216e6f08a: done: 0.016575 sec","job_status":"done","queue_duration_s":1.235204,"scheduling_latency_s":1.235218,"redis_calls":13,"redis_duration_s":0.0031520000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001306,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001846,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010584,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016575,"completed_at":"2026-08-15T23:34:08.710Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1540gitlab # [ 262.719049] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:34:08.711Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a695f02c230e4a2f98a1ea16","created_at":"2026-08-15T23:34:07.377Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-f93aadb19b8f4ecd","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52ad70cb138131bb1a50fb906b6b21fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:34:07.458Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a695f02c230e4a2f98a1ea16: start","job_status":"start","queue_duration_s":1.253124,"scheduling_latency_s":1.25314}1541gitlab # [ 262.731850] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:34:08.727Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a695f02c230e4a2f98a1ea16","created_at":"2026-08-15T23:34:07.377Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-f93aadb19b8f4ecd","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52ad70cb138131bb1a50fb906b6b21fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:34:07.458Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a695f02c230e4a2f98a1ea16: done: 0.015779 sec","job_status":"done","queue_duration_s":1.253124,"scheduling_latency_s":1.25314,"redis_calls":13,"redis_duration_s":0.0027229999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000926,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001797,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010172,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015779,"completed_at":"2026-08-15T23:34:08.727Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1542gitlab # [ 262.771971] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:34:08.729Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fdb89793d67581841ce8fef4","created_at":"2026-08-15T23:34:07.377Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-f93aadb19b8f4ecd","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52ad70cb138131bb1a50fb906b6b21fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:34:07.458Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fdb89793d67581841ce8fef4: start","job_status":"start","queue_duration_s":1.271134,"scheduling_latency_s":1.271152}1543gitlab # [ 262.784751] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:34:08.745Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fdb89793d67581841ce8fef4","created_at":"2026-08-15T23:34:07.377Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-f93aadb19b8f4ecd","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52ad70cb138131bb1a50fb906b6b21fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:34:07.458Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fdb89793d67581841ce8fef4: done: 0.016504 sec","job_status":"done","queue_duration_s":1.271134,"scheduling_latency_s":1.271152,"redis_calls":13,"redis_duration_s":0.002816,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000976,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00184,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010485,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016504,"completed_at":"2026-08-15T23:34:08.745Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1544gitlab # [ 262.824747] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:34:08.747Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f3fb5d1f67134987d4607ff0","created_at":"2026-08-15T23:34:07.377Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-f93aadb19b8f4ecd","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52ad70cb138131bb1a50fb906b6b21fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:34:07.458Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f3fb5d1f67134987d4607ff0: start","job_status":"start","queue_duration_s":1.288974,"scheduling_latency_s":1.28899}1545gitlab # [ 262.837373] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:34:08.763Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f3fb5d1f67134987d4607ff0","created_at":"2026-08-15T23:34:07.377Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-f93aadb19b8f4ecd","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52ad70cb138131bb1a50fb906b6b21fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:34:07.458Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f3fb5d1f67134987d4607ff0: done: 0.016117 sec","job_status":"done","queue_duration_s":1.288974,"scheduling_latency_s":1.28899,"redis_calls":13,"redis_duration_s":0.002872,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000934,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001938,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010412,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016117,"completed_at":"2026-08-15T23:34:08.763Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1546gitlab # [ 262.877114] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:34:08.764Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"36a1b1b3ce53b9d277919ed8","created_at":"2026-08-15T23:34:07.377Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-f93aadb19b8f4ecd","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52ad70cb138131bb1a50fb906b6b21fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:34:07.458Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-36a1b1b3ce53b9d277919ed8: start","job_status":"start","queue_duration_s":1.306471,"scheduling_latency_s":1.306486}1547gitlab # [ 262.890998] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:34:08.780Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"36a1b1b3ce53b9d277919ed8","created_at":"2026-08-15T23:34:07.377Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-f93aadb19b8f4ecd","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52ad70cb138131bb1a50fb906b6b21fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:34:07.458Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-36a1b1b3ce53b9d277919ed8: done: 0.015885 sec","job_status":"done","queue_duration_s":1.306471,"scheduling_latency_s":1.306486,"redis_calls":13,"redis_duration_s":0.002694,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000939,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001755,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010316,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015885,"completed_at":"2026-08-15T23:34:08.780Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1548gitlab # [ 262.930952] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:34:08.781Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8fdead2b53006e47039f2c50","created_at":"2026-08-15T23:34:07.377Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-f93aadb19b8f4ecd","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52ad70cb138131bb1a50fb906b6b21fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:34:07.458Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8fdead2b53006e47039f2c50: start","job_status":"start","queue_duration_s":1.323657,"scheduling_latency_s":1.323672}1549gitlab # [ 262.943630] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:34:08.797Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8fdead2b53006e47039f2c50","created_at":"2026-08-15T23:34:07.377Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-f93aadb19b8f4ecd","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52ad70cb138131bb1a50fb906b6b21fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:34:07.458Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8fdead2b53006e47039f2c50: done: 0.015986 sec","job_status":"done","queue_duration_s":1.323657,"scheduling_latency_s":1.323672,"redis_calls":13,"redis_duration_s":0.002802,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000966,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001836,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009519,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015986,"completed_at":"2026-08-15T23:34:08.797Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1550gitlab # [ 262.983349] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:34:08.800Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ecf124232faef5bda1d818aa","created_at":"2026-08-15T23:34:07.377Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-f93aadb19b8f4ecd","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52ad70cb138131bb1a50fb906b6b21fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:34:07.458Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ecf124232faef5bda1d818aa: start","job_status":"start","queue_duration_s":1.342056,"scheduling_latency_s":1.342073}1551gitlab # [ 262.996109] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:34:08.832Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ecf124232faef5bda1d818aa","created_at":"2026-08-15T23:34:07.377Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-f93aadb19b8f4ecd","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52ad70cb138131bb1a50fb906b6b21fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:34:07.458Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ecf124232faef5bda1d818aa: done: 0.032359 sec","job_status":"done","queue_duration_s":1.342056,"scheduling_latency_s":1.342073,"redis_calls":13,"redis_duration_s":0.005698999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001291,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.004408,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023005,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.032359,"completed_at":"2026-08-15T23:34:08.832Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1552gitlab # [ 263.036858] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:34:08.836Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5da8f260000b959daa0851f2","created_at":"2026-08-15T23:34:07.377Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-f93aadb19b8f4ecd","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52ad70cb138131bb1a50fb906b6b21fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:34:07.458Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5da8f260000b959daa0851f2: start","job_status":"start","queue_duration_s":1.378467,"scheduling_latency_s":1.37851}1553gitlab # [ 263.049996] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:34:08.871Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5da8f260000b959daa0851f2","created_at":"2026-08-15T23:34:07.377Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-f93aadb19b8f4ecd","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52ad70cb138131bb1a50fb906b6b21fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:34:07.458Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5da8f260000b959daa0851f2: done: 0.035046 sec","job_status":"done","queue_duration_s":1.378467,"scheduling_latency_s":1.37851,"redis_calls":13,"redis_duration_s":0.0032569999999999995,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001187,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00207,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024125,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.035046,"completed_at":"2026-08-15T23:34:08.871Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1554gitlab # [ 263.090119] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:34:08.873Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3ca7fc64cdb931b9e9b31393","created_at":"2026-08-15T23:34:07.377Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-f93aadb19b8f4ecd","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52ad70cb138131bb1a50fb906b6b21fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:34:07.458Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3ca7fc64cdb931b9e9b31393: start","job_status":"start","queue_duration_s":1.415237,"scheduling_latency_s":1.415264}1555gitlab # [ 263.103172] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:34:08.895Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3ca7fc64cdb931b9e9b31393","created_at":"2026-08-15T23:34:07.377Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-f93aadb19b8f4ecd","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52ad70cb138131bb1a50fb906b6b21fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:34:07.458Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3ca7fc64cdb931b9e9b31393: done: 0.022269 sec","job_status":"done","queue_duration_s":1.415237,"scheduling_latency_s":1.415264,"redis_calls":13,"redis_duration_s":0.002088,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000742,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001346,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015542,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.022269,"completed_at":"2026-08-15T23:34:08.895Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1556gitlab # [ 263.145149] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:34:08.897Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"59252207b75a7718255f4358","created_at":"2026-08-15T23:34:07.377Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-f93aadb19b8f4ecd","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52ad70cb138131bb1a50fb906b6b21fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:34:07.458Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-59252207b75a7718255f4358: start","job_status":"start","queue_duration_s":1.438898,"scheduling_latency_s":1.43892}1557gitlab # [ 263.157845] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:34:08.917Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"59252207b75a7718255f4358","created_at":"2026-08-15T23:34:07.377Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-f93aadb19b8f4ecd","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52ad70cb138131bb1a50fb906b6b21fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:34:07.458Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-59252207b75a7718255f4358: done: 0.019901 sec","job_status":"done","queue_duration_s":1.438898,"scheduling_latency_s":1.43892,"redis_calls":13,"redis_duration_s":0.001908,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000657,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001251,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012212,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019901,"completed_at":"2026-08-15T23:34:08.917Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1558gitlab # [ 263.197522] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:34:08.918Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fc80870e2d4f4535be7d91e2","created_at":"2026-08-15T23:34:07.377Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-f93aadb19b8f4ecd","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52ad70cb138131bb1a50fb906b6b21fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:34:07.458Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fc80870e2d4f4535be7d91e2: start","job_status":"start","queue_duration_s":1.459974,"scheduling_latency_s":1.459992}1559gitlab # [ 263.210290] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:34:08.934Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fc80870e2d4f4535be7d91e2","created_at":"2026-08-15T23:34:07.377Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-f93aadb19b8f4ecd","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52ad70cb138131bb1a50fb906b6b21fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:34:07.458Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fc80870e2d4f4535be7d91e2: done: 0.016339 sec","job_status":"done","queue_duration_s":1.459974,"scheduling_latency_s":1.459992,"redis_calls":13,"redis_duration_s":0.00163,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00059,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00104,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011601,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016339,"completed_at":"2026-08-15T23:34:08.934Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1560gitlab # [ 263.251601] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:34:08.935Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"6d6518a823350e0da656f6b3","created_at":"2026-08-15T23:34:07.913Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-4e98e43e5f0145ab","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"a736a7a272c53f95dfdfa25d9df7f7c0","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:34:07.922Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-6d6518a823350e0da656f6b3: start","job_status":"start","queue_duration_s":1.013021,"scheduling_latency_s":1.013037}1561gitlab # [ 263.264191] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:34:08.948Z","message":"No existing merge request to be cleaned up."}1562gitlab # [ 263.265920] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:34:08.956Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"6d6518a823350e0da656f6b3","created_at":"2026-08-15T23:34:07.913Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-4e98e43e5f0145ab","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"a736a7a272c53f95dfdfa25d9df7f7c0","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:34:07.922Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-6d6518a823350e0da656f6b3: done: 0.020917 sec","job_status":"done","queue_duration_s":1.013021,"scheduling_latency_s":1.013037,"redis_calls":10,"redis_duration_s":0.001449,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000628,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000821,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015068,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020917,"completed_at":"2026-08-15T23:34:08.956Z","load_balancing_strategy":"primary","db_duration_s":0.002169,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1563gitlab # [ 263.305362] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:34:08.958Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"ccd10e6bb2754de2c3e2feba","created_at":"2026-08-15T23:34:07.913Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-4e98e43e5f0145ab","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"a736a7a272c53f95dfdfa25d9df7f7c0","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:34:07.922Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-ccd10e6bb2754de2c3e2feba: start","job_status":"start","queue_duration_s":1.0359,"scheduling_latency_s":1.035919}1564gitlab # [ 263.318022] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:34:08.968Z","message":"No existing merge request to be cleaned up."}1565gitlab # [ 263.319674] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:34:08.977Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"ccd10e6bb2754de2c3e2feba","created_at":"2026-08-15T23:34:07.913Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-4e98e43e5f0145ab","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"a736a7a272c53f95dfdfa25d9df7f7c0","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:34:07.922Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-ccd10e6bb2754de2c3e2feba: done: 0.019049 sec","job_status":"done","queue_duration_s":1.0359,"scheduling_latency_s":1.035919,"redis_calls":10,"redis_duration_s":0.001339,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000586,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000753,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013949,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019049,"completed_at":"2026-08-15T23:34:08.977Z","load_balancing_strategy":"primary","db_duration_s":0.00133,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1566gitlab # [ 263.358661] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:34:08.978Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"5ed5b486a5bf143ad4010b97","created_at":"2026-08-15T23:34:07.913Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-4e98e43e5f0145ab","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"a736a7a272c53f95dfdfa25d9df7f7c0","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:34:07.922Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-5ed5b486a5bf143ad4010b97: start","job_status":"start","queue_duration_s":1.056006,"scheduling_latency_s":1.056023}1567gitlab # [ 263.371438] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:34:08.989Z","message":"No existing merge request to be cleaned up."}1568gitlab # [ 263.373280] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:34:08.998Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"5ed5b486a5bf143ad4010b97","created_at":"2026-08-15T23:34:07.913Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-4e98e43e5f0145ab","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"a736a7a272c53f95dfdfa25d9df7f7c0","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:34:07.922Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-5ed5b486a5bf143ad4010b97: done: 0.019271 sec","job_status":"done","queue_duration_s":1.056006,"scheduling_latency_s":1.056023,"redis_calls":10,"redis_duration_s":0.001382,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000577,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000805,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014115,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019271,"completed_at":"2026-08-15T23:34:08.997Z","load_balancing_strategy":"primary","db_duration_s":0.00127,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1569gitlab # [ 263.411582] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:34:08.999Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"efe11bd5b5388cc7f555588b","created_at":"2026-08-15T23:34:07.913Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-4e98e43e5f0145ab","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"a736a7a272c53f95dfdfa25d9df7f7c0","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:34:07.922Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-efe11bd5b5388cc7f555588b: start","job_status":"start","queue_duration_s":1.07644,"scheduling_latency_s":1.07646}1570gitlab # [ 263.425271] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:34:09.010Z","message":"No existing merge request to be cleaned up."}1571gitlab # [ 263.426899] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:34:09.019Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"efe11bd5b5388cc7f555588b","created_at":"2026-08-15T23:34:07.913Z","trace_propagation_headers":{"sentry-trace":"1a2f8681d8504078919f1df7db5087bd-4e98e43e5f0145ab","baggage":"sentry-trace_id=1a2f8681d8504078919f1df7db5087bd,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"a736a7a272c53f95dfdfa25d9df7f7c0","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:34:07.922Z","job_size_bytes":2,"pid":2010,"sidekiq_tid":"mape","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-efe11bd5b5388cc7f555588b: done: 0.020312 sec","job_status":"done","queue_duration_s":1.07644,"scheduling_latency_s":1.07646,"redis_calls":10,"redis_duration_s":0.001375,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000593,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000782,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012891,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020312,"completed_at":"2026-08-15T23:34:09.019Z","load_balancing_strategy":"primary","db_duration_s":0.001234,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1572gitlab # [ 267.560546] setup-gitlab-start[2926]: W, [2026-08-15T23:34:15.471555 #2926] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1573gitlab # [ 308.522307] postgres[3259]: [3259] ERROR: relation "table_without_models" does not exist1574gitlab # [ 308.528236] postgres[3259]: [3259] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1575gitlab # [ 309.139276] redis[794]: 10 changes in 300 seconds. Saving...1576gitlab # [ 309.139877] redis[794]: Background saving started by pid 32861577gitlab # [ 309.147975] redis[3286]: BGSAVE done, 457 keys saved, 0 keys skipped, 118183 bytes written.1578gitlab # [ 309.152575] redis[3286]: DB saved on disk1579gitlab # [ 309.154772] redis[3286]: Fork CoW for RDB: current 0 MB, peak 0 MB, average 0 MB1580gitlab # [ 309.239528] redis[794]: Background saving terminated with success1581gitlab # [ 310.594454] postgres[862]: [862] LOG: checkpoint starting: time1582gitlab # [ 311.894641] gitaly[914]: time="2026-08-15T23:34:59.805Z" level=info msg="burden monitor stats" pid=9141583gitlab # [ 314.219429] runuser[2925]: pam_unix(runuser:session): session closed for user gitlab1584gitlab # [ 314.221044] setup-gitlab-start[2902]: + systemctl restart gitlab-sidekiq.service1585gitlab # [ 314.252165] systemd[1]: Stopping gitlab-sidekiq.service...1586gitlab # [ 314.253509] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:35:02.164Z","message":"Shutting down"}1587gitlab # [ 314.255011] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:35:02.164Z","message":"Scheduler exiting..."}1588gitlab # [ 314.256587] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:35:02.164Z","message":"Terminating quiet threads for default capsule"}1589gitlab # [ 314.258385] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:35:02.165Z","message":"Scheduler exiting..."}1590gitlab # [ 314.755173] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:35:02.666Z","message":"Pausing to allow jobs to finish..."}1591gitlab # [ 316.761259] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:35:04.671Z","message":"Bye!"}1592gitlab # [ 317.589517] sidekiq-cluster[2010]: {"severity":"INFO","time":"2026-08-15T23:35:05.501Z","message":"stopped","memwd_reason":"background task stopped","memwd_handler_class":"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler","memwd_sleep_time_s":3,"pid":2010,"worker_id":"sidekiq_0","memwd_rss_bytes":971239424,"retry":0}1593gitlab # [ 318.880449] systemd[1]: gitlab-sidekiq.service: Deactivated successfully.1594gitlab # [ 318.880858] systemd[1]: Stopped gitlab-sidekiq.service.1595gitlab # [ 318.881074] systemd[1]: gitlab-sidekiq.service: Consumed 1min 49.077s CPU time over 3min 17.550s wall clock time, 955M memory peak, 4.5M read from disk.1596gitlab # [ 318.894604] systemd[1]: Started gitlab-sidekiq.service.1597gitlab # [ 318.899153] setup-gitlab-start[2902]: + mkdir -p /var/lib/secrets1598gitlab # [ 318.904060] setup-gitlab-start[2902]: + echo nixbot-test-token-of-20-chars1599gitlab # [ 318.906965] setup-gitlab-start[2902]: + chmod 644 /var/lib/secrets/gitlab-token1600gitlab # [ 318.910399] setup-gitlab-start[2902]: + curl -fs -X POST -H 'PRIVATE-TOKEN: nixbot-test-token-of-20-chars' -H 'Content-Type: application/json' -d '{"name":"test-flake","visibility":"public","topics":["build-with-buildbot"]}' http://gitlab/api/v4/projects1601gitlab # [ 320.076784] gitaly[914]: time="2026-08-15T23:35:07.987Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M03WEWV4NCSXMM8QK0CC2KSY error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-15T23:35:17.005" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-15T23:35:07.986" pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1602gitlab # [ 320.080506] gitaly[914]: time="2026-08-15T23:35:07.988Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M03WEWV4NCSXMM8QK0CC2KSY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-15T23:35:17.005" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=95 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-15T23:35:07.986" grpc.time_ms=0.995 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1603gitlab # [ 320.331282] gitaly[914]: time="2026-08-15T23:35:08.242Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M03WEWV4NCSXMM8QK0CC2KSY error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-15T23:35:18.001" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-15T23:35:08.242" pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1604gitlab # [ 320.363643] gitaly[914]: time="2026-08-15T23:35:08.244Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M03WEWV4NCSXMM8QK0CC2KSY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-15T23:35:18.001" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-15T23:35:08.242" grpc.time_ms=1.039 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1605gitlab # [ 320.396968] gitaly[914]: time="2026-08-15T23:35:08.308Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M03WEWV4NCSXMM8QK0CC2KSY diskcache=3ea7d61b-bc63-4113-8e44-4f537009260e grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-08-15T23:35:18.013" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-15T23:35:08.254" pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1606gitlab # [ 320.427954] gitaly[914]: time="2026-08-15T23:35:08.309Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=24 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1436 command.oublock=32 command.real_time_ms=30 command.spawn_token_fork_ms=6 command.system_time_ms=20 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M03WEWV4NCSXMM8QK0CC2KSY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-08-15T23:35:18.013" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-15T23:35:08.254" grpc.time_ms=54.561 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1607gitlab # [ 320.456514] gitaly[914]: time="2026-08-15T23:35:08.326Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01M03WEWV4NCSXMM8QK0CC2KSY grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-15T23:35:18.085" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-15T23:35:08.325" pid=914 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root1608gitlab # [ 320.476671] gitaly[914]: time="2026-08-15T23:35:08.327Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M03WEWV4NCSXMM8QK0CC2KSY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-15T23:35:18.085" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-15T23:35:08.325" grpc.time_ms=1.414 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1609gitlab # [ 320.494006] gitaly[914]: time="2026-08-15T23:35:08.349Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=1 command.system_time_ms=12 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M03WEWV4NCSXMM8QK0CC2KSY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-15T23:35:18.092" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-15T23:35:08.333" grpc.time_ms=16.331 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1610gitlab # [ 320.528338] gitaly[914]: time="2026-08-15T23:35:08.440Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M03WEWV4NCSXMM8QK0CC2KSY error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-15T23:35:18.199" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-15T23:35:08.439" pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1611gitlab # [ 320.546348] gitaly[914]: time="2026-08-15T23:35:08.440Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M03WEWV4NCSXMM8QK0CC2KSY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-15T23:35:18.199" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-15T23:35:08.439" grpc.time_ms=0.387 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1612gitlab # [ 320.577833] gitaly[914]: time="2026-08-15T23:35:08.489Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M03WEWV4NCSXMM8QK0CC2KSY diskcache=c7760174-b685-412c-947a-6b195f8abccc grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-08-15T23:35:18.202" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-15T23:35:08.442" pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1613gitlab # [ 320.595268] gitaly[914]: time="2026-08-15T23:35:08.490Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=22 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1439 command.oublock=32 command.real_time_ms=26 command.spawn_token_fork_ms=2 command.system_time_ms=16 command.user_time_ms=6 component=gitaly.UnaryServerInterceptor correlation_id=01M03WEWV4NCSXMM8QK0CC2KSY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-08-15T23:35:18.202" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=137 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-15T23:35:08.442" grpc.time_ms=47.233 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1614gitlab # [ 320.615103] gitaly[914]: time="2026-08-15T23:35:08.497Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01M03WEWV4NCSXMM8QK0CC2KSY grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-15T23:35:18.256" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-15T23:35:08.496" pid=914 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root1615gitlab # [ 320.632181] gitaly[914]: time="2026-08-15T23:35:08.498Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M03WEWV4NCSXMM8QK0CC2KSY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-15T23:35:18.256" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-15T23:35:08.496" grpc.time_ms=1.307 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1616gitlab # [ 320.646562] gitaly[914]: time="2026-08-15T23:35:08.510Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=1 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M03WEWV4NCSXMM8QK0CC2KSY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-15T23:35:18.261" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-15T23:35:08.501" grpc.time_ms=8.771 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1617gitlab # [ 320.662609] gitaly[914]: time="2026-08-15T23:35:08.549Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M03WEWV4NCSXMM8QK0CC2KSY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-15T23:35:18.008" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-15T23:35:08.548" grpc.time_ms=0.163 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1618gitlab # [ 320.675037] gitaly[914]: time="2026-08-15T23:35:08.556Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M03WEWV4NCSXMM8QK0CC2KSY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-08-15T23:35:18.015" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-15T23:35:08.556" grpc.time_ms=0.265 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1619gitlab # [ 321.624443] gitaly[914]: time="2026-08-15T23:35:09.535Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M03WEWV4NCSXMM8QK0CC2KSY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-15T23:35:19.278" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-15T23:35:09.518" grpc.time_ms=16.642 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1620gitlab # [ 322.077764] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/08/15:23:35:09 +0000] "POST /api/v4/projects HTTP/1.1" 201 4828 "" "curl/8.21.0" 31351621gitlab # [ 322.084511] setup-gitlab-start[2902]: + mkdir -p /tmp/test-flake1622gitlab # [ 322.087153] setup-gitlab-start[2902]: + cd /tmp/test-flake1623gitlab # [ 322.089838] setup-gitlab-start[2902]: + git init -b master1624gitlab # [ 322.097437] setup-gitlab-start[3379]: Initialized empty Git repository in /tmp/test-flake/.git/1625gitlab # [ 322.101107] setup-gitlab-start[2902]: + git config user.name test1626gitlab # [ 322.103692] setup-gitlab-start[2902]: + git config user.email test@example.com1627gitlab # [ 322.106790] setup-gitlab-start[2902]: + cat1628gitlab # [ 322.108709] setup-gitlab-start[2902]: + git add flake.nix1629gitlab # [ 322.110975] setup-gitlab-start[2902]: + git commit -m 'initial commit'1630gitlab # [ 322.130878] setup-gitlab-start[3384]: [master (root-commit) a67995a] initial commit1631gitlab # [ 322.134313] setup-gitlab-start[3384]: 1 file changed, 10 insertions(+)1632gitlab # [ 322.137220] setup-gitlab-start[3384]: create mode 100644 flake.nix1633gitlab # [ 322.139796] setup-gitlab-start[2902]: + git remote add origin http://oauth2:nixbot-test-token-of-20-chars@gitlab/root/test-flake.git1634gitlab # [ 322.144798] setup-gitlab-start[2902]: + git push -u origin master1635gitlab # [ 322.200097] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/08/15:23:35:10 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.55.0" 381636gitlab # [ 323.007652] gitaly[914]: time="2026-08-15T23:35:10.919Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=581 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=2 command.system_time_ms=6 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M03WF011WBVMT7EJB5JJ2PPG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=242 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-15T23:35:10.904" grpc.time_ms=14.882 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1637gitlab # [ 323.027258] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/08/15:23:35:10 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 178 "" "git/2.55.0" 8071638gitlab # [ 323.407427] gitaly[914]: time="2026-08-15T23:35:11.319Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=12 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M03WF0TYS012C2C6MKGWJ80W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-15T23:35:21.061" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=169 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-15T23:35:11.302" grpc.time_ms=16.5 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1639gitlab # [ 323.478526] gitaly[914]: time="2026-08-15T23:35:11.390Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=302 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=2 command.system_time_ms=6 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M03WF0TYS012C2C6MKGWJ80W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-08-15T23:35:41.074" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-08-15T23:35:11.375" grpc.time_ms=15.034 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1640gitlab # [ 323.539248] gitaly[914]: time="2026-08-15T23:35:11.451Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01M03WF0TYS012C2C6MKGWJ80W duration_ms=274ns method=POST pid=914 status=200 url="http://unix/api/v4/internal/allowed"1641gitlab # [ 323.604959] gitaly[914]: time="2026-08-15T23:35:11.516Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01M03WF0TYS012C2C6MKGWJ80W duration_ms=64ns method=POST pid=914 status=200 url="http://unix/api/v4/internal/pre_receive"1642gitlab # [ 323.618301] gitaly[914]: time="2026-08-15T23:35:11.517Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M03WF0TYS012C2C6MKGWJ80W grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5314 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-15T23:35:11.174" grpc.time_ms=342.61 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1643gitlab # [ 323.702385] gitaly[914]: time="2026-08-15T23:35:11.614Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M03WF0TYS012C2C6MKGWJ80W grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4784 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-15T23:35:11.612" grpc.time_ms=1.39 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1644gitlab # [ 323.774938] gitaly[914]: time="2026-08-15T23:35:11.686Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M03WF0TYS012C2C6MKGWJ80W grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4783 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-15T23:35:11.684" grpc.time_ms=1.012 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1645gitlab # [ 323.825504] gitaly[914]: time="2026-08-15T23:35:11.736Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M03WF0TYS012C2C6MKGWJ80W grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4785 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-15T23:35:11.733" grpc.time_ms=2.271 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1646gitlab # [ 323.992904] gitaly[914]: time="2026-08-15T23:35:11.904Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M03WF0TYS012C2C6MKGWJ80W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-15T23:35:21.006" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-15T23:35:11.887" grpc.time_ms=17.061 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1647gitlab # [ 324.019332] sidekiq-cluster[3328]: {"severity":"INFO","time":"2026-08-15T23:35:11.877Z","message":"Starting cluster with 1 processes"}1648gitlab # [ 324.040801] gitaly[914]: time="2026-08-15T23:35:11.952Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=15 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1434 command.oublock=0 command.real_time_ms=19 command.spawn_token_fork_ms=1 command.system_time_ms=12 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M03WF0TYS012C2C6MKGWJ80W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-08-15T23:35:21.048" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-08-15T23:35:11.929" grpc.time_ms=22.55 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1649gitlab # [ 324.062943] gitaly[914]: time="2026-08-15T23:35:11.964Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01M03WF0TYS012C2C6MKGWJ80W duration_ms=175ns method=POST pid=914 status=200 url="http://unix/api/v4/internal/post_receive"1650gitlab # [ 324.067148] gitaly[914]: time="2026-08-15T23:35:11.965Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M03WF0TYS012C2C6MKGWJ80W grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4808 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-15T23:35:11.787" grpc.time_ms=177.839 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1651gitlab # [ 324.082118] gitaly[914]: time="2026-08-15T23:35:11.985Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01M03WF0TYS012C2C6MKGWJ80W diskcache=60ff888c-eb6d-43bc-a4af-5b9dfc817d41 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-15T23:35:11.058" pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1652gitlab # [ 324.095632] setup-gitlab-start[3388]: To http://gitlab/root/test-flake.git1653gitlab # [ 324.096876] setup-gitlab-start[3388]: * [new branch] master -> master1654gitlab # [ 324.097996] setup-gitlab-start[3388]: branch 'master' set up to track 'origin/master'.1655gitlab # [ 324.099630] gitlab-workhorse[820]: time="2026-08-15T23:35:11Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=521656gitlab # [ 324.101947] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/08/15:23:35:11 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.55.0" 10431657gitlab # [ 324.104416] systemd[1]: Finished setup-gitlab.service.1658gitlab # [ 324.105260] gitaly[914]: time="2026-08-15T23:35:11.986Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=376 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=851968 command.minflt=14069 command.oublock=32 command.real_time_ms=920 command.spawn_token_fork_ms=1 command.system_time_ms=221 command.user_time_ms=155 component=gitaly.StreamServerInterceptor correlation_id=01M03WF0TYS012C2C6MKGWJ80W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=684 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=56 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-15T23:35:11.058" grpc.time_ms=927.602 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1659gitlab # [ 324.120213] systemd[1]: Starting nixbot CI service...1660gitlab: (finished: waiting for unit setup-gitlab.service, in 325.46 seconds)1661gitlab: waiting for unit nixbot.service1662gitlab # [ 325.404706] nixbot[3476]: {"ts": "2026-08-15T23:35:13.315Z", "level": "info", "logger": "nixbot.main", "msg": "nixbot starting", "url": "http://localhost:8010", "state_dir": "/var/lib/nixbot"}1663gitlab # [ 325.442588] nixbot[3476]: {"ts": "2026-08-15T23:35:13.354Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 1, "migration": "initial"}1664gitlab # [ 325.460032] nixbot[3476]: {"ts": "2026-08-15T23:35:13.371Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 2, "migration": "scheduled_effects"}1665gitlab # [ 325.469557] nixbot[3476]: {"ts": "2026-08-15T23:35:13.381Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 3, "migration": "gitea_webhook_secrets"}1666gitlab # [ 325.477564] nixbot[3476]: {"ts": "2026-08-15T23:35:13.389Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 4, "migration": "api_tokens"}1667gitlab # [ 325.490014] nixbot[3476]: {"ts": "2026-08-15T23:35:13.401Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 5, "migration": "status_notify"}1668gitlab # [ 325.497009] nixbot[3476]: {"ts": "2026-08-15T23:35:13.408Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 6, "migration": "webhook_secrets"}1669gitlab # [ 325.500107] nixbot[3476]: {"ts": "2026-08-15T23:35:13.411Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 7, "migration": "build_effects"}1670gitlab # [ 325.511255] nixbot[3476]: {"ts": "2026-08-15T23:35:13.423Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 8, "migration": "api_token_groups"}1671gitlab # [ 325.514739] nixbot[3476]: {"ts": "2026-08-15T23:35:13.426Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 9, "migration": "scheduled_effect_runs"}1672gitlab # [ 325.524044] nixbot[3476]: {"ts": "2026-08-15T23:35:13.435Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 10, "migration": "work_queue"}1673gitlab # [ 325.537240] nixbot[3476]: {"ts": "2026-08-15T23:35:13.449Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 11, "migration": "revoked_sessions"}1674gitlab # [ 325.543970] nixbot[3476]: {"ts": "2026-08-15T23:35:13.455Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 12, "migration": "truncate_notify_names"}1675gitlab # [ 325.548464] nixbot[3476]: {"ts": "2026-08-15T23:35:13.459Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 13, "migration": "failed_builds_per_project"}1676gitlab # [ 325.554708] nixbot[3476]: {"ts": "2026-08-15T23:35:13.466Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 14, "migration": "streamed_eval_warnings"}1677gitlab # [ 325.559413] nixbot[3476]: {"ts": "2026-08-15T23:35:13.470Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 15, "migration": "eval_completed"}1678gitlab # [ 325.564101] nixbot[3476]: {"ts": "2026-08-15T23:35:13.473Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 16, "migration": "reconcile_watermark"}1679gitlab # [ 325.568353] nixbot[3476]: {"ts": "2026-08-15T23:35:13.475Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 17, "migration": "check_runs"}1680gitlab # [ 325.572646] nixbot[3476]: {"ts": "2026-08-15T23:35:13.484Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 18, "migration": "effects_commit"}1681gitlab # [ 325.576482] nixbot[3476]: {"ts": "2026-08-15T23:35:13.487Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 19, "migration": "scheduled_run_notify"}1682gitlab # [ 325.580405] nixbot[3476]: {"ts": "2026-08-15T23:35:13.490Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 20, "migration": "log_metadata"}1683gitlab # [ 325.588208] nixbot[3476]: {"ts": "2026-08-15T23:35:13.500Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 21, "migration": "forge_refresh_tokens"}1684gitlab # [ 325.592174] nixbot[3476]: {"ts": "2026-08-15T23:35:13.503Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 22, "migration": "attr_finished_idx"}1685gitlab # [ 325.596119] nixbot[3476]: {"ts": "2026-08-15T23:35:13.507Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 23, "migration": "effect_deps"}1686gitlab # [ 325.599892] nixbot[3476]: {"ts": "2026-08-15T23:35:13.509Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 24, "migration": "drop_forge_tokens"}1687gitlab # [ 325.952858] nixbot[3476]: INFO: Started server process [3476]1688gitlab # [ 325.955603] nixbot[3476]: INFO: Uvicorn running on socket ('::', 8010, 0, 0) (Press CTRL+C to quit)1689gitlab # [ 325.973130] nixbot[3476]: INFO: ::ffff:127.0.0.1:53628 - "GET /health HTTP/1.1" 200 OK1690gitlab # [ 325.982023] systemd[1]: Started nixbot CI service.1691gitlab # [ 325.984929] systemd[1]: Reached target Multi-User System.1692gitlab # [ 325.987271] systemd[1]: Startup finished in 726ms (kernel) + 4.202s (initrd) + 5min 21.056s (userspace) = 5min 25.985s.1693gitlab: (finished: waiting for unit nixbot.service, in 1.10 seconds)1694gitlab: waiting for success: curl --fail -s http://127.0.0.1:8010/health1695gitlab # [ 326.162192] nixbot[3476]: INFO: ::ffff:127.0.0.1:53630 - "GET /health HTTP/1.1" 200 OK1696gitlab: (finished: waiting for success: curl --fail -s http://127.0.0.1:8010/health, in 0.05 seconds)1697subtest: project discovered and webhook registered1698gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks1699gitlab # [ 326.405420] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/08/15:23:35:14 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4909 "" "python-httpx/0.28.1" 4311700gitlab # [ 326.415478] nixbot[3476]: {"ts": "2026-08-15T23:35:14.317Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects?membership=true&archived=false&per_page=100 \"HTTP/1.1 200 OK\""}1701gitlab # [ 326.428853] nixbot[3476]: {"ts": "2026-08-15T23:35:14.340Z", "level": "info", "logger": "nixbot.repos", "msg": "legacy topic import complete", "topics": {"gitlab": "build-with-buildbot"}, "enabled": 1}1702gitlab # [ 326.480357] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/08/15:23:35:14 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 2 "" "curl/8.21.0" 2671703gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks, in 0.32 seconds)1704gitlab # [ 326.515463] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/08/15:23:35:14 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 771705gitlab # [ 326.522388] nixbot[3476]: {"ts": "2026-08-15T23:35:14.428Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 200 OK\""}1706gitlab # [ 326.529453] nixbot[3476]: {"ts": "2026-08-15T23:35:14.429Z", "level": "info", "logger": "nixbot.hook_registration", "msg": "registering webhook", "repo": "root/test-flake"}1707gitlab # [ 326.927257] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/08/15:23:35:14 +0000] "POST /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 201 919 "" "python-httpx/0.28.1" 4071708gitlab # [ 326.934095] nixbot[3476]: {"ts": "2026-08-15T23:35:14.841Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 201 Created\""}1709gitlab # [ 327.232160] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/08/15:23:35:15 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4909 "" "python-httpx/0.28.1" 2851710gitlab # [ 327.235396] nixbot[3476]: {"ts": "2026-08-15T23:35:15.146Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects?membership=true&archived=false&per_page=100 \"HTTP/1.1 200 OK\""}1711gitlab # [ 327.407306] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/08/15:23:35:15 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 882 "" "python-httpx/0.28.1" 1541712gitlab # [ 327.414125] nixbot[3476]: {"ts": "2026-08-15T23:35:15.319Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 200 OK\""}1713gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks1714gitlab # [ 327.483841] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/08/15:23:35:15 +0000] "PUT /api/v4/projects/root%2Ftest-flake/hooks/1 HTTP/1.1" 200 919 "" "python-httpx/0.28.1" 721715gitlab # [ 327.492352] nixbot[3476]: {"ts": "2026-08-15T23:35:15.396Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: PUT http://gitlab/api/v4/projects/root%2Ftest-flake/hooks/1 \"HTTP/1.1 200 OK\""}1716gitlab # [ 327.564814] gitaly[914]: time="2026-08-15T23:35:15.475Z" level=info msg="finished unary call with code OK" catfile.duration_ms=2 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=2 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=575 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=4 command.system_time_ms=10 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M03WF5691TKTR44HCCZYAJ7K grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindBranch grpc.request.deadline="2026-08-15T23:35:45.154" grpc.request.fullMethod=/gitaly.RefService/FindBranch grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=215 grpc.service=gitaly.RefService grpc.start_time="2026-08-15T23:35:15.456" grpc.time_ms=18.445 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1717gitlab # [ 327.597336] gitaly[914]: time="2026-08-15T23:35:15.499Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M03WF5691TKTR44HCCZYAJ7K grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-15T23:35:45.197" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-15T23:35:15.498" grpc.time_ms=0.722 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1718gitlab # [ 327.616418] gitaly[914]: time="2026-08-15T23:35:15.516Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=582 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=6 command.system_time_ms=2 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M03WF5691TKTR44HCCZYAJ7K grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitIsAncestor grpc.request.deadline="2026-08-15T23:35:25.263" grpc.request.fullMethod=/gitaly.CommitService/CommitIsAncestor grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-08-15T23:35:15.504" grpc.time_ms=12.083 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1719gitlab # [ 327.692381] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/08/15:23:35:15 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 882 "" "curl/8.21.0" 1481720gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks, in 0.22 seconds)1721(finished: subtest: project discovered and webhook registered, in 1.54 seconds)1722subtest: push delivers the webhook1723gitlab: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master1724gitlab # [ 327.801975] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/08/15:23:35:15 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/branches/master HTTP/1.1" 200 732 "" "python-httpx/0.28.1" 3121725gitlab # [ 327.810438] nixbot[3476]: {"ts": "2026-08-15T23:35:15.722Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/repository/branches/master \"HTTP/1.1 200 OK\""}1726gitlab # [ 327.875442] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/08/15:23:35:15 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.55.0" 821727gitlab # [ 327.916318] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/08/15:23:35:15 +0000] "GET /api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 1011728gitlab # [ 327.924224] nixbot[3476]: {"ts": "2026-08-15T23:35:15.828Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 \"HTTP/1.1 200 OK\""}1729gitlab # [ 327.932460] nixbot[3476]: {"ts": "2026-08-15T23:35:15.832Z", "level": "info", "logger": "nixbot.reconcile", "msg": "reconciliation: building unbuilt head", "project": "root/test-flake", "branch": "master", "pr": null}1730gitlab # [ 327.998418] gitaly[914]: time="2026-08-15T23:35:15.910Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=581 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=5 component=gitaly.StreamServerInterceptor correlation_id=01M03WF5JJRB3RWYDVRZ5AQ0N6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=246 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-15T23:35:15.897" grpc.time_ms=12.73 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1731gitlab # Enumerating objects: 5, done.1732gitlab # [ 328.036297] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/08/15:23:35:15 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 202 "" "git/2.55.0" 1161733gitlab # Counting objects: 20% (1/5)Counting objects: 40% (2/5)Counting objects: 60% (3/5)Counting objects: 80% (4/5)Counting objects: 100% (5/5)Counting objects: 100% (5/5), done.1734gitlab # Delta compression using up to 4 threads1735gitlab # Compressing objects: 50% (1/2)Compressing objects: 100% (2/2)Compressing objects: 100% (2/2), done.1736gitlab # Writing objects: 33% (1/3)Writing objects: 66% (2/3)Writing objects: 100% (3/3)Writing objects: 100% (3/3), 273 bytes | 39.00 KiB/s, done.1737gitlab # Total 3 (delta 1), reused 0 (delta 0), pack-reused 0 (from 0)1738gitlab # [ 328.057746] gitaly[914]: time="2026-08-15T23:35:15.969Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=579 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M03WF5N5EWFGPZFX39XYC7G2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=192 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-15T23:35:15.956" grpc.time_ms=12.553 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc1739gitlab # [ 328.087345] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/08/15:23:35:15 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 921740gitlab # [ 328.204975] gitaly[914]: time="2026-08-15T23:35:16.116Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M03WF5RZKTJXD0Y1XZH75P4A grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-15T23:35:16.103" pid=914 remote_ip="2001:db8:1::1" request_sha=cbf4cb85c7b4a4aa26c72509fcce4a61c2433abb response_bytes=113 span.kind=server system=grpc1741gitlab # [ 328.234786] gitaly[914]: time="2026-08-15T23:35:16.117Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=586 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=4 command.system_time_ms=9 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M03WF5RZKTJXD0Y1XZH75P4A grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-15T23:35:16.103" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc1742gitlab # [ 328.261653] gitlab-workhorse[820]: time="2026-08-15T23:35:16Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=1131743gitlab # [ 328.264741] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/08/15:23:35:16 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 113 "" "git/2.55.0" 1181744gitlab # [ 328.267768] gitaly[914]: time="2026-08-15T23:35:16.117Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=586 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=4 command.system_time_ms=9 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M03WF5RZKTJXD0Y1XZH75P4A grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=7 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-15T23:35:16.103" grpc.time_ms=14.027 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc1745gitlab # [ 328.334791] gitaly[914]: time="2026-08-15T23:35:16.246Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M03WF5WZXJH2VFVH2QW9HQ43 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-15T23:35:16.218" pid=914 remote_ip="2001:db8:1::1" request_sha=c7710052b298df5ed672cdca57c5a18483fe5519 response_bytes=223 span.kind=server system=grpc1746gitlab # [ 328.361465] gitaly[914]: time="2026-08-15T23:35:16.246Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=22 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1136 command.oublock=0 command.real_time_ms=24 command.spawn_token_fork_ms=1 command.system_time_ms=17 command.user_time_ms=5 component=gitaly.UnaryServerInterceptor correlation_id=01M03WF5WZXJH2VFVH2QW9HQ43 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-15T23:35:16.218" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc1747gitlab # [ 328.390513] gitlab-workhorse[820]: time="2026-08-15T23:35:16Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2231748gitlab # [ 328.393934] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/08/15:23:35:16 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 223 "" "git/2.55.0" 1211749gitlab # [ 328.397390] gitaly[914]: time="2026-08-15T23:35:16.247Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=22 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1136 command.oublock=0 command.real_time_ms=24 command.spawn_token_fork_ms=1 command.system_time_ms=17 command.user_time_ms=5 component=gitaly.UnaryServerInterceptor correlation_id=01M03WF5WZXJH2VFVH2QW9HQ43 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-15T23:35:16.218" grpc.time_ms=28.465 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc1750gitlab # [ 328.422435] gitaly[914]: time="2026-08-15T23:35:16.265Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=301 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=5 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M03WF5R22ZWTRYS8YY2WF6CG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-08-15T23:35:46.056" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-08-15T23:35:16.257" grpc.time_ms=8.59 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1751gitlab # [ 328.443753] gitaly[914]: time="2026-08-15T23:35:16.295Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01M03WF5R22ZWTRYS8YY2WF6CG duration_ms=186ns method=POST pid=914 status=200 url="http://unix/api/v4/internal/allowed"1752gitlab # [ 328.447965] gitaly[914]: time="2026-08-15T23:35:16.329Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01M03WF5R22ZWTRYS8YY2WF6CG duration_ms=34ns method=POST pid=914 status=200 url="http://unix/api/v4/internal/pre_receive"1753gitlab # [ 328.452663] gitaly[914]: time="2026-08-15T23:35:16.330Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M03WF5R22ZWTRYS8YY2WF6CG grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5314 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-15T23:35:16.108" grpc.time_ms=221.598 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1754gitlab # [ 328.476197] gitaly[914]: time="2026-08-15T23:35:16.388Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M03WF5R22ZWTRYS8YY2WF6CG grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4784 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-15T23:35:16.386" grpc.time_ms=1.522 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1755gitlab # [ 328.521453] gitaly[914]: time="2026-08-15T23:35:16.433Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M03WF5R22ZWTRYS8YY2WF6CG grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4783 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-15T23:35:16.432" grpc.time_ms=0.641 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1756gitlab # [ 328.536646] gitaly[914]: time="2026-08-15T23:35:16.442Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=579 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=2 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M03WF64W20ZW01JAF7KCX5JQ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=186 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-15T23:35:16.431" grpc.time_ms=11.251 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc1757gitlab # [ 328.568359] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/08/15:23:35:16 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 631758gitlab # [ 328.574304] gitaly[914]: time="2026-08-15T23:35:16.485Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M03WF5R22ZWTRYS8YY2WF6CG grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4785 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-15T23:35:16.484" grpc.time_ms=1.177 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1759gitlab # [ 328.601599] gitaly[914]: time="2026-08-15T23:35:16.513Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M03WF66WBJ8501G9D4HMMF2H grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-15T23:35:16.505" pid=914 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc1760gitlab # [ 328.617866] gitaly[914]: time="2026-08-15T23:35:16.520Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=583 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M03WF66WBJ8501G9D4HMMF2H grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-15T23:35:16.505" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc1761gitlab # [ 328.636844] gitlab-workhorse[820]: time="2026-08-15T23:35:16Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671762gitlab # [ 328.639172] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/08/15:23:35:16 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 761763gitlab # [ 328.641625] gitaly[914]: time="2026-08-15T23:35:16.520Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=583 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M03WF66WBJ8501G9D4HMMF2H grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-15T23:35:16.505" grpc.time_ms=15.409 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc1764gitlab # [ 328.661266] gitaly[914]: time="2026-08-15T23:35:16.573Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01M03WF5R22ZWTRYS8YY2WF6CG duration_ms=51ns method=POST pid=914 status=200 url="http://unix/api/v4/internal/post_receive"1765gitlab # [ 328.664460] gitaly[914]: time="2026-08-15T23:35:16.573Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M03WF5R22ZWTRYS8YY2WF6CG grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4808 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-15T23:35:16.519" grpc.time_ms=54.285 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1766gitlab # To http://gitlab/root/test-flake.git1767gitlab # [ 328.676923] gitaly[914]: time="2026-08-15T23:35:16.585Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01M03WF5R22ZWTRYS8YY2WF6CG diskcache=75a8166a-620c-4c51-acf1-33053c75a774 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-15T23:35:16.044" pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1768gitlab # a67995a..9ad1721 [ 328.688661] gitlab-workhorse[820]: time="2026-08-15T23:35:16Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=521769gitlab # master -> master[ 328.690819] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/08/15:23:35:16 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.55.0" 6161770gitlab # 1771gitlab # [ 328.693117] gitaly[914]: time="2026-08-15T23:35:16.585Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=194 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=847872 command.minflt=13584 command.oublock=32 command.real_time_ms=532 command.spawn_token_fork_ms=2 command.system_time_ms=113 command.user_time_ms=81 component=gitaly.StreamServerInterceptor correlation_id=01M03WF5R22ZWTRYS8YY2WF6CG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=605 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=58 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-15T23:35:16.044" grpc.time_ms=541.463 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1772gitlab: (finished: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master, in 1.01 seconds)1773gitlab: must succeed: git -C /tmp/test-flake rev-parse master1774gitlab: (finished: must succeed: git -C /tmp/test-flake rev-parse master, in 0.01 seconds)1775gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a'1776gitlab # [ 328.727147] gitaly[914]: time="2026-08-15T23:35:16.638Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M03WF69AV4N2QGFJ54N93GRD grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-15T23:35:16.623" pid=914 remote_ip="2001:db8:1::1" request_sha=1f0eadcacc2167db7e5eb9639374c299ce339dc0 response_bytes=342 span.kind=server system=grpc1777gitlab # [ 328.738727] gitaly[914]: time="2026-08-15T23:35:16.639Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1131 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=7 component=gitaly.UnaryServerInterceptor correlation_id=01M03WF69AV4N2QGFJ54N93GRD grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-15T23:35:16.623" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=1 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc1778gitlab # [ 328.752892] gitlab-workhorse[820]: time="2026-08-15T23:35:16Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=3421779gitlab # [ 328.754791] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/08/15:23:35:16 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 342 "" "git/2.55.0" 1171780gitlab # [ 328.756858] gitaly[914]: time="2026-08-15T23:35:16.640Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1131 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=7 component=gitaly.UnaryServerInterceptor correlation_id=01M03WF69AV4N2QGFJ54N93GRD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=22 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-15T23:35:16.623" grpc.time_ms=15.84 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=1 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc1781gitlab # [ 328.814525] nixbot[3476]: INFO: ::ffff:127.0.0.1:53638 - "GET /api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a HTTP/1.1" 200 OK1782gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a', in 0.10 seconds)1783gitlab # [ 328.830333] gitaly[914]: time="2026-08-15T23:35:16.742Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=579 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=1 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M03WF6E99B98YQQXZ151JB66 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=192 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-15T23:35:16.732" grpc.time_ms=9.785 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc1784gitlab # [ 328.844490] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/08/15:23:35:16 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 611785gitlab # [ 328.915708] gitaly[914]: time="2026-08-15T23:35:16.827Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M03WF6G9QEW0QCFSY5WTW94F grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-15T23:35:16.799" pid=914 remote_ip="2001:db8:1::1" request_sha=fb62c37b60b550dd367e34acce88d0d3e3444d95 response_bytes=209 span.kind=server system=grpc1786gitlab # [ 328.934692] gitaly[914]: time="2026-08-15T23:35:16.827Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=24 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1104 command.oublock=0 command.real_time_ms=25 command.spawn_token_fork_ms=0 command.system_time_ms=10 command.user_time_ms=14 component=gitaly.UnaryServerInterceptor correlation_id=01M03WF6G9QEW0QCFSY5WTW94F grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-15T23:35:16.799" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc1787gitlab # [ 328.956488] gitlab-workhorse[820]: time="2026-08-15T23:35:16Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2091788gitlab # [ 328.959132] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/08/15:23:35:16 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 209 "" "git/2.55.0" 821789gitlab # [ 328.961744] gitaly[914]: time="2026-08-15T23:35:16.828Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=24 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1104 command.oublock=0 command.real_time_ms=25 command.spawn_token_fork_ms=0 command.system_time_ms=10 command.user_time_ms=14 component=gitaly.UnaryServerInterceptor correlation_id=01M03WF6G9QEW0QCFSY5WTW94F grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-15T23:35:16.799" grpc.time_ms=28.398 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc1790gitlab # [ 329.034741] gitaly[914]: time="2026-08-15T23:35:16.946Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M03WF6MBMNTJ2HBCR9P8JA54 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-15T23:35:46.645" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-15T23:35:16.945" grpc.time_ms=0.825 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1791gitlab # [ 329.092184] gitaly[914]: time="2026-08-15T23:35:17.004Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=590 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=2 command.system_time_ms=9 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M03WF6MBMNTJ2HBCR9P8JA54 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-08-15T23:35:46.689" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-08-15T23:35:16.989" grpc.time_ms=14.327 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1792gitlab # [ 329.130800] gitaly[914]: time="2026-08-15T23:35:17.037Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=5 command.system_time_ms=10 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M03WF6MBMNTJ2HBCR9P8JA54 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-15T23:35:27.002" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-15T23:35:17.022" grpc.time_ms=15.255 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1793gitlab # [ 329.154843] gitaly[914]: time="2026-08-15T23:35:17.061Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M03WF6MBMNTJ2HBCR9P8JA54 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-15T23:35:27.029" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-08-15T23:35:17.050" grpc.time_ms=10.76 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1794gitlab # [ 329.236573] gitaly[914]: time="2026-08-15T23:35:17.148Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M03WF6MBMNTJ2HBCR9P8JA54 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-08-15T23:35:27.126" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-15T23:35:17.147" grpc.time_ms=0.558 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1795gitlab # [ 329.268710] gitaly[914]: time="2026-08-15T23:35:17.172Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=570 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=5 command.system_time_ms=9 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M03WF6MBMNTJ2HBCR9P8JA54 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-08-15T23:35:27.138" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-15T23:35:17.158" grpc.time_ms=13.705 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1796gitlab # [ 329.306638] gitaly[914]: time="2026-08-15T23:35:17.218Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M03WF6MBMNTJ2HBCR9P8JA54 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4152 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-15T23:35:17.217" grpc.time_ms=0.821 pid=914 span.kind=server system=grpc1797gitlab # [ 329.357187] gitaly[914]: time="2026-08-15T23:35:17.269Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M03WF6MBMNTJ2HBCR9P8JA54 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4154 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-15T23:35:17.267" grpc.time_ms=1.056 pid=914 span.kind=server system=grpc1798gitlab # [ 329.385375] gitaly[914]: time="2026-08-15T23:35:17.277Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M03WF6MBMNTJ2HBCR9P8JA54 diskcache=8c10788e-bde7-436a-9c79-4b3101960183 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-15T23:35:27.155" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-15T23:35:17.175" pid=914 ref=refs/keep-around/a67995a4626b5610cec8924c971f7239bbaa2866 remote_ip="2001:db8:1::1" revision=a67995a4626b5610cec8924c971f7239bbaa2866 span.kind=server system=grpc username=root1799gitlab # [ 329.411884] gitaly[914]: time="2026-08-15T23:35:17.277Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=93 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5338 command.oublock=8 command.real_time_ms=94 command.spawn_token_fork_ms=2 command.system_time_ms=46 command.user_time_ms=47 component=gitaly.UnaryServerInterceptor correlation_id=01M03WF6MBMNTJ2HBCR9P8JA54 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-15T23:35:27.155" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-15T23:35:17.175" grpc.time_ms=101.676 pid=914 ref=refs/keep-around/a67995a4626b5610cec8924c971f7239bbaa2866 remote_ip="2001:db8:1::1" revision=a67995a4626b5610cec8924c971f7239bbaa2866 span.kind=server system=grpc username=root1800gitlab # [ 329.436374] gitaly[914]: time="2026-08-15T23:35:17.283Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M03WF6MBMNTJ2HBCR9P8JA54 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-15T23:35:47.082" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-15T23:35:17.282" grpc.time_ms=0.471 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1801gitlab # [ 329.673992] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/08/15:23:35:17 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/a67995a4626b5610cec8924c971f7239bbaa2866 HTTP/1.1" 201 631 "" "python-httpx/0.28.1" 7091802gitlab # [ 329.682078] nixbot[3476]: {"ts": "2026-08-15T23:35:17.590Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/a67995a4626b5610cec8924c971f7239bbaa2866 \"HTTP/1.1 201 Created\""}1803gitlab # [ 329.694229] nixbot[3476]: {"ts": "2026-08-15T23:35:17.606Z", "level": "info", "logger": "nixbot.flake_prefetch", "msg": "prefetching flake inputs", "flake_dir": "/var/lib/nixbot/worktrees/1-a67995a4626b-0"}1804gitlab # [ 329.815091] systemd[1]: Started Nix Daemon.1805gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a'1806gitlab # [ 329.878989] nixbot[3476]: INFO: ::ffff:127.0.0.1:53646 - "GET /api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a HTTP/1.1" 200 OK1807gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a', in 0.07 seconds)1808gitlab # [ 329.924526] nix-daemon[3691]: accepted connection from pid 3685, user nixbot1809gitlab # [ 330.059668] nix-daemon[3691]: accepted connection from pid 3701, user nixbot1810gitlab # [ 330.087558] nixbot[3476]: {"ts": "2026-08-15T23:35:17.999Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-a67995a4626b-0", "argv0": "bwrap"}1811gitlab # [ 330.297204] nix-daemon[3691]: accepted connection from pid 3711, user nixbot1812gitlab # [ 330.411175] nix-daemon[3691]: accepted connection from pid 3721, user nixbot1813gitlab # [ 330.429986] nix-daemon[3691]: accepted connection from pid 3711, user nixbot1814gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a'1815gitlab # [ 330.938312] nixbot[3476]: INFO: ::ffff:127.0.0.1:34468 - "GET /api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a HTTP/1.1" 200 OK1816gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a', in 0.06 seconds)1817gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a'1818gitlab # [ 331.992191] nixbot[3476]: INFO: ::ffff:127.0.0.1:34478 - "GET /api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a HTTP/1.1" 200 OK1819gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a', in 0.05 seconds)1820gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a'1821gitlab # [ 333.046263] nixbot[3476]: INFO: ::ffff:127.0.0.1:34490 - "GET /api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a HTTP/1.1" 200 OK1822gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a', in 0.05 seconds)1823gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a'1824gitlab # [ 334.102163] nixbot[3476]: INFO: ::ffff:127.0.0.1:34502 - "GET /api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a HTTP/1.1" 200 OK1825gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a', in 0.06 seconds)1826gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a'1827gitlab # [ 335.164145] nixbot[3476]: INFO: ::ffff:127.0.0.1:34518 - "GET /api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a HTTP/1.1" 200 OK1828gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a', in 0.06 seconds)1829gitlab # [ 335.305364] gitaly[914]: time="2026-08-15T23:35:23.216Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M03WFCQ1NRGTAARZMJHC1FD6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-15T23:35:53.013" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-15T23:35:23.214" grpc.time_ms=1.345 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1830gitlab # [ 335.427836] gitaly[914]: time="2026-08-15T23:35:23.339Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M03WFCQ1NRGTAARZMJHC1FD6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-15T23:35:33.000" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-15T23:35:23.321" grpc.time_ms=18.055 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1831gitlab # [ 335.531775] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/08/15:23:35:23 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/a67995a4626b5610cec8924c971f7239bbaa2866 HTTP/1.1" 201 669 "" "python-httpx/0.28.1" 3361832gitlab # [ 335.539995] nixbot[3476]: {"ts": "2026-08-15T23:35:23.444Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/a67995a4626b5610cec8924c971f7239bbaa2866 \"HTTP/1.1 201 Created\""}1833gitlab # [ 335.622331] gitaly[914]: time="2026-08-15T23:35:23.534Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M03WFD1XS0AN2TZ4NE6R9VCR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-15T23:35:53.332" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-15T23:35:23.532" grpc.time_ms=1.027 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1834gitlab # [ 335.677111] gitaly[914]: time="2026-08-15T23:35:23.589Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M03WFD1XS0AN2TZ4NE6R9VCR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-15T23:35:33.253" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-15T23:35:23.574" grpc.time_ms=14.629 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1835gitlab # [ 335.745767] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/08/15:23:35:23 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/a67995a4626b5610cec8924c971f7239bbaa2866 HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 2031836gitlab # [ 335.754012] nixbot[3476]: {"ts": "2026-08-15T23:35:23.661Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/a67995a4626b5610cec8924c971f7239bbaa2866 \"HTTP/1.1 201 Created\""}1837gitlab # [ 335.833508] gitaly[914]: time="2026-08-15T23:35:23.745Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M03WFD8ZGWHM1R5X6VVD1KGW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-15T23:35:53.543" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-15T23:35:23.743" grpc.time_ms=1.301 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1838gitlab # [ 335.906390] gitaly[914]: time="2026-08-15T23:35:23.818Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=2 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M03WFD8ZGWHM1R5X6VVD1KGW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-15T23:35:33.005" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-15T23:35:23.805" grpc.time_ms=12.36 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1839gitlab # [ 335.998178] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/08/15:23:35:23 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/a67995a4626b5610cec8924c971f7239bbaa2866 HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 2291840gitlab # [ 336.006555] nixbot[3476]: {"ts": "2026-08-15T23:35:23.911Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/a67995a4626b5610cec8924c971f7239bbaa2866 \"HTTP/1.1 201 Created\""}1841gitlab # [ 336.163793] nix-daemon[3691]: accepted connection from pid 3761, user nixbot1842gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a'1843gitlab # [ 336.240941] nixbot[3476]: INFO: ::ffff:127.0.0.1:34520 - "GET /api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a HTTP/1.1" 200 OK1844gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a', in 0.08 seconds)1845gitlab # [ 336.362908] gitaly[914]: time="2026-08-15T23:35:24.273Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=578 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=1 command.system_time_ms=7 command.user_time_ms=6 component=gitaly.StreamServerInterceptor correlation_id=01M03WFDR4TP99F6KF7BFDZCF0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-15T23:35:24.255" grpc.time_ms=17.659 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc1846gitlab # [ 336.402525] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/08/15:23:35:24 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 1091847gitlab # [ 336.529630] gitaly[914]: time="2026-08-15T23:35:24.441Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M03WFDWSM833W5X37MMCCPE0 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-15T23:35:24.422" pid=914 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc1848gitlab # [ 336.560108] gitaly[914]: time="2026-08-15T23:35:24.441Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M03WFDWSM833W5X37MMCCPE0 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-15T23:35:24.422" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc1849gitlab # [ 336.594967] gitlab-workhorse[820]: time="2026-08-15T23:35:24Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671850gitlab # [ 336.599017] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/08/15:23:35:24 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 1281851gitlab # [ 336.602844] gitaly[914]: time="2026-08-15T23:35:24.442Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M03WFDWSM833W5X37MMCCPE0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-15T23:35:24.422" grpc.time_ms=19.765 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc1852gitlab # [ 336.691397] nix-daemon[3691]: accepted connection from pid 3789, user nixbot1853gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a'1854gitlab # [ 337.298954] nixbot[3476]: INFO: ::ffff:127.0.0.1:34536 - "GET /api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a HTTP/1.1" 200 OK1855gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a', in 0.06 seconds)1856gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a'1857gitlab # [ 338.352995] nixbot[3476]: INFO: ::ffff:127.0.0.1:34548 - "GET /api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a HTTP/1.1" 200 OK1858gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a', in 0.05 seconds)1859gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a'1860gitlab # [ 339.407664] nixbot[3476]: INFO: ::ffff:127.0.0.1:34562 - "GET /api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a HTTP/1.1" 200 OK1861gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a', in 0.05 seconds)1862gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a'1863gitlab # [ 340.462815] nixbot[3476]: INFO: ::ffff:127.0.0.1:34574 - "GET /api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a HTTP/1.1" 200 OK1864gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a', in 0.06 seconds)1865gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a'1866gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a', in 0.05 seconds)1867gitlab # [ 341.518468] nixbot[3476]: INFO: ::ffff:127.0.0.1:50256 - "GET /api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a HTTP/1.1" 200 OK1868gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a'1869gitlab # [ 342.570425] nixbot[3476]: INFO: ::ffff:127.0.0.1:50258 - "GET /api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a HTTP/1.1" 200 OK1870gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a', in 0.05 seconds)1871gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a'1872gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a', in 0.05 seconds)1873gitlab # [ 343.625184] nixbot[3476]: INFO: ::ffff:127.0.0.1:50262 - "GET /api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a HTTP/1.1" 200 OK1874gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a'1875gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a', in 0.05 seconds)1876gitlab # [ 344.678218] nixbot[3476]: INFO: ::ffff:127.0.0.1:50268 - "GET /api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a HTTP/1.1" 200 OK1877gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a'1878gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a', in 0.05 seconds)1879gitlab # [ 345.731305] nixbot[3476]: INFO: ::ffff:127.0.0.1:50278 - "GET /api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a HTTP/1.1" 200 OK1880gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a'1881gitlab # [ 346.784390] nixbot[3476]: INFO: ::ffff:127.0.0.1:50288 - "GET /api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a HTTP/1.1" 200 OK1882gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a', in 0.05 seconds)1883gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a'1884gitlab # [ 347.838459] nixbot[3476]: INFO: ::ffff:127.0.0.1:50294 - "GET /api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a HTTP/1.1" 200 OK1885gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a', in 0.05 seconds)1886gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a'1887gitlab # [ 348.892687] nixbot[3476]: INFO: ::ffff:127.0.0.1:50300 - "GET /api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a HTTP/1.1" 200 OK1888gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a', in 0.05 seconds)1889gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a'1890gitlab # [ 349.947567] nixbot[3476]: INFO: ::ffff:127.0.0.1:50312 - "GET /api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a HTTP/1.1" 200 OK1891gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a', in 0.06 seconds)1892gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a'1893gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a', in 0.05 seconds)1894gitlab # [ 351.002762] nixbot[3476]: INFO: ::ffff:127.0.0.1:37258 - "GET /api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a HTTP/1.1" 200 OK1895gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a'1896gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a', in 0.05 seconds)1897gitlab # [ 352.054086] nixbot[3476]: INFO: ::ffff:127.0.0.1:37268 - "GET /api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a HTTP/1.1" 200 OK1898gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a'1899gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a', in 0.05 seconds)1900gitlab # [ 353.105833] nixbot[3476]: INFO: ::ffff:127.0.0.1:37270 - "GET /api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a HTTP/1.1" 200 OK1901gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a'1902gitlab # [ 354.157744] nixbot[3476]: INFO: ::ffff:127.0.0.1:37282 - "GET /api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a HTTP/1.1" 200 OK1903gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a', in 0.05 seconds)1904gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a'1905gitlab # [ 355.211575] nixbot[3476]: INFO: ::ffff:127.0.0.1:37284 - "GET /api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a HTTP/1.1" 200 OK1906gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a', in 0.05 seconds)1907gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a'1908gitlab # [ 356.265326] nixbot[3476]: INFO: ::ffff:127.0.0.1:37300 - "GET /api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a HTTP/1.1" 200 OK1909gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a', in 0.05 seconds)1910gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a'1911gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a', in 0.05 seconds)1912gitlab # [ 357.319554] nixbot[3476]: INFO: ::ffff:127.0.0.1:37308 - "GET /api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a HTTP/1.1" 200 OK1913gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a'1914gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a', in 0.05 seconds)1915gitlab # [ 358.372349] nixbot[3476]: INFO: ::ffff:127.0.0.1:37324 - "GET /api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a HTTP/1.1" 200 OK1916gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a'1917gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a', in 0.05 seconds)1918gitlab # [ 359.425232] nixbot[3476]: INFO: ::ffff:127.0.0.1:37338 - "GET /api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a HTTP/1.1" 200 OK1919gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a'1920gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a', in 0.05 seconds)1921gitlab # [ 360.477428] nixbot[3476]: INFO: ::ffff:127.0.0.1:37348 - "GET /api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a HTTP/1.1" 200 OK1922gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a'1923gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a', in 0.05 seconds)1924gitlab # [ 361.529036] nixbot[3476]: INFO: ::ffff:127.0.0.1:54644 - "GET /api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a HTTP/1.1" 200 OK1925gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a'1926gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a', in 0.05 seconds)1927gitlab # [ 362.580945] nixbot[3476]: INFO: ::ffff:127.0.0.1:54658 - "GET /api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a HTTP/1.1" 200 OK1928gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a'1929gitlab # [ 363.630626] nixbot[3476]: INFO: ::ffff:127.0.0.1:54660 - "GET /api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a HTTP/1.1" 200 OK1930gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a', in 0.05 seconds)1931gitlab # [ 364.615308] sidekiq-cluster[3466]: 2026-08-15T23:35:52.526Z pid=3466 tid=yle INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>3466, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>428982272}1932gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a'1933gitlab # [ 364.684443] nixbot[3476]: INFO: ::ffff:127.0.0.1:54666 - "GET /api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a HTTP/1.1" 200 OK1934gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a', in 0.05 seconds)1935gitlab # [ 364.911632] sidekiq-cluster[3466]: W, [2026-08-15T23:35:52.823470 #3466] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1936gitlab # [ 364.976243] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-15T23:35:52.888Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"}1937gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a'1938gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a', in 0.05 seconds)1939gitlab # [ 365.739576] nixbot[3476]: INFO: ::ffff:127.0.0.1:54682 - "GET /api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a HTTP/1.1" 200 OK1940gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a'1941gitlab # [ 366.792253] nixbot[3476]: INFO: ::ffff:127.0.0.1:54690 - "GET /api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a HTTP/1.1" 200 OK1942gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a', in 0.05 seconds)1943gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a'1944gitlab # [ 367.847914] nixbot[3476]: INFO: ::ffff:127.0.0.1:54702 - "GET /api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a HTTP/1.1" 200 OK1945gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a', in 0.06 seconds)1946gitlab # [ 368.492322] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-15T23:35:56.403Z","message":"GitLab reliable fetch activated!"}1947gitlab # [ 368.497368] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-15T23:35:56.403Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1948gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a'1949gitlab # [ 368.902363] nixbot[3476]: INFO: ::ffff:127.0.0.1:54718 - "GET /api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a HTTP/1.1" 200 OK1950gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a', in 0.05 seconds)1951gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a'1952gitlab # [ 369.956910] nixbot[3476]: INFO: ::ffff:127.0.0.1:54722 - "GET /api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a HTTP/1.1" 200 OK1953gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a', in 0.05 seconds)1954gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a'1955gitlab # [ 371.011781] nixbot[3476]: INFO: ::ffff:127.0.0.1:48220 - "GET /api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a HTTP/1.1" 200 OK1956gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a', in 0.05 seconds)1957gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a'1958gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a', in 0.05 seconds)1959gitlab # [ 372.066472] nixbot[3476]: INFO: ::ffff:127.0.0.1:48234 - "GET /api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a HTTP/1.1" 200 OK1960gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a'1961gitlab # [ 373.118781] nixbot[3476]: INFO: ::ffff:127.0.0.1:48246 - "GET /api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a HTTP/1.1" 200 OK1962gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a', in 0.06 seconds)1963gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a'1964gitlab # [ 374.175025] nixbot[3476]: INFO: ::ffff:127.0.0.1:48250 - "GET /api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a HTTP/1.1" 200 OK1965gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a', in 0.06 seconds)1966gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a'1967gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a', in 0.05 seconds)1968gitlab # [ 375.230871] nixbot[3476]: INFO: ::ffff:127.0.0.1:48258 - "GET /api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a HTTP/1.1" 200 OK1969gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a'1970gitlab # [ 376.283962] nixbot[3476]: INFO: ::ffff:127.0.0.1:48272 - "GET /api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a HTTP/1.1" 200 OK1971gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a', in 0.06 seconds)1972gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a'1973gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a', in 0.05 seconds)1974gitlab # [ 377.340248] nixbot[3476]: INFO: ::ffff:127.0.0.1:48274 - "GET /api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a HTTP/1.1" 200 OK1975gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a'1976gitlab # [ 378.392199] nixbot[3476]: INFO: ::ffff:127.0.0.1:48284 - "GET /api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a HTTP/1.1" 200 OK1977gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a', in 0.06 seconds)1978gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a'1979gitlab # [ 379.446828] nixbot[3476]: INFO: ::ffff:127.0.0.1:48294 - "GET /api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a HTTP/1.1" 200 OK1980gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a', in 0.05 seconds)1981gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a'1982gitlab # [ 380.501351] nixbot[3476]: INFO: ::ffff:127.0.0.1:48298 - "GET /api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a HTTP/1.1" 200 OK1983gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a', in 0.05 seconds)1984gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a'1985gitlab # [ 381.556985] nixbot[3476]: INFO: ::ffff:127.0.0.1:52596 - "GET /api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a HTTP/1.1" 200 OK1986gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a', in 0.06 seconds)1987gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a'1988gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a', in 0.05 seconds)1989gitlab # [ 382.611171] nixbot[3476]: INFO: ::ffff:127.0.0.1:52612 - "GET /api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a HTTP/1.1" 200 OK1990gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a'1991gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a', in 0.05 seconds)1992gitlab # [ 383.662800] nixbot[3476]: INFO: ::ffff:127.0.0.1:52620 - "GET /api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a HTTP/1.1" 200 OK1993gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a'1994gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a', in 0.05 seconds)1995gitlab # [ 384.714530] nixbot[3476]: INFO: ::ffff:127.0.0.1:52626 - "GET /api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a HTTP/1.1" 200 OK1996gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a'1997gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a', in 0.05 seconds)1998gitlab # [ 385.767107] nixbot[3476]: INFO: ::ffff:127.0.0.1:52636 - "GET /api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a HTTP/1.1" 200 OK1999gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a'2000gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a', in 0.05 seconds)2001gitlab # [ 386.818784] nixbot[3476]: INFO: ::ffff:127.0.0.1:52644 - "GET /api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a HTTP/1.1" 200 OK2002gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a'2003gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a', in 0.05 seconds)2004gitlab # [ 387.871140] nixbot[3476]: INFO: ::ffff:127.0.0.1:52656 - "GET /api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a HTTP/1.1" 200 OK2005gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a'2006gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a', in 0.05 seconds)2007gitlab # [ 388.922851] nixbot[3476]: INFO: ::ffff:127.0.0.1:52658 - "GET /api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a HTTP/1.1" 200 OK2008gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a'2009gitlab # [ 389.975821] nixbot[3476]: INFO: ::ffff:127.0.0.1:52664 - "GET /api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a HTTP/1.1" 200 OK2010gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a', in 0.06 seconds)2011gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a'2012gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a', in 0.05 seconds)2013gitlab # [ 391.030789] nixbot[3476]: INFO: ::ffff:127.0.0.1:47714 - "GET /api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a HTTP/1.1" 200 OK2014gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a'2015gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a', in 0.05 seconds)2016gitlab # [ 392.083804] nixbot[3476]: INFO: ::ffff:127.0.0.1:47730 - "GET /api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a HTTP/1.1" 200 OK2017gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a'2018gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a', in 0.05 seconds)2019gitlab # [ 393.136868] nixbot[3476]: INFO: ::ffff:127.0.0.1:47732 - "GET /api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a HTTP/1.1" 200 OK2020gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a'2021gitlab # [ 394.189503] nixbot[3476]: INFO: ::ffff:127.0.0.1:47748 - "GET /api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a HTTP/1.1" 200 OK2022gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a', in 0.05 seconds)2023gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a'2024gitlab # [ 395.244398] nixbot[3476]: INFO: ::ffff:127.0.0.1:47754 - "GET /api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a HTTP/1.1" 200 OK2025gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a', in 0.05 seconds)2026gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a'2027gitlab # [ 396.298595] nixbot[3476]: INFO: ::ffff:127.0.0.1:47758 - "GET /api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a HTTP/1.1" 200 OK2028gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a', in 0.06 seconds)2029gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a'2030gitlab # [ 397.360611] nixbot[3476]: INFO: ::ffff:127.0.0.1:47760 - "GET /api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a HTTP/1.1" 200 OK2031gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a', in 0.06 seconds)2032gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a'2033gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a', in 0.05 seconds)2034gitlab # [ 398.416925] nixbot[3476]: INFO: ::ffff:127.0.0.1:47766 - "GET /api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a HTTP/1.1" 200 OK2035gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a'2036gitlab # [ 399.468986] nixbot[3476]: INFO: ::ffff:127.0.0.1:47768 - "GET /api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a HTTP/1.1" 200 OK2037gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a', in 0.05 seconds)2038gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a'2039gitlab # [ 400.522547] nixbot[3476]: INFO: ::ffff:127.0.0.1:47772 - "GET /api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a HTTP/1.1" 200 OK2040gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a', in 0.05 seconds)2041gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a'2042gitlab # [ 401.578659] nixbot[3476]: INFO: ::ffff:127.0.0.1:43850 - "GET /api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a HTTP/1.1" 200 OK2043gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a', in 0.05 seconds)2044gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a'2045gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a', in 0.05 seconds)2046gitlab # [ 402.633216] nixbot[3476]: INFO: ::ffff:127.0.0.1:43856 - "GET /api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a HTTP/1.1" 200 OK2047gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a'2048gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a', in 0.05 seconds)2049gitlab # [ 403.684974] nixbot[3476]: INFO: ::ffff:127.0.0.1:43864 - "GET /api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a HTTP/1.1" 200 OK2050gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a'2051gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a', in 0.05 seconds)2052gitlab # [ 404.736643] nixbot[3476]: INFO: ::ffff:127.0.0.1:43872 - "GET /api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a HTTP/1.1" 200 OK2053gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a'2054gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a', in 0.05 seconds)2055gitlab # [ 405.790409] nixbot[3476]: INFO: ::ffff:127.0.0.1:43882 - "GET /api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a HTTP/1.1" 200 OK2056gitlab # [ 406.319921] postgres[4011]: [4011] ERROR: relation "table_without_models" does not exist2057gitlab # [ 406.323738] postgres[4011]: [4011] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')2058gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a'2059gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a', in 0.05 seconds)2060gitlab # [ 406.844079] nixbot[3476]: INFO: ::ffff:127.0.0.1:43896 - "GET /api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a HTTP/1.1" 200 OK2061gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a'2062gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a', in 0.05 seconds)2063gitlab # [ 407.895586] nixbot[3476]: INFO: ::ffff:127.0.0.1:43902 - "GET /api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a HTTP/1.1" 200 OK2064gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a'2065gitlab # [ 408.946512] nixbot[3476]: INFO: ::ffff:127.0.0.1:43916 - "GET /api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a HTTP/1.1" 200 OK2066gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a', in 0.05 seconds)2067gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a'2068gitlab # [ 410.000932] nixbot[3476]: INFO: ::ffff:127.0.0.1:43918 - "GET /api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a HTTP/1.1" 200 OK2069gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a', in 0.05 seconds)2070gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a'2071gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a', in 0.05 seconds)2072gitlab # [ 411.055693] nixbot[3476]: INFO: ::ffff:127.0.0.1:35484 - "GET /api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a HTTP/1.1" 200 OK2073gitlab # [ 411.272441] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-15T23:36:39.183Z","message":"Booted Rails 7.2.3.1 application in production environment"}2074gitlab # [ 411.279927] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-15T23:36:39.191Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [aarch64-linux]"}2075gitlab # [ 411.286474] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-15T23:36:39.191Z","message":"See LICENSE and the LGPL-3.0 for licensing details."}2076gitlab # [ 411.291951] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-15T23:36:39.196Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"}2077gitlab # [ 411.297949] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-15T23:36:39.200Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}2078gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a'2079gitlab # [ 412.109438] nixbot[3476]: INFO: ::ffff:127.0.0.1:35496 - "GET /api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a HTTP/1.1" 200 OK2080gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a', in 0.06 seconds)2081gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a'2082gitlab # [ 413.163774] nixbot[3476]: INFO: ::ffff:127.0.0.1:35500 - "GET /api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a HTTP/1.1" 200 OK2083gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a', in 0.05 seconds)2084gitlab # [ 413.961518] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-15T23:36:41.871Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"c691cc08d0742a095d8687ca","created_at":"2026-08-15T23:35:08.364Z","trace_propagation_headers":{"sentry-trace":"3c012158a44744408055215f07a3eb9b-07f55ab26c7d4b8a","baggage":"sentry-trace_id=3c012158a44744408055215f07a3eb9b,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M03WEWV4NCSXMM8QK0CC2KSY","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-08-15T23:35:08.412Z","job_size_bytes":2,"pid":3466,"sidekiq_tid":"m8s6","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-c691cc08d0742a095d8687ca: start","job_status":"start","queue_duration_s":93.458695,"scheduling_latency_s":93.458798}2085gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a'2086gitlab # [ 414.216669] nixbot[3476]: INFO: ::ffff:127.0.0.1:35510 - "GET /api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a HTTP/1.1" 200 OK2087gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a', in 0.05 seconds)2088gitlab # [ 414.326708] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-15T23:36:42.237Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"c691cc08d0742a095d8687ca","created_at":"2026-08-15T23:35:08.364Z","trace_propagation_headers":{"sentry-trace":"3c012158a44744408055215f07a3eb9b-07f55ab26c7d4b8a","baggage":"sentry-trace_id=3c012158a44744408055215f07a3eb9b,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M03WEWV4NCSXMM8QK0CC2KSY","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-08-15T23:35:08.412Z","job_size_bytes":2,"pid":3466,"sidekiq_tid":"m8s6","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-c691cc08d0742a095d8687ca: done: 0.366346 sec","job_status":"done","queue_duration_s":93.458695,"scheduling_latency_s":93.458798,"redis_calls":23,"redis_duration_s":0.011535,"redis_read_bytes":910,"redis_write_bytes":2540,"redis_feature_flag_calls":13,"redis_feature_flag_duration_s":0.006246,"redis_feature_flag_read_bytes":902,"redis_feature_flag_write_bytes":1375,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003007,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":606,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002282,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":559,"db_count":10,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":10,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.023,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":9,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.019,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.211111,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.2080589,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.366346,"completed_at":"2026-08-15T23:36:42.237Z","load_balancing_strategy":"primary","db_duration_s":0.109634,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2089gitlab # [ 414.425806] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-15T23:36:42.240Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"ad2062033a605627c9239084","created_at":"2026-08-15T23:35:08.427Z","trace_propagation_headers":{"sentry-trace":"3c012158a44744408055215f07a3eb9b-07f55ab26c7d4b8a","baggage":"sentry-trace_id=3c012158a44744408055215f07a3eb9b,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M03WEWV4NCSXMM8QK0CC2KSY","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-08-15T23:35:08.434Z","job_size_bytes":2,"pid":3466,"sidekiq_tid":"m8s6","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-ad2062033a605627c9239084: start","job_status":"start","queue_duration_s":93.806452,"scheduling_latency_s":93.806492}2090gitlab # [ 414.515251] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-15T23:36:42.426Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"ad2062033a605627c9239084","created_at":"2026-08-15T23:35:08.427Z","trace_propagation_headers":{"sentry-trace":"3c012158a44744408055215f07a3eb9b-07f55ab26c7d4b8a","baggage":"sentry-trace_id=3c012158a44744408055215f07a3eb9b,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M03WEWV4NCSXMM8QK0CC2KSY","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-08-15T23:35:08.434Z","job_size_bytes":2,"pid":3466,"sidekiq_tid":"m8s6","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-ad2062033a605627c9239084: done: 0.185697 sec","job_status":"done","queue_duration_s":93.806452,"scheduling_latency_s":93.806492,"redis_calls":14,"redis_duration_s":0.005116,"redis_read_bytes":140,"redis_write_bytes":1653,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.001185,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":422,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.00232,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":680,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001611,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":551,"db_count":8,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.018,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.014,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.139016,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.1430533,"extra.projects_process_sync_events_worker.estimated_total_events":1,"extra.projects_process_sync_events_worker.consumable_events":1,"extra.projects_process_sync_events_worker.processed_events":1,"duration_s":0.185697,"completed_at":"2026-08-15T23:36:42.426Z","load_balancing_strategy":"primary","db_duration_s":0.036108,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2091gitlab # [ 414.586538] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-15T23:36:42.428Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"a4cbf1245c82ba4c7c619186","created_at":"2026-08-15T23:35:09.374Z","trace_propagation_headers":{"sentry-trace":"3c012158a44744408055215f07a3eb9b-07f55ab26c7d4b8a","baggage":"sentry-trace_id=3c012158a44744408055215f07a3eb9b,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M03WEWV4NCSXMM8QK0CC2KSY","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-08-15T23:35:09.384Z","job_size_bytes":5,"pid":3466,"sidekiq_tid":"m8s6","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-a4cbf1245c82ba4c7c619186: start","job_status":"start","queue_duration_s":93.044214,"scheduling_latency_s":93.044239}2092gitlab # [ 414.740301] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-15T23:36:42.651Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"a4cbf1245c82ba4c7c619186","created_at":"2026-08-15T23:35:09.374Z","trace_propagation_headers":{"sentry-trace":"3c012158a44744408055215f07a3eb9b-07f55ab26c7d4b8a","baggage":"sentry-trace_id=3c012158a44744408055215f07a3eb9b,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M03WEWV4NCSXMM8QK0CC2KSY","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-08-15T23:35:09.384Z","job_size_bytes":5,"pid":3466,"sidekiq_tid":"m8s6","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-a4cbf1245c82ba4c7c619186: done: 0.223079 sec","job_status":"done","queue_duration_s":93.044214,"scheduling_latency_s":93.044239,"redis_calls":12,"redis_duration_s":0.003384,"redis_read_bytes":138,"redis_write_bytes":1541,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000913,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":491,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001936,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":784,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000535,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":14,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":14,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.023,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.023,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.174142,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00034838,"duration_s":0.223079,"completed_at":"2026-08-15T23:36:42.651Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.041435,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2093gitlab # [ 414.849393] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-15T23:36:42.653Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"14ee6a8694d3983b1bc83ee6","created_at":"2026-08-15T23:35:09.428Z","trace_propagation_headers":{"sentry-trace":"3c012158a44744408055215f07a3eb9b-07f55ab26c7d4b8a","baggage":"sentry-trace_id=3c012158a44744408055215f07a3eb9b,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M03WEWV4NCSXMM8QK0CC2KSY","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-08-15T23:35:09.436Z","job_size_bytes":3,"pid":3466,"sidekiq_tid":"m8s6","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-14ee6a8694d3983b1bc83ee6: start","job_status":"start","queue_duration_s":93.217369,"scheduling_latency_s":93.217392}2094gitlab # [ 415.016723] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-15T23:36:42.926Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"14ee6a8694d3983b1bc83ee6","created_at":"2026-08-15T23:35:09.428Z","trace_propagation_headers":{"sentry-trace":"3c012158a44744408055215f07a3eb9b-07f55ab26c7d4b8a","baggage":"sentry-trace_id=3c012158a44744408055215f07a3eb9b,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M03WEWV4NCSXMM8QK0CC2KSY","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-08-15T23:35:09.436Z","job_size_bytes":3,"pid":3466,"sidekiq_tid":"m8s6","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-14ee6a8694d3983b1bc83ee6: done: 0.273127 sec","job_status":"done","queue_duration_s":93.217369,"scheduling_latency_s":93.217392,"redis_calls":11,"redis_duration_s":0.003446,"redis_read_bytes":137,"redis_write_bytes":1147,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000818,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":407,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002032,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":538,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000596,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":202,"db_count":35,"db_write_count":6,"db_cached_count":2,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":35,"db_replica_write_count":0,"db_primary_write_count":6,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.04,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":34,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":6,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":2,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.231,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.231,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.039,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.171555,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00072372,"duration_s":0.273127,"completed_at":"2026-08-15T23:36:42.926Z","load_balancing_strategy":"primary","db_duration_s":0.105235,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2095gitlab # [ 415.112147] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-15T23:36:42.929Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"fd2af455672b09742b6770f8","created_at":"2026-08-15T23:35:09.440Z","trace_propagation_headers":{"sentry-trace":"3c012158a44744408055215f07a3eb9b-07f55ab26c7d4b8a","baggage":"sentry-trace_id=3c012158a44744408055215f07a3eb9b,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M03WEWV4NCSXMM8QK0CC2KSY","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-08-15T23:35:09.447Z","job_size_bytes":89,"pid":3466,"sidekiq_tid":"m8s6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-fd2af455672b09742b6770f8: start","job_status":"start","queue_duration_s":93.482084,"scheduling_latency_s":93.48211}2096gitlab # [ 415.133257] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-15T23:36:42.976Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"fd2af455672b09742b6770f8","created_at":"2026-08-15T23:35:09.440Z","trace_propagation_headers":{"sentry-trace":"3c012158a44744408055215f07a3eb9b-07f55ab26c7d4b8a","baggage":"sentry-trace_id=3c012158a44744408055215f07a3eb9b,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M03WEWV4NCSXMM8QK0CC2KSY","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-08-15T23:35:09.447Z","job_size_bytes":89,"pid":3466,"sidekiq_tid":"m8s6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-fd2af455672b09742b6770f8: done: 0.047185 sec","job_status":"done","queue_duration_s":93.482084,"scheduling_latency_s":93.48211,"redis_calls":11,"redis_duration_s":0.0028910000000000003,"redis_read_bytes":137,"redis_write_bytes":1267,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000805,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":443,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001572,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":594,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000514,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":230,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.030292,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00036138,"duration_s":0.047185,"completed_at":"2026-08-15T23:36:42.976Z","load_balancing_strategy":"primary","db_duration_s":0.008303,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2097gitlab # [ 415.179727] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-15T23:36:42.978Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 a67995a4626b5610cec8924c971f7239bbaa2866 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"631c4109395cc66c81bb020e","created_at":"2026-08-15T23:35:11.857Z","trace_propagation_headers":{"sentry-trace":"e642f789365f4b808c24da962532a593-b647bda1de0a403e","baggage":"sentry-trace_id=e642f789365f4b808c24da962532a593,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M03WF0TYS012C2C6MKGWJ80W","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:35:11.866Z","job_size_bytes":185,"pid":3466,"sidekiq_tid":"m8s6","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-631c4109395cc66c81bb020e: start","job_status":"start","queue_duration_s":91.112114,"scheduling_latency_s":91.112136}2098gitlab # [ 415.196978] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-15T23:36:42.998Z","message":"changes: \"0000000000000000000000000000000000000000 a67995a4626b5610cec8924c971f7239bbaa2866 refs/heads/master\\n\""}2099gitlab # [ 415.199685] gitaly[914]: time="2026-08-15T23:36:43.047Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=3 command.system_time_ms=12 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M03WF0TYS012C2C6MKGWJ80W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-15T23:36:53.010" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-08-15T23:36:43.030" grpc.time_ms=16.394 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2100gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a'2101gitlab # [ 415.214041] gitaly[914]: time="2026-08-15T23:36:43.066Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=2 command.system_time_ms=6 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M03WF0TYS012C2C6MKGWJ80W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-15T23:36:53.033" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-15T23:36:43.053" grpc.time_ms=12.286 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2102gitlab # [ 415.227549] gitaly[914]: time="2026-08-15T23:36:43.138Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=583 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M03WF0TYS012C2C6MKGWJ80W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-08-15T23:36:53.098" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=266 grpc.service=gitaly.RefService grpc.start_time="2026-08-15T23:36:43.119" grpc.time_ms=19.543 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2103gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a', in 0.06 seconds)2104gitlab # [ 415.273263] gitaly[914]: time="2026-08-15T23:36:43.185Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M03WF0TYS012C2C6MKGWJ80W grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3935 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-15T23:36:43.184" grpc.time_ms=0.445 pid=914 span.kind=server system=grpc2105gitlab # [ 415.303000] nixbot[3476]: INFO: ::ffff:127.0.0.1:35522 - "GET /api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a HTTP/1.1" 200 OK2106gitlab # [ 415.308742] gitaly[914]: time="2026-08-15T23:36:43.220Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M03WF0TYS012C2C6MKGWJ80W grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3937 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-15T23:36:43.218" grpc.time_ms=1.826 pid=914 span.kind=server system=grpc2107gitlab # [ 415.331967] gitaly[914]: time="2026-08-15T23:36:43.229Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M03WF0TYS012C2C6MKGWJ80W diskcache=270e12d7-cc18-42f9-9817-4a29b477963c grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-15T23:36:53.130" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-15T23:36:43.151" pid=914 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root2108gitlab # [ 415.351864] gitaly[914]: time="2026-08-15T23:36:43.229Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=74 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=4835 command.oublock=8 command.real_time_ms=71 command.spawn_token_fork_ms=0 command.system_time_ms=39 command.user_time_ms=35 component=gitaly.UnaryServerInterceptor correlation_id=01M03WF0TYS012C2C6MKGWJ80W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-15T23:36:53.130" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=148 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-15T23:36:43.151" grpc.time_ms=78.037 pid=914 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root2109gitlab # [ 415.372635] gitaly[914]: time="2026-08-15T23:36:43.245Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M03WF0TYS012C2C6MKGWJ80W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-15T23:36:53.224" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-15T23:36:43.245" grpc.time_ms=0.329 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2110gitlab # [ 415.386238] gitaly[914]: time="2026-08-15T23:36:43.272Z" level=info msg="finished unary call with code OK" command.count=3 command.cpu_time_ms=18 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=859 command.oublock=0 command.real_time_ms=20 command.spawn_token_fork_ms=0 command.system_time_ms=15 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M03WF0TYS012C2C6MKGWJ80W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-08-15T23:36:53.230" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-08-15T23:36:43.250" grpc.time_ms=22.051 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2111gitlab # [ 415.489400] gitaly[914]: time="2026-08-15T23:36:43.401Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=312 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=1 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M03WF0TYS012C2C6MKGWJ80W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindCommits grpc.request.deadline="2026-08-15T23:37:13.089" grpc.request.fullMethod=/gitaly.CommitService/FindCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=173 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-15T23:36:43.389" grpc.time_ms=11.202 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2112gitlab # [ 415.537730] gitaly[914]: time="2026-08-15T23:36:43.449Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M03WF0TYS012C2C6MKGWJ80W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-08-15T23:36:53.008" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-15T23:36:43.448" grpc.time_ms=0.509 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2113gitlab # [ 415.570441] gitaly[914]: time="2026-08-15T23:36:43.462Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=316 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=1 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M03WF0TYS012C2C6MKGWJ80W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-08-15T23:36:53.014" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=112 grpc.service=gitaly.DiffService grpc.start_time="2026-08-15T23:36:43.454" grpc.time_ms=8.103 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2114gitlab # [ 415.602689] gitaly[914]: time="2026-08-15T23:36:43.509Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M03WF0TYS012C2C6MKGWJ80W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-15T23:36:53.051" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-15T23:36:43.492" grpc.time_ms=17.041 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2115gitlab # [ 415.642599] gitaly[914]: time="2026-08-15T23:36:43.535Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=2 command.system_time_ms=12 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M03WF0TYS012C2C6MKGWJ80W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-15T23:36:53.079" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-08-15T23:36:43.520" grpc.time_ms=15.562 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2116gitlab # [ 415.675194] gitaly[914]: time="2026-08-15T23:36:43.587Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=20 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=882 command.oublock=0 command.real_time_ms=23 command.spawn_token_fork_ms=3 command.system_time_ms=17 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M03WF0TYS012C2C6MKGWJ80W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-08-15T23:37:13.259" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=155 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=80 grpc.service=gitaly.CommitService grpc.start_time="2026-08-15T23:36:43.559" grpc.time_ms=27.364 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2117gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a'2118gitlab # [ 416.344647] nixbot[3476]: INFO: ::ffff:127.0.0.1:35528 - "GET /api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a HTTP/1.1" 200 OK2119gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a', in 0.06 seconds)2120gitlab # [ 416.412582] gitaly[914]: time="2026-08-15T23:36:44.324Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M03WF0TYS012C2C6MKGWJ80W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-08-15T23:36:54.000" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-15T23:36:44.321" grpc.time_ms=2.423 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2121gitlab # [ 416.483697] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-15T23:36:44.393Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 a67995a4626b5610cec8924c971f7239bbaa2866 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"631c4109395cc66c81bb020e","created_at":"2026-08-15T23:35:11.857Z","trace_propagation_headers":{"sentry-trace":"e642f789365f4b808c24da962532a593-b647bda1de0a403e","baggage":"sentry-trace_id=e642f789365f4b808c24da962532a593,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M03WF0TYS012C2C6MKGWJ80W","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:35:11.866Z","job_size_bytes":185,"pid":3466,"sidekiq_tid":"m8s6","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-631c4109395cc66c81bb020e: done: 1.414751 sec","job_status":"done","queue_duration_s":91.112114,"scheduling_latency_s":91.112136,"gitaly_calls":13,"gitaly_duration_s":0.282839,"redis_calls":198,"redis_allowed_cross_slot_calls":6,"redis_duration_s":0.061714,"redis_read_bytes":2103,"redis_write_bytes":21751,"redis_cache_calls":15,"redis_cache_duration_s":0.006057,"redis_cache_read_bytes":20,"redis_cache_write_bytes":991,"redis_feature_flag_calls":27,"redis_feature_flag_duration_s":0.008627,"redis_feature_flag_read_bytes":1678,"redis_feature_flag_write_bytes":3082,"redis_queues_calls":10,"redis_queues_duration_s":0.002067,"redis_queues_read_bytes":10,"redis_queues_write_bytes":7839,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.006016,"redis_queues_metadata_read_bytes":13,"redis_queues_metadata_write_bytes":1467,"redis_repository_cache_calls":90,"redis_repository_cache_allowed_cross_slot_calls":6,"redis_repository_cache_duration_s":0.02108,"redis_repository_cache_read_bytes":249,"redis_repository_cache_write_bytes":6237,"redis_shared_state_calls":46,"redis_shared_state_duration_s":0.017867,"redis_shared_state_read_bytes":133,"redis_shared_state_write_bytes":2135,"db_count":47,"db_write_count":8,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":47,"db_replica_write_count":0,"db_primary_write_count":8,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.085,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":47,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":8,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.332,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.374,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.085,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.983284,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.0007929,"exclusive_lock_hold_duration_s":0.037968959999999996,"duration_s":1.414751,"completed_at":"2026-08-15T23:36:44.393Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.151964,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2122gitlab # [ 416.589626] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-15T23:36:44.396Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","a67995a4626b5610cec8924c971f7239bbaa2866 9ad17214e1c9d713186fc41ecac2f0b2682a968a refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"0a1521b51682a28888b04083","created_at":"2026-08-15T23:35:16.554Z","trace_propagation_headers":{"sentry-trace":"28844c8b7c24426ba33e625652b4f071-3fd23403ad164a7a","baggage":"sentry-trace_id=28844c8b7c24426ba33e625652b4f071,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M03WF5R22ZWTRYS8YY2WF6CG","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:35:16.556Z","job_size_bytes":185,"pid":3466,"sidekiq_tid":"m8s6","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-0a1521b51682a28888b04083: start","job_status":"start","queue_duration_s":87.839766,"scheduling_latency_s":87.839798}2123gitlab # [ 416.609299] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-15T23:36:44.416Z","message":"changes: \"a67995a4626b5610cec8924c971f7239bbaa2866 9ad17214e1c9d713186fc41ecac2f0b2682a968a refs/heads/master\\n\""}2124gitlab # [ 416.611817] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-15T23:36:44.489Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"f72eda4867134c5731139cc9","created_at":"2026-08-15T23:36:44.487Z","trace_propagation_headers":{"sentry-trace":"28844c8b7c24426ba33e625652b4f071-5c4dd3efa78f4ba6","baggage":"sentry-trace_id=28844c8b7c24426ba33e625652b4f071,sentry-release=Unknown"},"correlation_id":"01M03WF5R22ZWTRYS8YY2WF6CG","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","duplicate-of":"68531242fafe711126a8b0b4","job_size_bytes":46,"pid":3466,"job_status":"deduplicated","message":"ProjectCacheWorker JID-f72eda4867134c5731139cc9: deduplicated: until executing","deduplication.type":"until executing"}2125gitlab # [ 416.627725] gitaly[914]: time="2026-08-15T23:36:44.460Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=9 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M03WF5R22ZWTRYS8YY2WF6CG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-15T23:36:54.003" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-08-15T23:36:44.443" grpc.time_ms=16.984 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2126gitlab # [ 416.641479] gitaly[914]: time="2026-08-15T23:36:44.484Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=575 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=6 command.user_time_ms=6 component=gitaly.UnaryServerInterceptor correlation_id=01M03WF5R22ZWTRYS8YY2WF6CG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-15T23:36:54.027" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-15T23:36:44.467" grpc.time_ms=16.376 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2127gitlab # [ 416.657812] gitaly[914]: time="2026-08-15T23:36:44.525Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M03WF5R22ZWTRYS8YY2WF6CG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-08-15T23:36:54.068" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=266 grpc.service=gitaly.RefService grpc.start_time="2026-08-15T23:36:44.508" grpc.time_ms=16.269 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2128gitlab # [ 416.672996] gitaly[914]: time="2026-08-15T23:36:44.549Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=596 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=1 command.system_time_ms=6 command.user_time_ms=7 component=gitaly.StreamServerInterceptor correlation_id=01M03WF5R22ZWTRYS8YY2WF6CG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommits grpc.request.deadline="2026-08-15T23:37:14.230" grpc.request.fullMethod=/gitaly.CommitService/ListCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=212 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-15T23:36:44.531" grpc.time_ms=18.027 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2129gitlab # [ 416.690225] gitaly[914]: time="2026-08-15T23:36:44.575Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=318 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=1 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M03WF5R22ZWTRYS8YY2WF6CG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-08-15T23:36:54.124" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=116 grpc.service=gitaly.DiffService grpc.start_time="2026-08-15T23:36:44.565" grpc.time_ms=9.65 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2130gitlab # [ 416.705046] gitaly[914]: time="2026-08-15T23:36:44.604Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=2 command.system_time_ms=11 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M03WF5R22ZWTRYS8YY2WF6CG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-15T23:36:54.148" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-15T23:36:44.589" grpc.time_ms=14.889 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2131gitlab # [ 416.981055] gitaly[914]: time="2026-08-15T23:36:44.892Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M03WF5R22ZWTRYS8YY2WF6CG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-08-15T23:36:54.008" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-15T23:36:44.749" grpc.time_ms=143.46 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2132gitlab # [ 417.020418] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-15T23:36:44.916Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","a67995a4626b5610cec8924c971f7239bbaa2866 9ad17214e1c9d713186fc41ecac2f0b2682a968a refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"0a1521b51682a28888b04083","created_at":"2026-08-15T23:35:16.554Z","trace_propagation_headers":{"sentry-trace":"28844c8b7c24426ba33e625652b4f071-3fd23403ad164a7a","baggage":"sentry-trace_id=28844c8b7c24426ba33e625652b4f071,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M03WF5R22ZWTRYS8YY2WF6CG","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:35:16.556Z","job_size_bytes":185,"pid":3466,"sidekiq_tid":"m8s6","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-0a1521b51682a28888b04083: done: 0.519911 sec","job_status":"done","queue_duration_s":87.839766,"scheduling_latency_s":87.839798,"gitaly_calls":7,"gitaly_duration_s":0.259151,"redis_calls":110,"redis_allowed_cross_slot_calls":4,"redis_duration_s":0.02929,"redis_read_bytes":500,"redis_write_bytes":11943,"redis_cache_calls":9,"redis_cache_duration_s":0.003406,"redis_cache_read_bytes":14,"redis_cache_write_bytes":593,"redis_queues_calls":6,"redis_queues_duration_s":0.001552,"redis_queues_read_bytes":8,"redis_queues_write_bytes":5720,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.006121,"redis_queues_metadata_read_bytes":163,"redis_queues_metadata_write_bytes":1428,"redis_repository_cache_calls":41,"redis_repository_cache_allowed_cross_slot_calls":4,"redis_repository_cache_duration_s":0.009189,"redis_repository_cache_read_bytes":176,"redis_repository_cache_write_bytes":2193,"redis_shared_state_calls":44,"redis_shared_state_duration_s":0.009022,"redis_shared_state_read_bytes":139,"redis_shared_state_write_bytes":2009,"db_count":28,"db_write_count":3,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":28,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.038,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":28,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.033,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.033,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.038,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.35929,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00118106,"exclusive_lock_hold_duration_s":0.03048872,"duration_s":0.519911,"completed_at":"2026-08-15T23:36:44.916Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.039835,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2133gitlab # [ 417.115349] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-15T23:36:44.918Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"83415720469786e31800d4b9","created_at":"2026-08-15T23:35:17.288Z","trace_propagation_headers":{"sentry-trace":"94162400d1764c54b79f48e68f9cf918-e8d74378d8eb4106","baggage":"sentry-trace_id=94162400d1764c54b79f48e68f9cf918,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M03WF6MBMNTJ2HBCR9P8JA54","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-08-15T23:35:17.296Z","job_size_bytes":65,"pid":3466,"sidekiq_tid":"m8s6","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-83415720469786e31800d4b9: start","job_status":"start","queue_duration_s":87.621711,"scheduling_latency_s":87.621735}2134gitlab # [ 417.135770] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-15T23:36:45.031Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"83415720469786e31800d4b9","created_at":"2026-08-15T23:35:17.288Z","trace_propagation_headers":{"sentry-trace":"94162400d1764c54b79f48e68f9cf918-e8d74378d8eb4106","baggage":"sentry-trace_id=94162400d1764c54b79f48e68f9cf918,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M03WF6MBMNTJ2HBCR9P8JA54","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-08-15T23:35:17.296Z","job_size_bytes":65,"pid":3466,"sidekiq_tid":"m8s6","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-83415720469786e31800d4b9: done: 0.112979 sec","job_status":"done","queue_duration_s":87.621711,"scheduling_latency_s":87.621735,"redis_calls":16,"redis_duration_s":0.005323,"redis_read_bytes":269,"redis_write_bytes":1850,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.002925,"redis_feature_flag_read_bytes":262,"redis_feature_flag_write_bytes":1032,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001841,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":590,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000557,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":228,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.022,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.013,"db_ci_duration_s":0.009,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.068577,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00052684,"duration_s":0.112979,"completed_at":"2026-08-15T23:36:45.030Z","load_balancing_strategy":"primary","db_duration_s":0.037008,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2135gitlab # [ 417.181710] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-15T23:36:45.033Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"fd8075ec2f6f6778fc748613","created_at":"2026-08-15T23:35:17.297Z","trace_propagation_headers":{"sentry-trace":"94162400d1764c54b79f48e68f9cf918-e8d74378d8eb4106","baggage":"sentry-trace_id=94162400d1764c54b79f48e68f9cf918,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M03WF6MBMNTJ2HBCR9P8JA54","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-08-15T23:35:17.304Z","job_size_bytes":65,"pid":3466,"sidekiq_tid":"m8s6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-fd8075ec2f6f6778fc748613: start","job_status":"start","queue_duration_s":87.728485,"scheduling_latency_s":87.728508}2136gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a'2137gitlab # [ 417.270482] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-15T23:36:45.181Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"fd8075ec2f6f6778fc748613","created_at":"2026-08-15T23:35:17.297Z","trace_propagation_headers":{"sentry-trace":"94162400d1764c54b79f48e68f9cf918-e8d74378d8eb4106","baggage":"sentry-trace_id=94162400d1764c54b79f48e68f9cf918,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M03WF6MBMNTJ2HBCR9P8JA54","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-08-15T23:35:17.304Z","job_size_bytes":65,"pid":3466,"sidekiq_tid":"m8s6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-fd8075ec2f6f6778fc748613: done: 0.148562 sec","job_status":"done","queue_duration_s":87.728485,"scheduling_latency_s":87.728508,"redis_calls":21,"redis_duration_s":0.006513,"redis_read_bytes":148,"redis_write_bytes":2264,"redis_feature_flag_calls":9,"redis_feature_flag_duration_s":0.00294,"redis_feature_flag_read_bytes":136,"redis_feature_flag_write_bytes":1264,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001742,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":578,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001831,"redis_shared_state_read_bytes":8,"redis_shared_state_write_bytes":422,"db_count":15,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.042,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.032,"db_ci_duration_s":0.011,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.086549,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00058236,"duration_s":0.148562,"completed_at":"2026-08-15T23:36:45.181Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.049939,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2138gitlab # [ 417.360280] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-15T23:36:45.184Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"790dc0e6e8783991229aba76","created_at":"2026-08-15T23:35:17.532Z","trace_propagation_headers":{"sentry-trace":"94162400d1764c54b79f48e68f9cf918-e8d74378d8eb4106","baggage":"sentry-trace_id=94162400d1764c54b79f48e68f9cf918,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M03WF6MBMNTJ2HBCR9P8JA54","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-15T23:35:17.546Z","job_size_bytes":3,"pid":3466,"sidekiq_tid":"m8s6","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-790dc0e6e8783991229aba76: start","job_status":"start","queue_duration_s":87.637301,"scheduling_latency_s":87.637325}2139gitlab # [ 417.425957] nixbot[3476]: INFO: ::ffff:127.0.0.1:35540 - "GET /api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a HTTP/1.1" 200 OK2140gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a', in 0.08 seconds)2141gitlab # [ 417.624929] gitaly[914]: time="2026-08-15T23:36:45.535Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M03WF6MBMNTJ2HBCR9P8JA54 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3896 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-15T23:36:45.534" grpc.time_ms=0.766 pid=914 span.kind=server system=grpc2142gitlab # [ 417.679265] gitaly[914]: time="2026-08-15T23:36:45.591Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M03WF6MBMNTJ2HBCR9P8JA54 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-15T23:36:45.590" grpc.time_ms=0.773 pid=914 span.kind=server system=grpc2143gitlab # [ 417.733450] gitaly[914]: time="2026-08-15T23:36:45.645Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M03WF6MBMNTJ2HBCR9P8JA54 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3896 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-15T23:36:45.644" grpc.time_ms=0.649 pid=914 span.kind=server system=grpc2144gitlab # [ 417.763362] gitaly[914]: time="2026-08-15T23:36:45.661Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M03WF6MBMNTJ2HBCR9P8JA54 diskcache=54645faf-a4a6-49a8-a897-5a59201252fc grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-15T23:37:15.175" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-15T23:36:45.475" pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2145gitlab # [ 417.786033] gitaly[914]: time="2026-08-15T23:36:45.661Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=207 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7612 command.oublock=0 command.real_time_ms=177 command.spawn_token_fork_ms=1 command.system_time_ms=83 command.user_time_ms=124 component=gitaly.UnaryServerInterceptor correlation_id=01M03WF6MBMNTJ2HBCR9P8JA54 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-15T23:37:15.175" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-15T23:36:45.475" grpc.time_ms=185.532 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2146gitlab # [ 417.977101] gitaly[914]: time="2026-08-15T23:36:45.888Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M03WF6MBMNTJ2HBCR9P8JA54 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-15T23:37:15.586" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-15T23:36:45.887" grpc.time_ms=1.623 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2147gitlab # [ 418.041352] gitaly[914]: time="2026-08-15T23:36:45.953Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M03WF6MBMNTJ2HBCR9P8JA54 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-15T23:37:15.651" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-15T23:36:45.951" grpc.time_ms=1.119 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2148gitlab # [ 418.081282] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-15T23:36:45.983Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"790dc0e6e8783991229aba76","created_at":"2026-08-15T23:35:17.532Z","trace_propagation_headers":{"sentry-trace":"94162400d1764c54b79f48e68f9cf918-e8d74378d8eb4106","baggage":"sentry-trace_id=94162400d1764c54b79f48e68f9cf918,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M03WF6MBMNTJ2HBCR9P8JA54","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-15T23:35:17.546Z","job_size_bytes":3,"pid":3466,"sidekiq_tid":"m8s6","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-790dc0e6e8783991229aba76: done: 0.799907 sec","job_status":"done","queue_duration_s":87.637301,"scheduling_latency_s":87.637325,"gitaly_calls":3,"gitaly_duration_s":0.199178,"redis_calls":117,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.045294,"redis_read_bytes":457,"redis_write_bytes":27999,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.002613,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.002086,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_feature_flag_calls":40,"redis_feature_flag_duration_s":0.017619,"redis_feature_flag_read_bytes":294,"redis_feature_flag_write_bytes":6581,"redis_queues_calls":25,"redis_queues_duration_s":0.006444,"redis_queues_read_bytes":36,"redis_queues_write_bytes":14493,"redis_queues_metadata_calls":21,"redis_queues_metadata_duration_s":0.008329,"redis_queues_metadata_read_bytes":32,"redis_queues_metadata_write_bytes":3370,"redis_rate_limiting_calls":2,"redis_rate_limiting_duration_s":0.001265,"redis_rate_limiting_read_bytes":2,"redis_rate_limiting_write_bytes":166,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000973,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003352,"redis_shared_state_read_bytes":11,"redis_shared_state_write_bytes":851,"db_count":52,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":52,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.102,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":35,"db_ci_count":17,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.055,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.062,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.047,"db_ci_duration_s":0.055,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.469419,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.7127933399999999,"duration_s":0.799907,"completed_at":"2026-08-15T23:36:45.983Z","load_balancing_strategy":"primary","db_duration_s":0.121505,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2149gitlab # [ 418.170850] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-15T23:36:45.986Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"68531242fafe711126a8b0b4","created_at":"2026-08-15T23:36:43.069Z","trace_propagation_headers":{"sentry-trace":"e642f789365f4b808c24da962532a593-bd584b8c59ed4920","baggage":"sentry-trace_id=e642f789365f4b808c24da962532a593,sentry-release=Unknown"},"correlation_id":"01M03WF0TYS012C2C6MKGWJ80W","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-08-15T23:36:43.087Z","job_size_bytes":46,"pid":3466,"sidekiq_tid":"m8s6","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-68531242fafe711126a8b0b4: start","job_status":"start","queue_duration_s":2.898537,"scheduling_latency_s":2.898562}2150gitlab # [ 418.188074] gitaly[914]: time="2026-08-15T23:36:46.062Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M03WF0TYS012C2C6MKGWJ80W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryInfo grpc.request.deadline="2026-08-16T05:36:46.050" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryInfo grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-15T23:36:46.051" grpc.time_ms=10.158 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2151gitlab # [ 418.199132] gitaly[914]: time="2026-08-15T23:36:46.087Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=597 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M03WF0TYS012C2C6MKGWJ80W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-08-15T23:37:16.072" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-08-15T23:36:46.073" grpc.time_ms=13.869 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2152gitlab # [ 418.213120] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-15T23:36:46.121Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"68531242fafe711126a8b0b4","created_at":"2026-08-15T23:36:43.069Z","trace_propagation_headers":{"sentry-trace":"e642f789365f4b808c24da962532a593-bd584b8c59ed4920","baggage":"sentry-trace_id=e642f789365f4b808c24da962532a593,sentry-release=Unknown"},"correlation_id":"01M03WF0TYS012C2C6MKGWJ80W","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-08-15T23:36:43.087Z","job_size_bytes":46,"pid":3466,"sidekiq_tid":"m8s6","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-68531242fafe711126a8b0b4: done: 0.135176 sec","job_status":"done","queue_duration_s":2.898537,"scheduling_latency_s":2.898562,"gitaly_calls":2,"gitaly_duration_s":0.030801,"redis_calls":30,"redis_allowed_cross_slot_calls":2,"redis_duration_s":0.009066,"redis_read_bytes":69,"redis_write_bytes":4885,"redis_feature_flag_calls":6,"redis_feature_flag_duration_s":0.001764,"redis_feature_flag_read_bytes":6,"redis_feature_flag_write_bytes":1005,"redis_queues_calls":3,"redis_queues_duration_s":0.000725,"redis_queues_read_bytes":4,"redis_queues_write_bytes":2113,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.00192,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":710,"redis_repository_cache_calls":11,"redis_repository_cache_allowed_cross_slot_calls":2,"redis_repository_cache_duration_s":0.00365,"redis_repository_cache_read_bytes":48,"redis_repository_cache_write_bytes":753,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.001007,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":304,"db_count":10,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":10,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":2,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.004,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.004,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.011,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.078516,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00037036,"duration_s":0.135176,"completed_at":"2026-08-15T23:36:46.121Z","load_balancing_strategy":"primary","db_duration_s":0.017279,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2153gitlab # [ 418.262301] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-15T23:36:46.123Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"25271c5c558658f1e36946c4","created_at":"2026-08-15T23:36:43.108Z","trace_propagation_headers":{"sentry-trace":"e642f789365f4b808c24da962532a593-bd584b8c59ed4920","baggage":"sentry-trace_id=e642f789365f4b808c24da962532a593,sentry-release=Unknown"},"correlation_id":"01M03WF0TYS012C2C6MKGWJ80W","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-08-15T23:36:43.114Z","job_size_bytes":3,"pid":3466,"sidekiq_tid":"m8s6","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-25271c5c558658f1e36946c4: start","job_status":"start","queue_duration_s":3.008768,"scheduling_latency_s":3.008788}2154gitlab # [ 418.279968] gitaly[914]: time="2026-08-15T23:36:46.188Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M03WF0TYS012C2C6MKGWJ80W diskcache=f1a828bc-b73f-4a37-a007-a6ce49b67eac grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-08-16T05:36:46.151" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-08-15T23:36:46.151" pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2155gitlab # [ 418.291243] gitaly[914]: time="2026-08-15T23:36:46.189Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=4 command.cpu_time_ms=28 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1172 command.oublock=0 command.real_time_ms=46 command.spawn_token_fork_ms=2 command.system_time_ms=21 command.user_time_ms=7 component=gitaly.UnaryServerInterceptor correlation_id=01M03WF0TYS012C2C6MKGWJ80W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-08-16T05:36:46.151" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-08-15T23:36:46.151" grpc.time_ms=37.225 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2156gitlab # [ 418.331964] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-15T23:36:46.243Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"25271c5c558658f1e36946c4","created_at":"2026-08-15T23:36:43.108Z","trace_propagation_headers":{"sentry-trace":"e642f789365f4b808c24da962532a593-bd584b8c59ed4920","baggage":"sentry-trace_id=e642f789365f4b808c24da962532a593,sentry-release=Unknown"},"correlation_id":"01M03WF0TYS012C2C6MKGWJ80W","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-08-15T23:36:43.114Z","job_size_bytes":3,"pid":3466,"sidekiq_tid":"m8s6","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-25271c5c558658f1e36946c4: done: 0.120355 sec","job_status":"done","queue_duration_s":3.008768,"scheduling_latency_s":3.008788,"gitaly_calls":1,"gitaly_duration_s":0.040161,"redis_calls":15,"redis_duration_s":0.004775,"redis_read_bytes":68,"redis_write_bytes":1520,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000513,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002085,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":558,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000753,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001424,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":520,"db_count":12,"db_write_count":4,"db_cached_count":0,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":4,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.013,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":4,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.015,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.029,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.013,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.051947,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.09126762000000001,"duration_s":0.120355,"completed_at":"2026-08-15T23:36:46.243Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.022558,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2157gitlab # [ 418.380138] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-15T23:36:46.245Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"9956933a9b28516a92a6e877","created_at":"2026-08-15T23:36:43.239Z","trace_propagation_headers":{"sentry-trace":"e642f789365f4b808c24da962532a593-bd584b8c59ed4920","baggage":"sentry-trace_id=e642f789365f4b808c24da962532a593,sentry-release=Unknown"},"correlation_id":"01M03WF0TYS012C2C6MKGWJ80W","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-08-15T23:36:43.242Z","job_size_bytes":23,"pid":3466,"sidekiq_tid":"m8s6","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-9956933a9b28516a92a6e877: start","job_status":"start","queue_duration_s":3.003463,"scheduling_latency_s":3.003488}2158gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a'2159gitlab # [ 418.395903] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-15T23:36:46.305Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"9956933a9b28516a92a6e877","created_at":"2026-08-15T23:36:43.239Z","trace_propagation_headers":{"sentry-trace":"e642f789365f4b808c24da962532a593-bd584b8c59ed4920","baggage":"sentry-trace_id=e642f789365f4b808c24da962532a593,sentry-release=Unknown"},"correlation_id":"01M03WF0TYS012C2C6MKGWJ80W","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-08-15T23:36:43.242Z","job_size_bytes":23,"pid":3466,"sidekiq_tid":"m8s6","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-9956933a9b28516a92a6e877: done: 0.060031 sec","job_status":"done","queue_duration_s":3.003463,"scheduling_latency_s":3.003488,"gitaly_calls":1,"gitaly_duration_s":0.01649,"redis_calls":16,"redis_duration_s":0.004717,"redis_read_bytes":52,"redis_write_bytes":2049,"redis_queues_calls":1,"redis_queues_duration_s":0.000382,"redis_queues_read_bytes":1,"redis_queues_write_bytes":980,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001383,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":437,"redis_repository_cache_calls":7,"redis_repository_cache_duration_s":0.00213,"redis_repository_cache_read_bytes":44,"redis_repository_cache_write_bytes":344,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000822,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":288,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.033172,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.060031,"completed_at":"2026-08-15T23:36:46.305Z","load_balancing_strategy":"primary","db_duration_s":0.004315,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2160gitlab # [ 418.441138] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-15T23:36:46.307Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"bde1dc3f80b4fff290502214","created_at":"2026-08-15T23:36:44.035Z","trace_propagation_headers":{"sentry-trace":"e642f789365f4b808c24da962532a593-bd584b8c59ed4920","baggage":"sentry-trace_id=e642f789365f4b808c24da962532a593,sentry-release=Unknown"},"correlation_id":"01M03WF0TYS012C2C6MKGWJ80W","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:719bc19dde9de25d970761544b75945be39cea6c9f8bc87aea260bb7bf53b3c2","size_limiter":"validated","enqueued_at":"2026-08-15T23:36:44.047Z","job_size_bytes":467,"pid":3466,"sidekiq_tid":"m8s6","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-bde1dc3f80b4fff290502214: start","job_status":"start","queue_duration_s":2.259974,"scheduling_latency_s":2.259995}2161gitlab # [ 418.457881] gitaly[914]: time="2026-08-15T23:36:46.294Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=596 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=1 command.system_time_ms=7 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M03WF0TYS012C2C6MKGWJ80W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-08-15T23:37:16.279" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-08-15T23:36:46.280" grpc.time_ms=13.818 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2162gitlab # [ 418.471434] gitaly[914]: time="2026-08-15T23:36:46.341Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M03WF0TYS012C2C6MKGWJ80W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-15T23:37:16.339" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-15T23:36:46.340" grpc.time_ms=0.798 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2163gitlab # [ 418.484286] gitaly[914]: time="2026-08-15T23:36:46.363Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M03WF0TYS012C2C6MKGWJ80W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-08-15T23:36:56.023" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-08-15T23:36:46.344" grpc.time_ms=18.731 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2164gitlab # [ 418.501248] nixbot[3476]: INFO: ::ffff:127.0.0.1:35548 - "GET /api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a HTTP/1.1" 200 OK2165gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a', in 0.08 seconds)2166gitlab # [ 418.669282] gitaly[914]: time="2026-08-15T23:36:46.580Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M03WF0TYS012C2C6MKGWJ80W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-15T23:37:16.578" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-15T23:36:46.579" grpc.time_ms=1.153 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2167gitlab # [ 418.687851] gitaly[914]: time="2026-08-15T23:36:46.594Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=44 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M03WF0TYS012C2C6MKGWJ80W error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-08-15T23:37:16.589" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-15T23:36:46.589" grpc.time_ms=4.534 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2168gitlab # [ 418.860905] gitaly[914]: time="2026-08-15T23:36:46.772Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=1 command.system_time_ms=9 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M03WF0TYS012C2C6MKGWJ80W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-15T23:36:56.015" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-15T23:36:46.756" grpc.time_ms=16.424 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2169gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a'2170gitlab # [ 419.499091] gitaly[914]: time="2026-08-15T23:36:47.411Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=18 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=880 command.oublock=0 command.real_time_ms=22 command.spawn_token_fork_ms=2 command.system_time_ms=12 command.user_time_ms=6 component=gitaly.StreamServerInterceptor correlation_id=01M03WF0TYS012C2C6MKGWJ80W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-08-15T23:37:17.384" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-08-15T23:36:47.384" grpc.time_ms=26.406 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2171gitlab # [ 419.528384] gitaly[914]: time="2026-08-15T23:36:47.440Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=4 command.system_time_ms=12 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M03WF0TYS012C2C6MKGWJ80W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-08-15T23:37:17.416" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-08-15T23:36:47.417" grpc.time_ms=21.721 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2172gitlab # [ 419.562216] nixbot[3476]: INFO: ::ffff:127.0.0.1:35554 - "GET /api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a HTTP/1.1" 200 OK2173gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a', in 0.05 seconds)2174gitlab # [ 419.593501] sidekiq-cluster[3466]: {"severity":"WARN","time":"2026-08-15T23:36:47.504Z","class":"CreatePipelineWorker","correlation_id":"01M03WF0TYS012C2C6MKGWJ80W","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"0000000000000000000000000000000000000000","after":"a67995a4626b5610cec8924c971f7239bbaa2866","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"a67995a4626b5610cec8924c971f7239bbaa2866","ref":"refs/heads/master"},"retry":0}2175gitlab # [ 419.609022] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-15T23:36:47.519Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"bde1dc3f80b4fff290502214","created_at":"2026-08-15T23:36:44.035Z","trace_propagation_headers":{"sentry-trace":"e642f789365f4b808c24da962532a593-bd584b8c59ed4920","baggage":"sentry-trace_id=e642f789365f4b808c24da962532a593,sentry-release=Unknown"},"correlation_id":"01M03WF0TYS012C2C6MKGWJ80W","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:719bc19dde9de25d970761544b75945be39cea6c9f8bc87aea260bb7bf53b3c2","size_limiter":"validated","enqueued_at":"2026-08-15T23:36:44.047Z","job_size_bytes":467,"pid":3466,"sidekiq_tid":"m8s6","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-bde1dc3f80b4fff290502214: done: 1.212284 sec","job_status":"done","queue_duration_s":2.259974,"scheduling_latency_s":2.259995,"gitaly_calls":7,"gitaly_duration_s":0.119573,"redis_calls":51,"redis_duration_s":0.014960999999999999,"redis_read_bytes":169,"redis_write_bytes":4168,"redis_cache_calls":4,"redis_cache_duration_s":0.001307,"redis_cache_read_bytes":10,"redis_cache_write_bytes":343,"redis_feature_flag_calls":16,"redis_feature_flag_duration_s":0.006598,"redis_feature_flag_read_bytes":16,"redis_feature_flag_write_bytes":2174,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00182,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":510,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.003658,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001578,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":513,"db_count":36,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":36,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.048,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":32,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.043,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":1.008222,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000598,"duration_s":1.212284,"completed_at":"2026-08-15T23:36:47.519Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.088459,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2176gitlab # [ 419.675442] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-15T23:36:47.523Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{\"idempotency_key\"=\u003e\"cb9b228c-3349-468e-bc44-85d34899011e\"}"],"class":"WebHookWorker","jid":"952ca3895458a81ef61863f9","created_at":"2026-08-15T23:36:44.281Z","trace_propagation_headers":{"sentry-trace":"e642f789365f4b808c24da962532a593-bd584b8c59ed4920","baggage":"sentry-trace_id=e642f789365f4b808c24da962532a593,sentry-release=Unknown"},"correlation_id":"01M03WF0TYS012C2C6MKGWJ80W","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5045afc072d03370ff3f64bb3860a90f21b5245bab4b4ddf2482b49b0111ca1f","size_limiter":"validated","enqueued_at":"2026-08-15T23:36:44.287Z","job_size_bytes":1751,"pid":3466,"sidekiq_tid":"m8s6","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-952ca3895458a81ef61863f9: start","job_status":"start","queue_duration_s":3.236399,"scheduling_latency_s":3.236452}2177gitlab # [ 419.851137] nixbot[3476]: INFO: ::ffff:127.0.0.1:35568 - "POST /webhooks/gitlab HTTP/1.1" 202 Accepted2178gitlab # [ 419.893492] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-15T23:36:47.804Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{:idempotency_key=\u003e\"cb9b228c-3349-468e-bc44-85d34899011e\"}"],"class":"WebHookWorker","jid":"952ca3895458a81ef61863f9","created_at":"2026-08-15T23:36:44.281Z","trace_propagation_headers":{"sentry-trace":"e642f789365f4b808c24da962532a593-bd584b8c59ed4920","baggage":"sentry-trace_id=e642f789365f4b808c24da962532a593,sentry-release=Unknown"},"correlation_id":"01M03WF0TYS012C2C6MKGWJ80W","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5045afc072d03370ff3f64bb3860a90f21b5245bab4b4ddf2482b49b0111ca1f","size_limiter":"validated","enqueued_at":"2026-08-15T23:36:44.287Z","job_size_bytes":1751,"pid":3466,"sidekiq_tid":"m8s6","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-952ca3895458a81ef61863f9: done: 0.280389 sec","job_status":"done","queue_duration_s":3.236399,"scheduling_latency_s":3.236452,"redis_calls":19,"redis_duration_s":0.008363,"redis_read_bytes":32,"redis_write_bytes":5368,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001959,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":622,"redis_queues_calls":2,"redis_queues_duration_s":0.000772,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3730,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.003794,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":690,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001838,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":326,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"external_http_count":1,"external_http_duration_s":0.08793984000004684,"cpu_s":0.164252,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00074778,"extra.web_hook_worker.response_status":"success","extra.web_hook_worker.http_status":"ok","extra.web_hook_worker.signing_token_present":false,"duration_s":0.280389,"completed_at":"2026-08-15T23:36:47.803Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005874,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2179gitlab # [ 420.019533] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-15T23:36:47.807Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"45d37c529d00207ef384cf70","created_at":"2026-08-15T23:36:44.499Z","trace_propagation_headers":{"sentry-trace":"28844c8b7c24426ba33e625652b4f071-5c4dd3efa78f4ba6","baggage":"sentry-trace_id=28844c8b7c24426ba33e625652b4f071,sentry-release=Unknown"},"correlation_id":"01M03WF5R22ZWTRYS8YY2WF6CG","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","duplicate-of":"25271c5c558658f1e36946c4","size_limiter":"validated","enqueued_at":"2026-08-15T23:36:44.503Z","job_size_bytes":3,"pid":3466,"sidekiq_tid":"m8s6","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-45d37c529d00207ef384cf70: start","job_status":"start","queue_duration_s":3.304394,"scheduling_latency_s":3.304433}2180gitlab # [ 420.047089] gitaly[914]: time="2026-08-15T23:36:47.933Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M03WF5R22ZWTRYS8YY2WF6CG diskcache=8f1b2f57-44ae-4161-8253-87ef498d8aad grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-08-16T05:36:47.845" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-08-15T23:36:47.846" pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2181gitlab # [ 420.061513] gitaly[914]: time="2026-08-15T23:36:47.933Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=289 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M03WF5R22ZWTRYS8YY2WF6CG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-08-16T05:36:47.845" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-08-15T23:36:47.846" grpc.time_ms=87.288 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2182gitlab # [ 420.078499] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/08/15:23:36:47 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 1412183gitlab # [ 420.080952] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-15T23:36:47.980Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"45d37c529d00207ef384cf70","created_at":"2026-08-15T23:36:44.499Z","trace_propagation_headers":{"sentry-trace":"28844c8b7c24426ba33e625652b4f071-5c4dd3efa78f4ba6","baggage":"sentry-trace_id=28844c8b7c24426ba33e625652b4f071,sentry-release=Unknown"},"correlation_id":"01M03WF5R22ZWTRYS8YY2WF6CG","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","duplicate-of":"25271c5c558658f1e36946c4","size_limiter":"validated","enqueued_at":"2026-08-15T23:36:44.503Z","job_size_bytes":3,"pid":3466,"sidekiq_tid":"m8s6","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-45d37c529d00207ef384cf70: done: 0.172563 sec","job_status":"done","queue_duration_s":3.304394,"scheduling_latency_s":3.304433,"gitaly_calls":1,"gitaly_duration_s":0.091371,"redis_calls":12,"redis_duration_s":0.004916,"redis_read_bytes":64,"redis_write_bytes":1136,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001972,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":479,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.001142,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001802,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":520,"db_count":8,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.014,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.015,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.015,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.014,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.054914,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.13235586,"duration_s":0.172563,"completed_at":"2026-08-15T23:36:47.980Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.014773,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2184gitlab # [ 420.128347] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-15T23:36:47.983Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"c5bf9ddb5a0b54e8e8ca2528","created_at":"2026-08-15T23:36:44.681Z","trace_propagation_headers":{"sentry-trace":"28844c8b7c24426ba33e625652b4f071-5c4dd3efa78f4ba6","baggage":"sentry-trace_id=28844c8b7c24426ba33e625652b4f071,sentry-release=Unknown"},"correlation_id":"01M03WF5R22ZWTRYS8YY2WF6CG","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fcbdd9efd8b180df91a43a02f0ef04b26ad3c7ebd2477ad5c7003ab3e9715bd1","size_limiter":"validated","enqueued_at":"2026-08-15T23:36:44.688Z","job_size_bytes":467,"pid":3466,"sidekiq_tid":"m8s6","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-c5bf9ddb5a0b54e8e8ca2528: start","job_status":"start","queue_duration_s":3.295824,"scheduling_latency_s":3.295861}2185gitlab # [ 420.148147] gitaly[914]: time="2026-08-15T23:36:47.953Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=578 command.oublock=0 command.real_time_ms=22 command.spawn_token_fork_ms=4 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M03WHZE3VFK7R1EKS6W6YARR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=190 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-15T23:36:47.928" grpc.time_ms=24.545 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc2186gitlab # [ 420.161598] gitlab-workhorse[820]: time="2026-08-15T23:36:48Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672187gitlab # [ 420.163446] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/08/15:23:36:48 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 872188gitlab # [ 420.165449] gitaly[914]: time="2026-08-15T23:36:48.031Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M03WF5R22ZWTRYS8YY2WF6CG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-15T23:37:18.029" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-15T23:36:48.030" grpc.time_ms=0.824 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2189gitlab # [ 420.178311] gitaly[914]: time="2026-08-15T23:36:48.042Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M03WHZJMP30GSYM1PV7H9F7D grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-15T23:36:48.026" pid=914 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2190gitlab # [ 420.188837] gitaly[914]: time="2026-08-15T23:36:48.042Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=3 command.system_time_ms=3 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M03WHZJMP30GSYM1PV7H9F7D grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-15T23:36:48.026" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc2191gitlab # [ 420.202442] nixbot[3476]: {"ts": "2026-08-15T23:36:48.088Z", "level": "info", "logger": "nixbot.build_reuse", "msg": "reusing build for tree hash", "build_id": 1, "tree_hash": "a8c90de643fa3b1e78fc9dc27f18f04a936ba912"}2192gitlab # [ 420.204938] gitaly[914]: time="2026-08-15T23:36:48.045Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=3 command.system_time_ms=3 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M03WHZJMP30GSYM1PV7H9F7D grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-15T23:36:48.026" grpc.time_ms=16.862 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc2193gitlab # [ 420.219435] gitaly[914]: time="2026-08-15T23:36:48.048Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=3 command.system_time_ms=10 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M03WF5R22ZWTRYS8YY2WF6CG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-08-15T23:36:58.005" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-08-15T23:36:48.035" grpc.time_ms=12.754 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2194gitlab # [ 420.232948] gitaly[914]: time="2026-08-15T23:36:48.106Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M03WF5R22ZWTRYS8YY2WF6CG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-15T23:37:18.104" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-15T23:36:48.104" grpc.time_ms=1.168 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2195gitlab # [ 420.245880] gitaly[914]: time="2026-08-15T23:36:48.115Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=201 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=1 command.system_time_ms=0 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M03WF5R22ZWTRYS8YY2WF6CG error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-08-15T23:37:18.110" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-15T23:36:48.111" grpc.time_ms=4.481 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2196gitlab # [ 420.262276] gitaly[914]: time="2026-08-15T23:36:48.170Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M03WF5R22ZWTRYS8YY2WF6CG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-15T23:36:58.122" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-15T23:36:48.153" grpc.time_ms=16.782 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2197gitlab # [ 420.280436] gitaly[914]: time="2026-08-15T23:36:48.192Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M03WHZQ7AZVVC52VN7K3KAGA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-15T23:37:18.089" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-15T23:36:48.190" grpc.time_ms=1.022 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2198gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a'2199gitlab # [ 420.587310] gitaly[914]: time="2026-08-15T23:36:48.498Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=570 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=9 component=gitaly.StreamServerInterceptor correlation_id=01M03WHZQ7AZVVC52VN7K3KAGA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-15T23:36:58.008" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-15T23:36:48.479" grpc.time_ms=18.646 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2200gitlab # [ 420.641036] nixbot[3476]: INFO: ::ffff:127.0.0.1:35580 - "GET /api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a HTTP/1.1" 200 OK2201gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a', in 0.09 seconds)2202gitlab # [ 420.807935] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/08/15:23:36:48 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/a67995a4626b5610cec8924c971f7239bbaa2866 HTTP/1.1" 201 657 "" "python-httpx/0.28.1" 6152203gitlab # [ 420.816153] nixbot[3476]: {"ts": "2026-08-15T23:36:48.721Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/a67995a4626b5610cec8924c971f7239bbaa2866 \"HTTP/1.1 201 Created\""}2204gitlab # [ 420.942793] gitaly[914]: time="2026-08-15T23:36:48.854Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=881 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=1 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M03WF5R22ZWTRYS8YY2WF6CG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-08-15T23:37:18.834" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-08-15T23:36:48.835" grpc.time_ms=19.412 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2205gitlab # [ 420.969202] gitaly[914]: time="2026-08-15T23:36:48.881Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=2 command.system_time_ms=12 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M03WF5R22ZWTRYS8YY2WF6CG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-08-15T23:37:18.860" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-08-15T23:36:48.860" grpc.time_ms=19.873 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2206gitlab # [ 421.005798] sidekiq-cluster[3466]: {"severity":"WARN","time":"2026-08-15T23:36:48.895Z","class":"CreatePipelineWorker","correlation_id":"01M03WF5R22ZWTRYS8YY2WF6CG","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"a67995a4626b5610cec8924c971f7239bbaa2866","after":"9ad17214e1c9d713186fc41ecac2f0b2682a968a","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"9ad17214e1c9d713186fc41ecac2f0b2682a968a","ref":"refs/heads/master"},"retry":0}2207gitlab # [ 421.019715] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-15T23:36:48.900Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"c5bf9ddb5a0b54e8e8ca2528","created_at":"2026-08-15T23:36:44.681Z","trace_propagation_headers":{"sentry-trace":"28844c8b7c24426ba33e625652b4f071-5c4dd3efa78f4ba6","baggage":"sentry-trace_id=28844c8b7c24426ba33e625652b4f071,sentry-release=Unknown"},"correlation_id":"01M03WF5R22ZWTRYS8YY2WF6CG","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fcbdd9efd8b180df91a43a02f0ef04b26ad3c7ebd2477ad5c7003ab3e9715bd1","size_limiter":"validated","enqueued_at":"2026-08-15T23:36:44.688Z","job_size_bytes":467,"pid":3466,"sidekiq_tid":"m8s6","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-c5bf9ddb5a0b54e8e8ca2528: done: 0.916967 sec","job_status":"done","queue_duration_s":3.295824,"scheduling_latency_s":3.295861,"gitaly_calls":7,"gitaly_duration_s":0.101227,"redis_calls":33,"redis_duration_s":0.0063300000000000006,"redis_read_bytes":186,"redis_write_bytes":1839,"redis_cache_calls":3,"redis_cache_duration_s":0.000675,"redis_cache_read_bytes":45,"redis_cache_write_bytes":255,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001426,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":443,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.003317,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000912,"redis_shared_state_read_bytes":17,"redis_shared_state_write_bytes":513,"db_count":27,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":27,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.033,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":24,"db_ci_count":3,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.024,"db_ci_duration_s":0.008,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.788906,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.916967,"completed_at":"2026-08-15T23:36:48.900Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.032199,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2208gitlab # [ 421.090482] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-15T23:36:48.902Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{\"idempotency_key\"=\u003e\"7cb6e1db-f3c2-4dcc-8eb4-53cf5a426682\"}"],"class":"WebHookWorker","jid":"d0836dd23cfb37648952c18f","created_at":"2026-08-15T23:36:44.719Z","trace_propagation_headers":{"sentry-trace":"28844c8b7c24426ba33e625652b4f071-5c4dd3efa78f4ba6","baggage":"sentry-trace_id=28844c8b7c24426ba33e625652b4f071,sentry-release=Unknown"},"correlation_id":"01M03WF5R22ZWTRYS8YY2WF6CG","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63ceb909d04936833d3913ee0406e042bbc1cc20f125937653c3f125e98bc915","size_limiter":"validated","enqueued_at":"2026-08-15T23:36:44.724Z","job_size_bytes":1749,"pid":3466,"sidekiq_tid":"m8s6","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-d0836dd23cfb37648952c18f: start","job_status":"start","queue_duration_s":4.178574,"scheduling_latency_s":4.178599}2209gitlab # [ 421.110965] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-15T23:36:48.955Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{:idempotency_key=\u003e\"7cb6e1db-f3c2-4dcc-8eb4-53cf5a426682\"}"],"class":"WebHookWorker","jid":"d0836dd23cfb37648952c18f","created_at":"2026-08-15T23:36:44.719Z","trace_propagation_headers":{"sentry-trace":"28844c8b7c24426ba33e625652b4f071-5c4dd3efa78f4ba6","baggage":"sentry-trace_id=28844c8b7c24426ba33e625652b4f071,sentry-release=Unknown"},"correlation_id":"01M03WF5R22ZWTRYS8YY2WF6CG","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63ceb909d04936833d3913ee0406e042bbc1cc20f125937653c3f125e98bc915","size_limiter":"validated","enqueued_at":"2026-08-15T23:36:44.724Z","job_size_bytes":1749,"pid":3466,"sidekiq_tid":"m8s6","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-d0836dd23cfb37648952c18f: done: 0.052695 sec","job_status":"done","queue_duration_s":4.178574,"scheduling_latency_s":4.178599,"redis_calls":14,"redis_duration_s":0.008133,"redis_read_bytes":26,"redis_write_bytes":4685,"redis_queues_calls":2,"redis_queues_duration_s":0.000863,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3729,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.004774,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":630,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.002496,"redis_shared_state_read_bytes":17,"redis_shared_state_write_bytes":326,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"external_http_count":1,"external_http_duration_s":0.012926959999958854,"cpu_s":0.025175,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.web_hook_worker.response_status":"success","extra.web_hook_worker.http_status":"ok","extra.web_hook_worker.signing_token_present":false,"duration_s":0.052695,"completed_at":"2026-08-15T23:36:48.955Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003036,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2210gitlab # [ 421.162324] nixbot[3476]: INFO: ::ffff:127.0.0.1:40862 - "POST /webhooks/gitlab HTTP/1.1" 202 Accepted2211gitlab # [ 421.163960] gitaly[914]: time="2026-08-15T23:36:48.917Z" level=info msg="finished unary call with code OK" catfile.duration_ms=7 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=7 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M03WJ0ATJFGMW6T21D976M2Y grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-15T23:37:18.708" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-15T23:36:48.908" grpc.time_ms=8.17 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2212gitlab # [ 421.178585] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-15T23:36:48.957Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"d6c9ac73ed746800ee172c53","created_at":"2026-08-15T23:36:45.439Z","trace_propagation_headers":{"sentry-trace":"94162400d1764c54b79f48e68f9cf918-79eaa2943a3c46a7","baggage":"sentry-trace_id=94162400d1764c54b79f48e68f9cf918,sentry-release=Unknown"},"correlation_id":"01M03WF6MBMNTJ2HBCR9P8JA54","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-08-15T23:36:45.452Z","job_size_bytes":23,"pid":3466,"sidekiq_tid":"m8s6","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-d6c9ac73ed746800ee172c53: start","job_status":"start","queue_duration_s":3.505233,"scheduling_latency_s":3.505253}2213gitlab # [ 421.195618] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-15T23:36:49.044Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"d6c9ac73ed746800ee172c53","created_at":"2026-08-15T23:36:45.439Z","trace_propagation_headers":{"sentry-trace":"94162400d1764c54b79f48e68f9cf918-79eaa2943a3c46a7","baggage":"sentry-trace_id=94162400d1764c54b79f48e68f9cf918,sentry-release=Unknown"},"correlation_id":"01M03WF6MBMNTJ2HBCR9P8JA54","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-08-15T23:36:45.452Z","job_size_bytes":23,"pid":3466,"sidekiq_tid":"m8s6","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-d6c9ac73ed746800ee172c53: done: 0.0877 sec","job_status":"done","queue_duration_s":3.505233,"scheduling_latency_s":3.505253,"redis_calls":10,"redis_duration_s":0.004393,"redis_read_bytes":9,"redis_write_bytes":1029,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000635,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001591,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":534,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002167,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":200,"db_count":15,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":11,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.004,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.004,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.066726,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00057442,"duration_s":0.0877,"completed_at":"2026-08-15T23:36:49.044Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.013183,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2214gitlab # [ 421.241990] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/08/15:23:36:49 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 872215gitlab # [ 421.244368] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/08/15:23:36:49 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/a67995a4626b5610cec8924c971f7239bbaa2866 HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 3592216gitlab # [ 421.246910] gitlab-workhorse[820]: time="2026-08-15T23:36:49Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672217gitlab # [ 421.249137] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/08/15:23:36:49 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 662218gitlab # [ 421.251075] gitaly[914]: time="2026-08-15T23:36:49.015Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=7 command.system_time_ms=0 command.user_time_ms=4 component=gitaly.StreamServerInterceptor correlation_id=01M03WJ0ATJFGMW6T21D976M2Y grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-15T23:36:59.002" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-15T23:36:49.003" grpc.time_ms=12.012 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2219gitlab # [ 421.265381] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-15T23:36:49.046Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"87ef2c9d58ebdd5b5a8e7afa","created_at":"2026-08-15T23:36:45.670Z","trace_propagation_headers":{"sentry-trace":"94162400d1764c54b79f48e68f9cf918-79eaa2943a3c46a7","baggage":"sentry-trace_id=94162400d1764c54b79f48e68f9cf918,sentry-release=Unknown"},"correlation_id":"01M03WF6MBMNTJ2HBCR9P8JA54","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-08-15T23:36:45.681Z","job_size_bytes":3,"pid":3466,"sidekiq_tid":"m8s6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-87ef2c9d58ebdd5b5a8e7afa: start","job_status":"start","queue_duration_s":3.364635,"scheduling_latency_s":3.364655}2220gitlab # [ 421.282218] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-15T23:36:49.084Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"87ef2c9d58ebdd5b5a8e7afa","created_at":"2026-08-15T23:36:45.670Z","trace_propagation_headers":{"sentry-trace":"94162400d1764c54b79f48e68f9cf918-79eaa2943a3c46a7","baggage":"sentry-trace_id=94162400d1764c54b79f48e68f9cf918,sentry-release=Unknown"},"correlation_id":"01M03WF6MBMNTJ2HBCR9P8JA54","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-08-15T23:36:45.681Z","job_size_bytes":3,"pid":3466,"sidekiq_tid":"m8s6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-87ef2c9d58ebdd5b5a8e7afa: done: 0.038437 sec","job_status":"done","queue_duration_s":3.364635,"scheduling_latency_s":3.364655,"redis_calls":10,"redis_duration_s":0.001462,"redis_read_bytes":9,"redis_write_bytes":1165,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000286,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000828,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000348,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":234,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.007,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024711,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0002413,"duration_s":0.038437,"completed_at":"2026-08-15T23:36:49.084Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007176,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2221gitlab # [ 421.327821] nixbot[3476]: {"ts": "2026-08-15T23:36:49.091Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/a67995a4626b5610cec8924c971f7239bbaa2866 \"HTTP/1.1 201 Created\""}2222gitlab # [ 421.330939] gitaly[914]: time="2026-08-15T23:36:49.073Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=579 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=2 command.system_time_ms=2 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M03WJ0JTQFMQD4S74Q1K9V98 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=185 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-15T23:36:49.063" grpc.time_ms=10.366 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc2223gitlab # [ 421.344595] gitaly[914]: time="2026-08-15T23:36:49.141Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M03WJ0NKAYRP90Z0YKT79762 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-15T23:36:49.133" pid=914 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2224gitlab # [ 421.354988] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-15T23:36:49.086Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"259495d4dc94a368ddde725a","created_at":"2026-08-15T23:36:45.703Z","trace_propagation_headers":{"sentry-trace":"94162400d1764c54b79f48e68f9cf918-79eaa2943a3c46a7","baggage":"sentry-trace_id=94162400d1764c54b79f48e68f9cf918,sentry-release=Unknown"},"correlation_id":"01M03WF6MBMNTJ2HBCR9P8JA54","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-08-15T23:36:45.719Z","job_size_bytes":3,"pid":3466,"sidekiq_tid":"m8s6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-259495d4dc94a368ddde725a: start","job_status":"start","queue_duration_s":3.36665,"scheduling_latency_s":3.366666}2225gitlab # [ 421.372512] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-15T23:36:49.122Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"259495d4dc94a368ddde725a","created_at":"2026-08-15T23:36:45.703Z","trace_propagation_headers":{"sentry-trace":"94162400d1764c54b79f48e68f9cf918-79eaa2943a3c46a7","baggage":"sentry-trace_id=94162400d1764c54b79f48e68f9cf918,sentry-release=Unknown"},"correlation_id":"01M03WF6MBMNTJ2HBCR9P8JA54","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-08-15T23:36:45.719Z","job_size_bytes":3,"pid":3466,"sidekiq_tid":"m8s6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-259495d4dc94a368ddde725a: done: 0.036812 sec","job_status":"done","queue_duration_s":3.36665,"scheduling_latency_s":3.366666,"redis_calls":10,"redis_duration_s":0.001387,"redis_read_bytes":9,"redis_write_bytes":1205,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000303,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000805,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000279,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026211,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0002311,"duration_s":0.036812,"completed_at":"2026-08-15T23:36:49.122Z","load_balancing_strategy":"primary","db_duration_s":0.004891,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2226gitlab # [ 421.417335] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/08/15:23:36:49 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 752227gitlab # [ 421.419384] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/08/15:23:36:49 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/a67995a4626b5610cec8924c971f7239bbaa2866 HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 1932228gitlab # [ 421.422056] gitaly[914]: time="2026-08-15T23:36:49.141Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=4 command.system_time_ms=2 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M03WJ0NKAYRP90Z0YKT79762 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-15T23:36:49.133" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc2229gitlab # [ 421.435942] nixbot[3476]: {"ts": "2026-08-15T23:36:49.292Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/a67995a4626b5610cec8924c971f7239bbaa2866 \"HTTP/1.1 201 Created\""}2230gitlab # [ 421.439312] nix-daemon[3691]: accepted connection from pid 4258, user nixbot2231gitlab # [ 421.440365] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-15T23:36:49.124Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"f14078dbcb3ce25f8a1a33db","created_at":"2026-08-15T23:36:45.749Z","trace_propagation_headers":{"sentry-trace":"94162400d1764c54b79f48e68f9cf918-79eaa2943a3c46a7","baggage":"sentry-trace_id=94162400d1764c54b79f48e68f9cf918,sentry-release=Unknown"},"correlation_id":"01M03WF6MBMNTJ2HBCR9P8JA54","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-08-15T23:36:45.761Z","job_size_bytes":3,"pid":3466,"sidekiq_tid":"m8s6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-f14078dbcb3ce25f8a1a33db: start","job_status":"start","queue_duration_s":3.362155,"scheduling_latency_s":3.362171}2232gitlab # [ 421.456372] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-15T23:36:49.170Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"f14078dbcb3ce25f8a1a33db","created_at":"2026-08-15T23:36:45.749Z","trace_propagation_headers":{"sentry-trace":"94162400d1764c54b79f48e68f9cf918-79eaa2943a3c46a7","baggage":"sentry-trace_id=94162400d1764c54b79f48e68f9cf918,sentry-release=Unknown"},"correlation_id":"01M03WF6MBMNTJ2HBCR9P8JA54","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-08-15T23:36:45.761Z","job_size_bytes":3,"pid":3466,"sidekiq_tid":"m8s6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-f14078dbcb3ce25f8a1a33db: done: 0.046572 sec","job_status":"done","queue_duration_s":3.362155,"scheduling_latency_s":3.362171,"redis_calls":13,"redis_duration_s":0.008185,"redis_read_bytes":66,"redis_write_bytes":1182,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000491,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002483,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.001804,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.003407,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.028183,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00071034,"duration_s":0.046572,"completed_at":"2026-08-15T23:36:49.170Z","load_balancing_strategy":"primary","db_duration_s":0.005096,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2233gitlab # [ 421.502257] gitlab-workhorse[820]: time="2026-08-15T23:36:49Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672234gitlab # [ 421.504117] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/08/15:23:36:49 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 812235gitlab # [ 421.506003] gitaly[914]: time="2026-08-15T23:36:49.142Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=4 command.system_time_ms=2 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M03WJ0NKAYRP90Z0YKT79762 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-15T23:36:49.133" grpc.time_ms=8.993 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc2236gitlab # [ 421.520923] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-15T23:36:49.174Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"4e3cac8a4771ba0cee6e3836","created_at":"2026-08-15T23:36:45.763Z","trace_propagation_headers":{"sentry-trace":"94162400d1764c54b79f48e68f9cf918-79eaa2943a3c46a7","baggage":"sentry-trace_id=94162400d1764c54b79f48e68f9cf918,sentry-release=Unknown"},"correlation_id":"01M03WF6MBMNTJ2HBCR9P8JA54","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-08-15T23:36:45.774Z","job_size_bytes":3,"pid":3466,"sidekiq_tid":"m8s6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-4e3cac8a4771ba0cee6e3836: start","job_status":"start","queue_duration_s":3.399981,"scheduling_latency_s":3.4}2237gitlab # [ 421.537758] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-15T23:36:49.225Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"4e3cac8a4771ba0cee6e3836","created_at":"2026-08-15T23:36:45.763Z","trace_propagation_headers":{"sentry-trace":"94162400d1764c54b79f48e68f9cf918-79eaa2943a3c46a7","baggage":"sentry-trace_id=94162400d1764c54b79f48e68f9cf918,sentry-release=Unknown"},"correlation_id":"01M03WF6MBMNTJ2HBCR9P8JA54","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-08-15T23:36:45.774Z","job_size_bytes":3,"pid":3466,"sidekiq_tid":"m8s6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-4e3cac8a4771ba0cee6e3836: done: 0.050711 sec","job_status":"done","queue_duration_s":3.399981,"scheduling_latency_s":3.4,"redis_calls":10,"redis_duration_s":0.0070869999999999995,"redis_read_bytes":9,"redis_write_bytes":1159,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.002434,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003081,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001572,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026901,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00027138,"duration_s":0.050711,"completed_at":"2026-08-15T23:36:49.225Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00874,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2238gitlab # [ 421.584365] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/08/15:23:36:49 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 602239gitlab # [ 421.586462] gitaly[914]: time="2026-08-15T23:36:49.159Z" level=info msg="finished unary call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M03WJ0P9KWQ3TNJF2W2G6MGQ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-15T23:37:19.054" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-15T23:36:49.155" grpc.time_ms=1.342 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2240gitlab # [ 421.599584] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-15T23:36:49.227Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"1b2f15a5452263b173b9088b","created_at":"2026-08-15T23:36:45.775Z","trace_propagation_headers":{"sentry-trace":"94162400d1764c54b79f48e68f9cf918-79eaa2943a3c46a7","baggage":"sentry-trace_id=94162400d1764c54b79f48e68f9cf918,sentry-release=Unknown"},"correlation_id":"01M03WF6MBMNTJ2HBCR9P8JA54","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-08-15T23:36:45.788Z","job_size_bytes":19,"pid":3466,"sidekiq_tid":"m8s6","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-1b2f15a5452263b173b9088b: start","job_status":"start","queue_duration_s":3.438799,"scheduling_latency_s":3.438827}2241gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a'2242gitlab # [ 421.616471] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-15T23:36:49.271Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"1b2f15a5452263b173b9088b","created_at":"2026-08-15T23:36:45.775Z","trace_propagation_headers":{"sentry-trace":"94162400d1764c54b79f48e68f9cf918-79eaa2943a3c46a7","baggage":"sentry-trace_id=94162400d1764c54b79f48e68f9cf918,sentry-release=Unknown"},"correlation_id":"01M03WF6MBMNTJ2HBCR9P8JA54","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-08-15T23:36:45.788Z","job_size_bytes":19,"pid":3466,"sidekiq_tid":"m8s6","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-1b2f15a5452263b173b9088b: done: 0.044203 sec","job_status":"done","queue_duration_s":3.438799,"scheduling_latency_s":3.438827,"redis_calls":11,"redis_duration_s":0.007940000000000001,"redis_read_bytes":10,"redis_write_bytes":1121,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000372,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":287,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.00494,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":640,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002628,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":194,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023441,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00096258,"duration_s":0.044203,"completed_at":"2026-08-15T23:36:49.271Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004922,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2243gitlab # [ 421.661465] gitaly[914]: time="2026-08-15T23:36:49.215Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=2 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M03WJ0P9KWQ3TNJF2W2G6MGQ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-15T23:36:59.202" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-15T23:36:49.202" grpc.time_ms=12.998 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2244gitlab # [ 421.674119] gitlab-workhorse[820]: time="2026-08-15T23:36:49Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2162245gitlab # [ 421.675808] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/08/15:23:36:49 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 216 "" "git/2.55.0" 912246gitlab # [ 421.677735] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-15T23:36:49.278Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"db8fd81d68491b71d56ea99e","created_at":"2026-08-15T23:36:45.795Z","trace_propagation_headers":{"sentry-trace":"94162400d1764c54b79f48e68f9cf918-79eaa2943a3c46a7","baggage":"sentry-trace_id=94162400d1764c54b79f48e68f9cf918,sentry-release=Unknown"},"correlation_id":"01M03WF6MBMNTJ2HBCR9P8JA54","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-08-15T23:36:45.804Z","job_size_bytes":66,"pid":3466,"sidekiq_tid":"m8s6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-db8fd81d68491b71d56ea99e: start","job_status":"start","queue_duration_s":3.474328,"scheduling_latency_s":3.474347}2247gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a', in 0.05 seconds)2248(finished: subtest: push delivers the webhook, in 94.01 seconds)2249subtest: eval and build post commit statuses2250gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/9ad17214e1c9d713186fc41ecac2f0b2682a968a/statuses2251gitlab # [ 421.695043] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-15T23:36:49.332Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"db8fd81d68491b71d56ea99e","created_at":"2026-08-15T23:36:45.795Z","trace_propagation_headers":{"sentry-trace":"94162400d1764c54b79f48e68f9cf918-79eaa2943a3c46a7","baggage":"sentry-trace_id=94162400d1764c54b79f48e68f9cf918,sentry-release=Unknown"},"correlation_id":"01M03WF6MBMNTJ2HBCR9P8JA54","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-08-15T23:36:45.804Z","job_size_bytes":66,"pid":3466,"sidekiq_tid":"m8s6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-db8fd81d68491b71d56ea99e: done: 0.05354 sec","job_status":"done","queue_duration_s":3.474328,"scheduling_latency_s":3.474347,"redis_calls":10,"redis_duration_s":0.011122,"redis_read_bytes":9,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.002801,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":335,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.006991,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00133,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":240,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.028217,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00064726,"duration_s":0.05354,"completed_at":"2026-08-15T23:36:49.332Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006421,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2252gitlab # [ 421.741332] gitaly[914]: time="2026-08-15T23:36:49.254Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=578 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M03WJ0RV01Z3FXRZQ6C1YVYR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=206 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-15T23:36:49.245" grpc.time_ms=8.847 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc2253gitlab # [ 421.754700] gitaly[914]: time="2026-08-15T23:36:49.338Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M03WJ0V9P2S6E2FE5KRAMMJG grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-15T23:36:49.330" pid=914 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2254gitlab # [ 421.765224] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-15T23:36:49.333Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"51a92d3ecd14ec37465deb41","created_at":"2026-08-15T23:36:45.806Z","trace_propagation_headers":{"sentry-trace":"94162400d1764c54b79f48e68f9cf918-79eaa2943a3c46a7","baggage":"sentry-trace_id=94162400d1764c54b79f48e68f9cf918,sentry-release=Unknown"},"correlation_id":"01M03WF6MBMNTJ2HBCR9P8JA54","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-08-15T23:36:45.814Z","job_size_bytes":3,"pid":3466,"sidekiq_tid":"m8s6","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-51a92d3ecd14ec37465deb41: start","job_status":"start","queue_duration_s":3.519078,"scheduling_latency_s":3.519096}2255gitlab # [ 421.783226] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-15T23:36:49.387Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"51a92d3ecd14ec37465deb41","created_at":"2026-08-15T23:36:45.806Z","trace_propagation_headers":{"sentry-trace":"94162400d1764c54b79f48e68f9cf918-79eaa2943a3c46a7","baggage":"sentry-trace_id=94162400d1764c54b79f48e68f9cf918,sentry-release=Unknown"},"correlation_id":"01M03WF6MBMNTJ2HBCR9P8JA54","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-08-15T23:36:45.814Z","job_size_bytes":3,"pid":3466,"sidekiq_tid":"m8s6","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-51a92d3ecd14ec37465deb41: done: 0.053405 sec","job_status":"done","queue_duration_s":3.519078,"scheduling_latency_s":3.519096,"redis_calls":10,"redis_duration_s":0.0074399999999999996,"redis_read_bytes":9,"redis_write_bytes":973,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001291,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":281,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.005821,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":506,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000328,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":186,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.033882,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00027752,"duration_s":0.053405,"completed_at":"2026-08-15T23:36:49.386Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007744,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2256gitlab # [ 421.829324] nixbot[3476]: INFO: ::ffff:127.0.0.1:40874 - "GET /api/repos/gitlab/root/test-flake/builds?commit=9ad17214e1c9d713186fc41ecac2f0b2682a968a HTTP/1.1" 200 OK2257gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/9ad17214e1c9d713186fc41ecac2f0b2682a968a/statuses, in 0.13 seconds)2258gitlab # [ 421.831311] gitaly[914]: time="2026-08-15T23:36:49.338Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=3 command.system_time_ms=2 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M03WJ0V9P2S6E2FE5KRAMMJG grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-15T23:36:49.330" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc2259gitlab # [ 421.844802] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-15T23:36:49.388Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"2556b78b4b5d75a66b6dd7c5","created_at":"2026-08-15T23:36:45.826Z","trace_propagation_headers":{"sentry-trace":"94162400d1764c54b79f48e68f9cf918-79eaa2943a3c46a7","baggage":"sentry-trace_id=94162400d1764c54b79f48e68f9cf918,sentry-release=Unknown"},"correlation_id":"01M03WF6MBMNTJ2HBCR9P8JA54","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-08-15T23:36:45.835Z","job_size_bytes":3,"pid":3466,"sidekiq_tid":"m8s6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-2556b78b4b5d75a66b6dd7c5: start","job_status":"start","queue_duration_s":3.552961,"scheduling_latency_s":3.552981}2260gitlab # [ 421.861702] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-15T23:36:49.428Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"2556b78b4b5d75a66b6dd7c5","created_at":"2026-08-15T23:36:45.826Z","trace_propagation_headers":{"sentry-trace":"94162400d1764c54b79f48e68f9cf918-79eaa2943a3c46a7","baggage":"sentry-trace_id=94162400d1764c54b79f48e68f9cf918,sentry-release=Unknown"},"correlation_id":"01M03WF6MBMNTJ2HBCR9P8JA54","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-08-15T23:36:45.835Z","job_size_bytes":3,"pid":3466,"sidekiq_tid":"m8s6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-2556b78b4b5d75a66b6dd7c5: done: 0.039961 sec","job_status":"done","queue_duration_s":3.552961,"scheduling_latency_s":3.552981,"redis_calls":10,"redis_duration_s":0.001596,"redis_read_bytes":9,"redis_write_bytes":1023,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00039,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000899,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000307,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":198,"db_count":7,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025656,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00021972,"duration_s":0.039961,"completed_at":"2026-08-15T23:36:49.428Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.008154,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2261gitlab # [ 421.906372] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/08/15:23:36:49 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/9ad17214e1c9d713186fc41ecac2f0b2682a968a/statuses HTTP/1.1" 200 2 "" "curl/8.21.0" 842262gitlab # [ 421.909025] gitaly[914]: time="2026-08-15T23:36:49.339Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=3 command.system_time_ms=2 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M03WJ0V9P2S6E2FE5KRAMMJG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-15T23:36:49.330" grpc.time_ms=8.929 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc2263gitlab # [ 421.923830] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-15T23:36:49.429Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"24c71032d9c5792ebafba466","created_at":"2026-08-15T23:36:45.836Z","trace_propagation_headers":{"sentry-trace":"94162400d1764c54b79f48e68f9cf918-79eaa2943a3c46a7","baggage":"sentry-trace_id=94162400d1764c54b79f48e68f9cf918,sentry-release=Unknown"},"correlation_id":"01M03WF6MBMNTJ2HBCR9P8JA54","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-15T23:36:45.843Z","job_size_bytes":6,"pid":3466,"sidekiq_tid":"m8s6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-24c71032d9c5792ebafba466: start","job_status":"start","queue_duration_s":3.586329,"scheduling_latency_s":3.586351}2264gitlab # [ 421.940404] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-15T23:36:49.453Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"24c71032d9c5792ebafba466","created_at":"2026-08-15T23:36:45.836Z","trace_propagation_headers":{"sentry-trace":"94162400d1764c54b79f48e68f9cf918-79eaa2943a3c46a7","baggage":"sentry-trace_id=94162400d1764c54b79f48e68f9cf918,sentry-release=Unknown"},"correlation_id":"01M03WF6MBMNTJ2HBCR9P8JA54","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-15T23:36:45.843Z","job_size_bytes":6,"pid":3466,"sidekiq_tid":"m8s6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-24c71032d9c5792ebafba466: done: 0.023983 sec","job_status":"done","queue_duration_s":3.586329,"scheduling_latency_s":3.586351,"redis_calls":10,"redis_duration_s":0.0014680000000000001,"redis_read_bytes":9,"redis_write_bytes":1127,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000275,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":321,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000857,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000336,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":224,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014691,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00028618,"duration_s":0.023983,"completed_at":"2026-08-15T23:36:49.453Z","load_balancing_strategy":"primary","db_duration_s":0.001817,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2265gitlab # [ 421.986693] gitaly[914]: time="2026-08-15T23:36:49.432Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=578 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=0 command.user_time_ms=5 component=gitaly.StreamServerInterceptor correlation_id=01M03WJ0YVNFMH2YWHC8QBZEK2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=190 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-15T23:36:49.423" grpc.time_ms=8.86 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc2266gitlab # [ 422.001096] gitaly[914]: time="2026-08-15T23:36:49.525Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M03WJ10VA7K5YCG95P61JBCC grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-15T23:36:49.494" pid=914 remote_ip="2001:db8:1::1" request_sha=22300437632a556c435888000544c7c9bb3428e9 response_bytes=216 span.kind=server system=grpc2267gitlab # [ 422.011771] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-15T23:36:49.455Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"64fa7dc089c7cb0e1385b5da","created_at":"2026-08-15T23:36:45.844Z","trace_propagation_headers":{"sentry-trace":"94162400d1764c54b79f48e68f9cf918-79eaa2943a3c46a7","baggage":"sentry-trace_id=94162400d1764c54b79f48e68f9cf918,sentry-release=Unknown"},"correlation_id":"01M03WF6MBMNTJ2HBCR9P8JA54","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-08-15T23:36:45.852Z","job_size_bytes":3,"pid":3466,"sidekiq_tid":"m8s6","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-64fa7dc089c7cb0e1385b5da: start","job_status":"start","queue_duration_s":3.602531,"scheduling_latency_s":3.60255}2268gitlab # [ 422.027710] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-15T23:36:49.490Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"64fa7dc089c7cb0e1385b5da","created_at":"2026-08-15T23:36:45.844Z","trace_propagation_headers":{"sentry-trace":"94162400d1764c54b79f48e68f9cf918-79eaa2943a3c46a7","baggage":"sentry-trace_id=94162400d1764c54b79f48e68f9cf918,sentry-release=Unknown"},"correlation_id":"01M03WF6MBMNTJ2HBCR9P8JA54","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-08-15T23:36:45.852Z","job_size_bytes":3,"pid":3466,"sidekiq_tid":"m8s6","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-64fa7dc089c7cb0e1385b5da: done: 0.034974 sec","job_status":"done","queue_duration_s":3.602531,"scheduling_latency_s":3.60255,"redis_calls":10,"redis_duration_s":0.001577,"redis_read_bytes":9,"redis_write_bytes":989,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000273,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":285,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000925,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":514,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000379,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":190,"db_count":7,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023771,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00036838,"duration_s":0.034974,"completed_at":"2026-08-15T23:36:49.490Z","load_balancing_strategy":"primary","db_duration_s":0.005337,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2269gitlab # [ 422.072185] gitaly[914]: time="2026-08-15T23:36:49.525Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=21 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1102 command.oublock=0 command.real_time_ms=26 command.spawn_token_fork_ms=2 command.system_time_ms=21 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M03WJ10VA7K5YCG95P61JBCC grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-15T23:36:49.494" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc2270gitlab # [ 422.086653] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-15T23:36:49.491Z","retry":25,"queue":"default","version":0,"store":null,"args":["1"],"class":"Ci::TrackFirstPipelineSucceededWorker","jid":"8f7b0c6867b437ca332a228c","created_at":"2026-08-15T23:36:45.862Z","trace_propagation_headers":{"sentry-trace":"94162400d1764c54b79f48e68f9cf918-79eaa2943a3c46a7","baggage":"sentry-trace_id=94162400d1764c54b79f48e68f9cf918,sentry-release=Unknown"},"correlation_id":"01M03WF6MBMNTJ2HBCR9P8JA54","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c5d2c9faee55896683425d4b50feeb49f6074c2dda34904072dea18e4eda0a9b","size_limiter":"validated","enqueued_at":"2026-08-15T23:36:45.869Z","job_size_bytes":3,"pid":3466,"sidekiq_tid":"m8s6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackFirstPipelineSucceededWorker JID-8f7b0c6867b437ca332a228c: start","job_status":"start","queue_duration_s":3.622442,"scheduling_latency_s":3.622457}2271gitlab # [ 422.103298] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-15T23:36:49.559Z","retry":25,"queue":"default","version":0,"store":null,"args":["1"],"class":"Ci::TrackFirstPipelineSucceededWorker","jid":"8f7b0c6867b437ca332a228c","created_at":"2026-08-15T23:36:45.862Z","trace_propagation_headers":{"sentry-trace":"94162400d1764c54b79f48e68f9cf918-79eaa2943a3c46a7","baggage":"sentry-trace_id=94162400d1764c54b79f48e68f9cf918,sentry-release=Unknown"},"correlation_id":"01M03WF6MBMNTJ2HBCR9P8JA54","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c5d2c9faee55896683425d4b50feeb49f6074c2dda34904072dea18e4eda0a9b","size_limiter":"validated","enqueued_at":"2026-08-15T23:36:45.869Z","job_size_bytes":3,"pid":3466,"sidekiq_tid":"m8s6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackFirstPipelineSucceededWorker JID-8f7b0c6867b437ca332a228c: done: 0.067312 sec","job_status":"done","queue_duration_s":3.622442,"scheduling_latency_s":3.622457,"redis_calls":14,"redis_duration_s":0.003409,"redis_read_bytes":14,"redis_write_bytes":1335,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000303,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":317,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001323,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001783,"redis_shared_state_read_bytes":8,"redis_shared_state_write_bytes":436,"db_count":12,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.013,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.045343,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00033014,"duration_s":0.067312,"completed_at":"2026-08-15T23:36:49.558Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.014582,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2272gitlab # [ 422.148532] gitaly[914]: time="2026-08-15T23:36:49.526Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=21 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1102 command.oublock=0 command.real_time_ms=26 command.spawn_token_fork_ms=2 command.system_time_ms=21 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M03WJ10VA7K5YCG95P61JBCC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-15T23:36:49.494" grpc.time_ms=31.597 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc2273gitlab # [ 422.163728] nixbot[3476]: {"ts": "2026-08-15T23:36:50.022Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/9ad17214e1c9d713186fc41ecac2f0b2682a968a \"HTTP/1.1 201 Created\""}2274gitlab # [ 422.166784] nixbot[3476]: {"ts": "2026-08-15T23:36:50.036Z", "level": "info", "logger": "nixbot.flake_prefetch", "msg": "prefetching flake inputs", "flake_dir": "/var/lib/nixbot/worktrees/1-9ad17214e1c9-4"}2275gitlab # [ 422.169280] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-15T23:36:49.560Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"1dbbaddbe6ae037ecb5772be","created_at":"2026-08-15T23:36:46.100Z","trace_propagation_headers":{"sentry-trace":"e642f789365f4b808c24da962532a593-ddb284383f1048fc","baggage":"sentry-trace_id=e642f789365f4b808c24da962532a593,sentry-release=Unknown"},"correlation_id":"01M03WF0TYS012C2C6MKGWJ80W","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-08-15T23:36:46.106Z","job_size_bytes":3,"pid":3466,"sidekiq_tid":"m8s6","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-1dbbaddbe6ae037ecb5772be: start","job_status":"start","queue_duration_s":3.454124,"scheduling_latency_s":3.454144}2276gitlab # [ 422.187114] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-15T23:36:49.640Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"1dbbaddbe6ae037ecb5772be","created_at":"2026-08-15T23:36:46.100Z","trace_propagation_headers":{"sentry-trace":"e642f789365f4b808c24da962532a593-ddb284383f1048fc","baggage":"sentry-trace_id=e642f789365f4b808c24da962532a593,sentry-release=Unknown"},"correlation_id":"01M03WF0TYS012C2C6MKGWJ80W","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-08-15T23:36:46.106Z","job_size_bytes":3,"pid":3466,"sidekiq_tid":"m8s6","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-1dbbaddbe6ae037ecb5772be: done: 0.079457 sec","job_status":"done","queue_duration_s":3.454124,"scheduling_latency_s":3.454144,"redis_calls":19,"redis_duration_s":0.015745000000000002,"redis_read_bytes":21,"redis_write_bytes":4292,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.00617,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":678,"redis_queues_calls":3,"redis_queues_duration_s":0.002253,"redis_queues_read_bytes":3,"redis_queues_write_bytes":2263,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.006191,"redis_queues_metadata_read_bytes":9,"redis_queues_metadata_write_bytes":1024,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.001131,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":327,"db_count":7,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.013,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.005,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.005,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.013,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.04222,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.01558214,"duration_s":0.079457,"completed_at":"2026-08-15T23:36:49.639Z","load_balancing_strategy":"primary","db_duration_s":0.019078,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2277gitlab # [ 422.233447] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/08/15:23:36:50 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/9ad17214e1c9d713186fc41ecac2f0b2682a968a HTTP/1.1" 201 631 "" "python-httpx/0.28.1" 4452278gitlab # [ 422.236334] gitaly[914]: time="2026-08-15T23:36:49.692Z" level=info msg="finished unary call with code OK" catfile.duration_ms=7 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=7 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M03WJ156QH4ZG73CRQDPZ63D grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-15T23:37:19.483" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-15T23:36:49.684" grpc.time_ms=8.357 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2279gitlab # [ 422.249574] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-15T23:36:49.643Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","952ca3895458a81ef61863f9"],"class":"WebHooks::LogExecutionWorker","jid":"12d4084373ddf98a7f5bd4e5","created_at":"2026-08-15T23:36:47.768Z","trace_propagation_headers":{"sentry-trace":"e642f789365f4b808c24da962532a593-0e9c92b8df5c445b","baggage":"sentry-trace_id=e642f789365f4b808c24da962532a593,sentry-release=Unknown"},"correlation_id":"01M03WF0TYS012C2C6MKGWJ80W","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c3087357644f09ab8b7a8783a9fce0d446338d428caf71b31d052f62bac58de2","size_limiter":"validated","enqueued_at":"2026-08-15T23:36:47.782Z","job_size_bytes":2593,"pid":3466,"sidekiq_tid":"m8s6","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-12d4084373ddf98a7f5bd4e5: start","job_status":"start","queue_duration_s":1.861455,"scheduling_latency_s":1.861474}2280gitlab # [ 422.267201] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-15T23:36:49.710Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","952ca3895458a81ef61863f9"],"class":"WebHooks::LogExecutionWorker","jid":"12d4084373ddf98a7f5bd4e5","created_at":"2026-08-15T23:36:47.768Z","trace_propagation_headers":{"sentry-trace":"e642f789365f4b808c24da962532a593-0e9c92b8df5c445b","baggage":"sentry-trace_id=e642f789365f4b808c24da962532a593,sentry-release=Unknown"},"correlation_id":"01M03WF0TYS012C2C6MKGWJ80W","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c3087357644f09ab8b7a8783a9fce0d446338d428caf71b31d052f62bac58de2","size_limiter":"validated","enqueued_at":"2026-08-15T23:36:47.782Z","job_size_bytes":2593,"pid":3466,"sidekiq_tid":"m8s6","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-12d4084373ddf98a7f5bd4e5: done: 0.066475 sec","job_status":"done","queue_duration_s":1.861455,"scheduling_latency_s":1.861474,"redis_calls":10,"redis_duration_s":0.005041,"redis_read_bytes":9,"redis_write_bytes":1045,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000364,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003128,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001549,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":4,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.014,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.007,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.007,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.014,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.039198,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00047176,"duration_s":0.066475,"completed_at":"2026-08-15T23:36:49.710Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.017965,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2281gitlab # [ 422.313111] nix-daemon[3691]: accepted connection from pid 4356, user nixbot2282gitlab # [ 422.314099] gitaly[914]: time="2026-08-15T23:36:49.713Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M03WJ17S4P9Y0GYEAB0Z61YF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-15T23:37:19.612" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-15T23:36:49.712" grpc.time_ms=0.472 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2283gitlab # [ 422.327158] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-15T23:36:49.712Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"8345fa7994f79e5f25df5fc4","created_at":"2026-08-15T23:36:48.647Z","trace_propagation_headers":{"sentry-trace":"acdb942336a746c6bf4a86c128604b26-6c944f82fd854941","baggage":"sentry-trace_id=acdb942336a746c6bf4a86c128604b26,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M03WHZQ7AZVVC52VN7K3KAGA","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-15T23:36:48.663Z","job_size_bytes":3,"pid":3466,"sidekiq_tid":"m8s6","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-8345fa7994f79e5f25df5fc4: start","job_status":"start","queue_duration_s":1.048908,"scheduling_latency_s":1.04893}2284gitlab # [ 422.343942] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-15T23:36:50.025Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"8345fa7994f79e5f25df5fc4","created_at":"2026-08-15T23:36:48.647Z","trace_propagation_headers":{"sentry-trace":"acdb942336a746c6bf4a86c128604b26-6c944f82fd854941","baggage":"sentry-trace_id=acdb942336a746c6bf4a86c128604b26,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M03WHZQ7AZVVC52VN7K3KAGA","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-15T23:36:48.663Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":3466,"job_status":"rescheduled","message":"PipelineProcessWorker JID-8345fa7994f79e5f25df5fc4: rescheduled"}2285gitlab # [ 422.359443] nix-daemon[3691]: accepted connection from pid 4364, user nixbot2286gitlab # [ 422.360453] gitaly[914]: time="2026-08-15T23:36:49.739Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=590 command.oublock=0 command.real_time_ms=20 command.spawn_token_fork_ms=7 command.system_time_ms=11 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M03WJ156QH4ZG73CRQDPZ63D grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-08-15T23:37:19.511" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-08-15T23:36:49.712" grpc.time_ms=21.991 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2287gitlab # [ 422.374577] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-15T23:36:50.033Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"8345fa7994f79e5f25df5fc4","created_at":"2026-08-15T23:36:48.647Z","trace_propagation_headers":{"sentry-trace":"acdb942336a746c6bf4a86c128604b26-6c944f82fd854941","baggage":"sentry-trace_id=acdb942336a746c6bf4a86c128604b26,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M03WHZQ7AZVVC52VN7K3KAGA","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-15T23:36:48.663Z","job_size_bytes":3,"pid":3466,"sidekiq_tid":"m8s6","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-8345fa7994f79e5f25df5fc4: done: 0.321231 sec","job_status":"done","queue_duration_s":1.048908,"scheduling_latency_s":1.04893,"gitaly_calls":3,"gitaly_duration_s":0.122161,"redis_calls":66,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.026539,"redis_read_bytes":150,"redis_write_bytes":18011,"redis_action_cable_calls":2,"redis_action_cable_duration_s":0.000419,"redis_action_cable_read_bytes":2,"redis_action_cable_write_bytes":407,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.002834,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_queues_calls":22,"redis_queues_duration_s":0.005595,"redis_queues_read_bytes":28,"redis_queues_write_bytes":12310,"redis_queues_metadata_calls":19,"redis_queues_metadata_duration_s":0.013858,"redis_queues_metadata_read_bytes":30,"redis_queues_metadata_write_bytes":3093,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000216,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000421,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.002777,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":30,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":30,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.036,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":16,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":2,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.007,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.007,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.02,"db_ci_duration_s":0.016,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.14286,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.26670664,"duration_s":0.321231,"completed_at":"2026-08-15T23:36:50.033Z","load_balancing_strategy":"primary","db_duration_s":0.03676,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2288gitlab # [ 422.428868] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-15T23:36:50.036Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","d0836dd23cfb37648952c18f"],"class":"WebHooks::LogExecutionWorker","jid":"27b109968c59c23cb0062f67","created_at":"2026-08-15T23:36:48.941Z","trace_propagation_headers":{"sentry-trace":"28844c8b7c24426ba33e625652b4f071-cb16370de77940fc","baggage":"sentry-trace_id=28844c8b7c24426ba33e625652b4f071,sentry-release=Unknown"},"correlation_id":"01M03WF5R22ZWTRYS8YY2WF6CG","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6bdd6fb5ea97ed4e3ec5435076669fd2c99873df76d36c6102d788ff293b268e","size_limiter":"validated","enqueued_at":"2026-08-15T23:36:48.944Z","job_size_bytes":2592,"pid":3466,"sidekiq_tid":"m8s6","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-27b109968c59c23cb0062f67: start","job_status":"start","queue_duration_s":1.092097,"scheduling_latency_s":1.092125}2289gitlab # [ 422.446224] nixbot[3476]: {"ts": "2026-08-15T23:36:50.250Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-9ad17214e1c9-4", "argv0": "bwrap"}2290gitlab # [ 422.448611] gitaly[914]: time="2026-08-15T23:36:49.753Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M03WJ156QH4ZG73CRQDPZ63D grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-15T23:36:59.275" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-15T23:36:49.745" grpc.time_ms=8.153 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2291gitlab # [ 422.462127] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-15T23:36:50.065Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","d0836dd23cfb37648952c18f"],"class":"WebHooks::LogExecutionWorker","jid":"27b109968c59c23cb0062f67","created_at":"2026-08-15T23:36:48.941Z","trace_propagation_headers":{"sentry-trace":"28844c8b7c24426ba33e625652b4f071-cb16370de77940fc","baggage":"sentry-trace_id=28844c8b7c24426ba33e625652b4f071,sentry-release=Unknown"},"correlation_id":"01M03WF5R22ZWTRYS8YY2WF6CG","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6bdd6fb5ea97ed4e3ec5435076669fd2c99873df76d36c6102d788ff293b268e","size_limiter":"validated","enqueued_at":"2026-08-15T23:36:48.944Z","job_size_bytes":2592,"pid":3466,"sidekiq_tid":"m8s6","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-27b109968c59c23cb0062f67: done: 0.029159 sec","job_status":"done","queue_duration_s":1.092097,"scheduling_latency_s":1.092125,"redis_calls":7,"redis_duration_s":0.0017599999999999998,"redis_read_bytes":5,"redis_write_bytes":671,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001235,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000525,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":3,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.004,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.004,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019353,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.029159,"completed_at":"2026-08-15T23:36:50.065Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004372,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2292gitlab # [ 422.506301] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-15T23:36:50.067Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"119f78b0dd56ddcb0ffc5ad0","created_at":"2026-08-15T23:36:49.617Z","trace_propagation_headers":{"sentry-trace":"e642f789365f4b808c24da962532a593-0e77743fe3ce45dc","baggage":"sentry-trace_id=e642f789365f4b808c24da962532a593,sentry-release=Unknown"},"correlation_id":"01M03WF0TYS012C2C6MKGWJ80W","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-08-15T23:36:49.628Z","job_size_bytes":3,"pid":3466,"sidekiq_tid":"m8s6","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-119f78b0dd56ddcb0ffc5ad0: start","job_status":"start","queue_duration_s":0.438679,"scheduling_latency_s":0.438698}2293gitlab # [ 422.523949] gitaly[914]: time="2026-08-15T23:36:49.805Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M03WJ156QH4ZG73CRQDPZ63D grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-08-15T23:36:59.004" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-15T23:36:49.804" grpc.time_ms=0.409 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2294gitlab # [ 422.535166] gitaly[914]: time="2026-08-15T23:36:49.827Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M03WHZQ7AZVVC52VN7K3KAGA grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3896 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-15T23:36:49.824" grpc.time_ms=2.316 pid=914 span.kind=server system=grpc2295gitlab # [ 422.545207] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-15T23:36:50.171Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"119f78b0dd56ddcb0ffc5ad0","created_at":"2026-08-15T23:36:49.617Z","trace_propagation_headers":{"sentry-trace":"e642f789365f4b808c24da962532a593-0e77743fe3ce45dc","baggage":"sentry-trace_id=e642f789365f4b808c24da962532a593,sentry-release=Unknown"},"correlation_id":"01M03WF0TYS012C2C6MKGWJ80W","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-08-15T23:36:49.628Z","job_size_bytes":3,"pid":3466,"sidekiq_tid":"m8s6","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-119f78b0dd56ddcb0ffc5ad0: done: 0.104316 sec","job_status":"done","queue_duration_s":0.438679,"scheduling_latency_s":0.438698,"redis_calls":11,"redis_duration_s":0.00479,"redis_read_bytes":10,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.002414,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001908,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":672,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000468,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":210,"db_count":12,"db_write_count":3,"db_cached_count":0,"db_txn_count":3,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.017,"db_main_txn_count":3,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.006,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.013,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.017,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.065895,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00033606,"duration_s":0.104316,"completed_at":"2026-08-15T23:36:50.171Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.032292,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2296gitlab # [ 422.590972] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-15T23:36:50.173Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"336ba75bc11374428097c5e1","created_at":"2026-08-15T23:36:49.790Z","trace_propagation_headers":{"sentry-trace":"acdb942336a746c6bf4a86c128604b26-c95d8488eee44667","baggage":"sentry-trace_id=acdb942336a746c6bf4a86c128604b26,sentry-release=Unknown"},"correlation_id":"01M03WHZQ7AZVVC52VN7K3KAGA","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-08-15T23:36:49.792Z","job_size_bytes":23,"pid":3466,"sidekiq_tid":"m8s6","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-336ba75bc11374428097c5e1: start","job_status":"start","queue_duration_s":0.380452,"scheduling_latency_s":0.380469}2297gitlab # [ 422.608129] gitaly[914]: time="2026-08-15T23:36:49.827Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=1 command.system_time_ms=10 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M03WJ156QH4ZG73CRQDPZ63D grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-08-15T23:36:59.012" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-15T23:36:49.813" grpc.time_ms=14.413 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2298gitlab # [ 422.623258] gitaly[914]: time="2026-08-15T23:36:49.867Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M03WJ156QH4ZG73CRQDPZ63D grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4152 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-15T23:36:49.865" grpc.time_ms=1.051 pid=914 span.kind=server system=grpc2299gitlab # [ 422.633539] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-15T23:36:50.220Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"336ba75bc11374428097c5e1","created_at":"2026-08-15T23:36:49.790Z","trace_propagation_headers":{"sentry-trace":"acdb942336a746c6bf4a86c128604b26-c95d8488eee44667","baggage":"sentry-trace_id=acdb942336a746c6bf4a86c128604b26,sentry-release=Unknown"},"correlation_id":"01M03WHZQ7AZVVC52VN7K3KAGA","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-08-15T23:36:49.792Z","job_size_bytes":23,"pid":3466,"sidekiq_tid":"m8s6","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-336ba75bc11374428097c5e1: done: 0.047075 sec","job_status":"done","queue_duration_s":0.380452,"scheduling_latency_s":0.380469,"redis_calls":7,"redis_duration_s":0.0019529999999999999,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001434,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000519,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.032323,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.047075,"completed_at":"2026-08-15T23:36:50.220Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.011155,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2300gitlab # [ 422.677173] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-15T23:36:50.221Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"1739ce64b027288de5ccd9d0","created_at":"2026-08-15T23:36:49.916Z","trace_propagation_headers":{"sentry-trace":"acdb942336a746c6bf4a86c128604b26-c95d8488eee44667","baggage":"sentry-trace_id=acdb942336a746c6bf4a86c128604b26,sentry-release=Unknown"},"correlation_id":"01M03WHZQ7AZVVC52VN7K3KAGA","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-08-15T23:36:49.918Z","job_size_bytes":3,"pid":3466,"sidekiq_tid":"m8s6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-1739ce64b027288de5ccd9d0: start","job_status":"start","queue_duration_s":0.302811,"scheduling_latency_s":0.302829}2301gitlab # [ 422.694166] gitaly[914]: time="2026-08-15T23:36:49.867Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M03WHZQ7AZVVC52VN7K3KAGA grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-15T23:36:49.866" grpc.time_ms=0.409 pid=914 span.kind=server system=grpc2302gitlab # [ 422.704114] gitaly[914]: time="2026-08-15T23:36:49.895Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M03WJ156QH4ZG73CRQDPZ63D grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4154 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-15T23:36:49.895" grpc.time_ms=0.355 pid=914 span.kind=server system=grpc2303gitlab # [ 422.714258] nix-daemon[3691]: accepted connection from pid 4375, user nixbot2304gitlab # [ 422.715232] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-15T23:36:50.250Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"1739ce64b027288de5ccd9d0","created_at":"2026-08-15T23:36:49.916Z","trace_propagation_headers":{"sentry-trace":"acdb942336a746c6bf4a86c128604b26-c95d8488eee44667","baggage":"sentry-trace_id=acdb942336a746c6bf4a86c128604b26,sentry-release=Unknown"},"correlation_id":"01M03WHZQ7AZVVC52VN7K3KAGA","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-08-15T23:36:49.918Z","job_size_bytes":3,"pid":3466,"sidekiq_tid":"m8s6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-1739ce64b027288de5ccd9d0: done: 0.029083 sec","job_status":"done","queue_duration_s":0.302811,"scheduling_latency_s":0.302829,"redis_calls":7,"redis_duration_s":0.002124,"redis_read_bytes":5,"redis_write_bytes":746,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001627,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000497,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":234,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020248,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.029083,"completed_at":"2026-08-15T23:36:50.250Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004094,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2305gitlab # [ 422.758859] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-15T23:36:50.252Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"f1da3bbf2f4d557f4c720526","created_at":"2026-08-15T23:36:49.920Z","trace_propagation_headers":{"sentry-trace":"ca892a4fb973404b8dd624110dbcd22d-3365498df5674dc2","baggage":"sentry-trace_id=ca892a4fb973404b8dd624110dbcd22d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M03WJ156QH4ZG73CRQDPZ63D","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-08-15T23:36:49.925Z","job_size_bytes":65,"pid":3466,"sidekiq_tid":"m8s6","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-f1da3bbf2f4d557f4c720526: start","job_status":"start","queue_duration_s":0.326553,"scheduling_latency_s":0.326571}2306gitlab # [ 422.775891] gitaly[914]: time="2026-08-15T23:36:49.902Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M03WHZQ7AZVVC52VN7K3KAGA grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3896 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-15T23:36:49.901" grpc.time_ms=0.406 pid=914 span.kind=server system=grpc2307gitlab # [ 422.786428] gitaly[914]: time="2026-08-15T23:36:49.904Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M03WJ156QH4ZG73CRQDPZ63D diskcache=28855a76-4718-4534-b42f-d506f33c2610 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-15T23:36:59.031" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-15T23:36:49.831" pid=914 ref=refs/keep-around/9ad17214e1c9d713186fc41ecac2f0b2682a968a remote_ip="2001:db8:1::1" revision=9ad17214e1c9d713186fc41ecac2f0b2682a968a span.kind=server system=grpc username=root2308gitlab # [ 422.798416] nix-daemon[3691]: accepted connection from pid 4385, user nixbot2309gitlab # [ 422.799351] nix-daemon[3691]: accepted connection from pid 4375, user nixbot2310gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/9ad17214e1c9d713186fc41ecac2f0b2682a968a/statuses2311gitlab # [ 422.800326] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-15T23:36:50.288Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"f1da3bbf2f4d557f4c720526","created_at":"2026-08-15T23:36:49.920Z","trace_propagation_headers":{"sentry-trace":"ca892a4fb973404b8dd624110dbcd22d-3365498df5674dc2","baggage":"sentry-trace_id=ca892a4fb973404b8dd624110dbcd22d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M03WJ156QH4ZG73CRQDPZ63D","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-08-15T23:36:49.925Z","job_size_bytes":65,"pid":3466,"sidekiq_tid":"m8s6","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-f1da3bbf2f4d557f4c720526: done: 0.036281 sec","job_status":"done","queue_duration_s":0.326553,"scheduling_latency_s":0.326571,"redis_calls":7,"redis_duration_s":0.002955,"redis_read_bytes":5,"redis_write_bytes":731,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001534,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":503,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001421,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":228,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021047,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.036281,"completed_at":"2026-08-15T23:36:50.288Z","load_balancing_strategy":"primary","db_duration_s":0.007716,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2312gitlab # [ 422.845418] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-15T23:36:50.290Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"70be249cbcc8817768ea42e0","created_at":"2026-08-15T23:36:49.924Z","trace_propagation_headers":{"sentry-trace":"acdb942336a746c6bf4a86c128604b26-c95d8488eee44667","baggage":"sentry-trace_id=acdb942336a746c6bf4a86c128604b26,sentry-release=Unknown"},"correlation_id":"01M03WHZQ7AZVVC52VN7K3KAGA","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-08-15T23:36:49.929Z","job_size_bytes":3,"pid":3466,"sidekiq_tid":"m8s6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-70be249cbcc8817768ea42e0: start","job_status":"start","queue_duration_s":0.360295,"scheduling_latency_s":0.360311}2313gitlab # [ 422.860504] gitaly[914]: time="2026-08-15T23:36:49.905Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=63 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5252 command.oublock=8 command.real_time_ms=65 command.spawn_token_fork_ms=0 command.system_time_ms=31 command.user_time_ms=32 component=gitaly.UnaryServerInterceptor correlation_id=01M03WJ156QH4ZG73CRQDPZ63D grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-15T23:36:59.031" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-15T23:36:49.831" grpc.time_ms=73.09 pid=914 ref=refs/keep-around/9ad17214e1c9d713186fc41ecac2f0b2682a968a remote_ip="2001:db8:1::1" revision=9ad17214e1c9d713186fc41ecac2f0b2682a968a span.kind=server system=grpc username=root2314gitlab # [ 422.874164] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-15T23:36:50.322Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"70be249cbcc8817768ea42e0","created_at":"2026-08-15T23:36:49.924Z","trace_propagation_headers":{"sentry-trace":"acdb942336a746c6bf4a86c128604b26-c95d8488eee44667","baggage":"sentry-trace_id=acdb942336a746c6bf4a86c128604b26,sentry-release=Unknown"},"correlation_id":"01M03WHZQ7AZVVC52VN7K3KAGA","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-08-15T23:36:49.929Z","job_size_bytes":3,"pid":3466,"sidekiq_tid":"m8s6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-70be249cbcc8817768ea42e0: done: 0.032562 sec","job_status":"done","queue_duration_s":0.360295,"scheduling_latency_s":0.360311,"redis_calls":7,"redis_duration_s":0.001957,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00142,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000537,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.008,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020243,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.032562,"completed_at":"2026-08-15T23:36:50.322Z","load_balancing_strategy":"primary","db_duration_s":0.008186,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2315gitlab # [ 422.915631] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-15T23:36:50.324Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"b55576e1cd9d6bd18ba87aca","created_at":"2026-08-15T23:36:49.926Z","trace_propagation_headers":{"sentry-trace":"ca892a4fb973404b8dd624110dbcd22d-3365498df5674dc2","baggage":"sentry-trace_id=ca892a4fb973404b8dd624110dbcd22d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M03WJ156QH4ZG73CRQDPZ63D","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-08-15T23:36:49.931Z","job_size_bytes":65,"pid":3466,"sidekiq_tid":"m8s6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-b55576e1cd9d6bd18ba87aca: start","job_status":"start","queue_duration_s":0.392637,"scheduling_latency_s":0.392656}2316gitlab # [ 422.933799] gitaly[914]: time="2026-08-15T23:36:49.908Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M03WJ156QH4ZG73CRQDPZ63D grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-15T23:37:19.707" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-15T23:36:49.907" grpc.time_ms=0.307 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2317gitlab # [ 422.946928] gitaly[914]: time="2026-08-15T23:36:49.908Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M03WHZQ7AZVVC52VN7K3KAGA diskcache=90b2e797-4f9a-47a8-a221-3d4a7abd2381 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-15T23:37:19.800" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-15T23:36:49.801" pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2318gitlab # [ 422.956950] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-15T23:36:50.391Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"b55576e1cd9d6bd18ba87aca","created_at":"2026-08-15T23:36:49.926Z","trace_propagation_headers":{"sentry-trace":"ca892a4fb973404b8dd624110dbcd22d-3365498df5674dc2","baggage":"sentry-trace_id=ca892a4fb973404b8dd624110dbcd22d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M03WJ156QH4ZG73CRQDPZ63D","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-08-15T23:36:49.931Z","job_size_bytes":65,"pid":3466,"sidekiq_tid":"m8s6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-b55576e1cd9d6bd18ba87aca: done: 0.067458 sec","job_status":"done","queue_duration_s":0.392637,"scheduling_latency_s":0.392656,"redis_calls":10,"redis_duration_s":0.0038849999999999996,"redis_read_bytes":14,"redis_write_bytes":857,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002201,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":494,"redis_shared_state_calls":5,"redis_shared_state_duration_s":0.001684,"redis_shared_state_read_bytes":10,"redis_shared_state_write_bytes":363,"db_count":11,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":11,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.025,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.019,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.034353,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.067458,"completed_at":"2026-08-15T23:36:50.391Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.026563,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2319gitlab # [ 423.001031] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-15T23:36:50.393Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"3bad227ffd5ae089f8df14b9","created_at":"2026-08-15T23:36:49.939Z","trace_propagation_headers":{"sentry-trace":"acdb942336a746c6bf4a86c128604b26-c95d8488eee44667","baggage":"sentry-trace_id=acdb942336a746c6bf4a86c128604b26,sentry-release=Unknown"},"correlation_id":"01M03WHZQ7AZVVC52VN7K3KAGA","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-08-15T23:36:49.942Z","job_size_bytes":3,"pid":3466,"sidekiq_tid":"m8s6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-3bad227ffd5ae089f8df14b9: start","job_status":"start","queue_duration_s":0.450981,"scheduling_latency_s":0.450999}2320gitlab # [ 423.016689] gitaly[914]: time="2026-08-15T23:36:49.908Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=102 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7274 command.oublock=0 command.real_time_ms=103 command.spawn_token_fork_ms=0 command.system_time_ms=47 command.user_time_ms=55 component=gitaly.UnaryServerInterceptor correlation_id=01M03WHZQ7AZVVC52VN7K3KAGA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-15T23:37:19.800" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-15T23:36:49.801" grpc.time_ms=107.464 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2321gitlab # [ 423.030211] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-15T23:36:50.427Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"3bad227ffd5ae089f8df14b9","created_at":"2026-08-15T23:36:49.939Z","trace_propagation_headers":{"sentry-trace":"acdb942336a746c6bf4a86c128604b26-c95d8488eee44667","baggage":"sentry-trace_id=acdb942336a746c6bf4a86c128604b26,sentry-release=Unknown"},"correlation_id":"01M03WHZQ7AZVVC52VN7K3KAGA","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-08-15T23:36:49.942Z","job_size_bytes":3,"pid":3466,"sidekiq_tid":"m8s6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-3bad227ffd5ae089f8df14b9: done: 0.034825 sec","job_status":"done","queue_duration_s":0.450981,"scheduling_latency_s":0.450999,"redis_calls":10,"redis_duration_s":0.002912,"redis_read_bytes":62,"redis_write_bytes":808,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001504,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000858,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00055,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021851,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.034825,"completed_at":"2026-08-15T23:36:50.427Z","load_balancing_strategy":"primary","db_duration_s":0.008116,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2322gitlab # [ 423.076839] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-15T23:36:50.429Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"0a6643e2b5c0b91bc032a12a","created_at":"2026-08-15T23:36:49.942Z","trace_propagation_headers":{"sentry-trace":"acdb942336a746c6bf4a86c128604b26-c95d8488eee44667","baggage":"sentry-trace_id=acdb942336a746c6bf4a86c128604b26,sentry-release=Unknown"},"correlation_id":"01M03WHZQ7AZVVC52VN7K3KAGA","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-08-15T23:36:49.945Z","job_size_bytes":3,"pid":3466,"sidekiq_tid":"m8s6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-0a6643e2b5c0b91bc032a12a: start","job_status":"start","queue_duration_s":0.484369,"scheduling_latency_s":0.484386}2323gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/9ad17214e1c9d713186fc41ecac2f0b2682a968a/statuses, in 0.26 seconds)2324gitlab # [ 423.093864] gitaly[914]: time="2026-08-15T23:36:49.975Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=2 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=2 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M03WHZQ7AZVVC52VN7K3KAGA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-15T23:37:19.070" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-15T23:36:49.971" grpc.time_ms=3.577 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2325gitlab # [ 423.106368] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/08/15:23:36:50 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/9ad17214e1c9d713186fc41ecac2f0b2682a968a/statuses HTTP/1.1" 200 633 "" "curl/8.21.0" 1562326gitlab # [ 423.109060] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-15T23:36:50.471Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"0a6643e2b5c0b91bc032a12a","created_at":"2026-08-15T23:36:49.942Z","trace_propagation_headers":{"sentry-trace":"acdb942336a746c6bf4a86c128604b26-c95d8488eee44667","baggage":"sentry-trace_id=acdb942336a746c6bf4a86c128604b26,sentry-release=Unknown"},"correlation_id":"01M03WHZQ7AZVVC52VN7K3KAGA","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-08-15T23:36:49.945Z","job_size_bytes":3,"pid":3466,"sidekiq_tid":"m8s6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-0a6643e2b5c0b91bc032a12a: done: 0.041919 sec","job_status":"done","queue_duration_s":0.484369,"scheduling_latency_s":0.484386,"redis_calls":7,"redis_duration_s":0.003403,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002285,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001118,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.027904,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.041919,"completed_at":"2026-08-15T23:36:50.471Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007643,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2327gitlab # [ 423.151967] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-15T23:36:50.474Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"2835feddd7d3bcd20aae4e99","created_at":"2026-08-15T23:36:49.945Z","trace_propagation_headers":{"sentry-trace":"acdb942336a746c6bf4a86c128604b26-c95d8488eee44667","baggage":"sentry-trace_id=acdb942336a746c6bf4a86c128604b26,sentry-release=Unknown"},"correlation_id":"01M03WHZQ7AZVVC52VN7K3KAGA","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-08-15T23:36:49.948Z","job_size_bytes":19,"pid":3466,"sidekiq_tid":"m8s6","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-2835feddd7d3bcd20aae4e99: start","job_status":"start","queue_duration_s":0.526401,"scheduling_latency_s":0.526443}2328gitlab # [ 423.168454] gitaly[914]: time="2026-08-15T23:36:50.014Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M03WHZQ7AZVVC52VN7K3KAGA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-15T23:37:20.012" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-15T23:36:50.012" grpc.time_ms=0.833 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2329gitlab # [ 423.180922] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-15T23:36:50.517Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"2835feddd7d3bcd20aae4e99","created_at":"2026-08-15T23:36:49.945Z","trace_propagation_headers":{"sentry-trace":"acdb942336a746c6bf4a86c128604b26-c95d8488eee44667","baggage":"sentry-trace_id=acdb942336a746c6bf4a86c128604b26,sentry-release=Unknown"},"correlation_id":"01M03WHZQ7AZVVC52VN7K3KAGA","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-08-15T23:36:49.948Z","job_size_bytes":19,"pid":3466,"sidekiq_tid":"m8s6","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-2835feddd7d3bcd20aae4e99: done: 0.042626 sec","job_status":"done","queue_duration_s":0.526401,"scheduling_latency_s":0.526443,"redis_calls":8,"redis_duration_s":0.0030700000000000002,"redis_read_bytes":6,"redis_write_bytes":764,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002292,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":570,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000778,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":194,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025531,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.042626,"completed_at":"2026-08-15T23:36:50.517Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007313,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2330gitlab # [ 423.223506] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-15T23:36:50.519Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"13c0a2a7fff3c0ffdffc1b54","created_at":"2026-08-15T23:36:49.949Z","trace_propagation_headers":{"sentry-trace":"acdb942336a746c6bf4a86c128604b26-c95d8488eee44667","baggage":"sentry-trace_id=acdb942336a746c6bf4a86c128604b26,sentry-release=Unknown"},"correlation_id":"01M03WHZQ7AZVVC52VN7K3KAGA","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-08-15T23:36:49.951Z","job_size_bytes":66,"pid":3466,"sidekiq_tid":"m8s6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-13c0a2a7fff3c0ffdffc1b54: start","job_status":"start","queue_duration_s":0.567977,"scheduling_latency_s":0.567999}2331gitlab # [ 423.241290] gitaly[914]: time="2026-08-15T23:36:50.767Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M03WJ156QH4ZG73CRQDPZ63D grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-15T23:37:20.765" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-15T23:36:50.765" grpc.time_ms=1.392 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2332gitlab # [ 423.255128] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-15T23:36:50.552Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"13c0a2a7fff3c0ffdffc1b54","created_at":"2026-08-15T23:36:49.949Z","trace_propagation_headers":{"sentry-trace":"acdb942336a746c6bf4a86c128604b26-c95d8488eee44667","baggage":"sentry-trace_id=acdb942336a746c6bf4a86c128604b26,sentry-release=Unknown"},"correlation_id":"01M03WHZQ7AZVVC52VN7K3KAGA","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-08-15T23:36:49.951Z","job_size_bytes":66,"pid":3466,"sidekiq_tid":"m8s6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-13c0a2a7fff3c0ffdffc1b54: done: 0.032954 sec","job_status":"done","queue_duration_s":0.567977,"scheduling_latency_s":0.567999,"redis_calls":7,"redis_duration_s":0.002247,"redis_read_bytes":5,"redis_write_bytes":761,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001675,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000572,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":240,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021788,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.032954,"completed_at":"2026-08-15T23:36:50.551Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004956,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2333gitlab # [ 423.298949] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-15T23:36:50.554Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"7905559b2894889fcc3540d1","created_at":"2026-08-15T23:36:49.952Z","trace_propagation_headers":{"sentry-trace":"acdb942336a746c6bf4a86c128604b26-c95d8488eee44667","baggage":"sentry-trace_id=acdb942336a746c6bf4a86c128604b26,sentry-release=Unknown"},"correlation_id":"01M03WHZQ7AZVVC52VN7K3KAGA","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-08-15T23:36:49.954Z","job_size_bytes":3,"pid":3466,"sidekiq_tid":"m8s6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-7905559b2894889fcc3540d1: start","job_status":"start","queue_duration_s":0.600177,"scheduling_latency_s":0.600203}2334gitlab # [ 423.315604] gitaly[914]: time="2026-08-15T23:36:50.819Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M03WJ156QH4ZG73CRQDPZ63D grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-15T23:37:20.818" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-15T23:36:50.818" grpc.time_ms=0.836 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2335gitlab # [ 423.328186] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-15T23:36:50.589Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"7905559b2894889fcc3540d1","created_at":"2026-08-15T23:36:49.952Z","trace_propagation_headers":{"sentry-trace":"acdb942336a746c6bf4a86c128604b26-c95d8488eee44667","baggage":"sentry-trace_id=acdb942336a746c6bf4a86c128604b26,sentry-release=Unknown"},"correlation_id":"01M03WHZQ7AZVVC52VN7K3KAGA","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-08-15T23:36:49.954Z","job_size_bytes":3,"pid":3466,"sidekiq_tid":"m8s6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-7905559b2894889fcc3540d1: done: 0.035624 sec","job_status":"done","queue_duration_s":0.600177,"scheduling_latency_s":0.600203,"redis_calls":7,"redis_duration_s":0.002117,"redis_read_bytes":5,"redis_write_bytes":656,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.0015,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":458,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000617,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":198,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02349,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.035624,"completed_at":"2026-08-15T23:36:50.589Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007047,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2336gitlab # [ 423.370726] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-15T23:36:50.591Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"563f267decd25a787945c597","created_at":"2026-08-15T23:36:49.954Z","trace_propagation_headers":{"sentry-trace":"acdb942336a746c6bf4a86c128604b26-c95d8488eee44667","baggage":"sentry-trace_id=acdb942336a746c6bf4a86c128604b26,sentry-release=Unknown"},"correlation_id":"01M03WHZQ7AZVVC52VN7K3KAGA","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-15T23:36:49.956Z","job_size_bytes":6,"pid":3466,"sidekiq_tid":"m8s6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-563f267decd25a787945c597: start","job_status":"start","queue_duration_s":0.635784,"scheduling_latency_s":0.635805}2337gitlab # [ 423.386628] gitaly[914]: time="2026-08-15T23:36:50.941Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M03WJ2CT2H3A2RCSX60BWBNB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-15T23:37:20.738" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-15T23:36:50.939" grpc.time_ms=1.284 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2338gitlab # [ 423.399461] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-15T23:36:50.612Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"563f267decd25a787945c597","created_at":"2026-08-15T23:36:49.954Z","trace_propagation_headers":{"sentry-trace":"acdb942336a746c6bf4a86c128604b26-c95d8488eee44667","baggage":"sentry-trace_id=acdb942336a746c6bf4a86c128604b26,sentry-release=Unknown"},"correlation_id":"01M03WHZQ7AZVVC52VN7K3KAGA","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-15T23:36:49.956Z","job_size_bytes":6,"pid":3466,"sidekiq_tid":"m8s6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-563f267decd25a787945c597: done: 0.020166 sec","job_status":"done","queue_duration_s":0.635784,"scheduling_latency_s":0.635805,"redis_calls":7,"redis_duration_s":0.002099,"redis_read_bytes":5,"redis_write_bytes":721,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001482,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":497,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000617,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":224,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011408,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020166,"completed_at":"2026-08-15T23:36:50.612Z","load_balancing_strategy":"primary","db_duration_s":0.000809,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2339gitlab # [ 423.441619] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-15T23:36:50.613Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"cead5c5e933074598e157fde","created_at":"2026-08-15T23:36:49.956Z","trace_propagation_headers":{"sentry-trace":"acdb942336a746c6bf4a86c128604b26-c95d8488eee44667","baggage":"sentry-trace_id=acdb942336a746c6bf4a86c128604b26,sentry-release=Unknown"},"correlation_id":"01M03WHZQ7AZVVC52VN7K3KAGA","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-08-15T23:36:49.958Z","job_size_bytes":3,"pid":3466,"sidekiq_tid":"m8s6","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-cead5c5e933074598e157fde: start","job_status":"start","queue_duration_s":0.655754,"scheduling_latency_s":0.655775}2340gitlab # [ 423.457073] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-15T23:36:50.643Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"cead5c5e933074598e157fde","created_at":"2026-08-15T23:36:49.956Z","trace_propagation_headers":{"sentry-trace":"acdb942336a746c6bf4a86c128604b26-c95d8488eee44667","baggage":"sentry-trace_id=acdb942336a746c6bf4a86c128604b26,sentry-release=Unknown"},"correlation_id":"01M03WHZQ7AZVVC52VN7K3KAGA","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-08-15T23:36:49.958Z","job_size_bytes":3,"pid":3466,"sidekiq_tid":"m8s6","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-cead5c5e933074598e157fde: done: 0.029318 sec","job_status":"done","queue_duration_s":0.655754,"scheduling_latency_s":0.655775,"redis_calls":7,"redis_duration_s":0.0020080000000000002,"redis_read_bytes":5,"redis_write_bytes":636,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001487,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":446,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000521,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019229,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.029318,"completed_at":"2026-08-15T23:36:50.643Z","load_balancing_strategy":"primary","db_duration_s":0.00524,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2341gitlab # [ 423.500062] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-15T23:36:50.644Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"06c72296e4c47279d6250d5f","created_at":"2026-08-15T23:36:49.996Z","trace_propagation_headers":{"sentry-trace":"ca892a4fb973404b8dd624110dbcd22d-3365498df5674dc2","baggage":"sentry-trace_id=ca892a4fb973404b8dd624110dbcd22d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M03WJ156QH4ZG73CRQDPZ63D","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-15T23:36:50.000Z","job_size_bytes":3,"pid":3466,"sidekiq_tid":"m8s6","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-06c72296e4c47279d6250d5f: start","job_status":"start","queue_duration_s":0.644514,"scheduling_latency_s":0.644533}2342gitlab # [ 423.516242] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-15T23:36:50.833Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"06c72296e4c47279d6250d5f","created_at":"2026-08-15T23:36:49.996Z","trace_propagation_headers":{"sentry-trace":"ca892a4fb973404b8dd624110dbcd22d-3365498df5674dc2","baggage":"sentry-trace_id=ca892a4fb973404b8dd624110dbcd22d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M03WJ156QH4ZG73CRQDPZ63D","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-15T23:36:50.000Z","job_size_bytes":3,"pid":3466,"sidekiq_tid":"m8s6","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-06c72296e4c47279d6250d5f: done: 0.188476 sec","job_status":"done","queue_duration_s":0.644514,"scheduling_latency_s":0.644533,"gitaly_calls":2,"gitaly_duration_s":0.007533,"redis_calls":34,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.016632,"redis_read_bytes":79,"redis_write_bytes":5122,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.004618,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":10,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.002292,"redis_cache_read_bytes":19,"redis_cache_write_bytes":892,"redis_queues_calls":2,"redis_queues_duration_s":0.000413,"redis_queues_read_bytes":2,"redis_queues_write_bytes":1133,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002389,"redis_queues_metadata_read_bytes":7,"redis_queues_metadata_write_bytes":772,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000352,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":2,"redis_repository_cache_duration_s":0.000582,"redis_repository_cache_read_bytes":39,"redis_repository_cache_write_bytes":83,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001368,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":551,"db_count":28,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":28,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.052,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":15,"db_ci_count":13,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.004,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.007,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.032,"db_ci_duration_s":0.02,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.121303,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.15112342,"duration_s":0.188476,"completed_at":"2026-08-15T23:36:50.833Z","load_balancing_strategy":"primary","db_duration_s":0.057103,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2343gitlab # [ 423.568542] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-15T23:36:50.835Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"7cec1a165719ebf88b6ee1e6","created_at":"2026-08-15T23:36:50.025Z","trace_propagation_headers":{"sentry-trace":"acdb942336a746c6bf4a86c128604b26-c95d8488eee44667","baggage":"sentry-trace_id=acdb942336a746c6bf4a86c128604b26,sentry-release=Unknown"},"correlation_id":"01M03WHZQ7AZVVC52VN7K3KAGA","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-15T23:36:50.027Z","job_size_bytes":3,"pid":3466,"sidekiq_tid":"m8s6","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-7cec1a165719ebf88b6ee1e6: start","job_status":"start","queue_duration_s":0.807858,"scheduling_latency_s":0.807877}2344gitlab # [ 423.584077] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-15T23:36:50.868Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"7cec1a165719ebf88b6ee1e6","created_at":"2026-08-15T23:36:50.025Z","trace_propagation_headers":{"sentry-trace":"acdb942336a746c6bf4a86c128604b26-c95d8488eee44667","baggage":"sentry-trace_id=acdb942336a746c6bf4a86c128604b26,sentry-release=Unknown"},"correlation_id":"01M03WHZQ7AZVVC52VN7K3KAGA","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-15T23:36:50.027Z","job_size_bytes":3,"pid":3466,"sidekiq_tid":"m8s6","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-7cec1a165719ebf88b6ee1e6: done: 0.033179 sec","job_status":"done","queue_duration_s":0.807858,"scheduling_latency_s":0.807877,"redis_calls":8,"redis_duration_s":0.004483,"redis_read_bytes":6,"redis_write_bytes":754,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003759,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":564,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000724,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019489,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.033179,"completed_at":"2026-08-15T23:36:50.868Z","load_balancing_strategy":"primary","db_duration_s":0.006713,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2345gitlab # [ 423.626014] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-15T23:36:50.869Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"d59680965bea34491c6be664","created_at":"2026-08-15T23:36:50.747Z","trace_propagation_headers":{"sentry-trace":"ca892a4fb973404b8dd624110dbcd22d-81014d31f28446be","baggage":"sentry-trace_id=ca892a4fb973404b8dd624110dbcd22d,sentry-release=Unknown"},"correlation_id":"01M03WJ156QH4ZG73CRQDPZ63D","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-08-15T23:36:50.749Z","job_size_bytes":3,"pid":3466,"sidekiq_tid":"m8s6","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-d59680965bea34491c6be664: start","job_status":"start","queue_duration_s":0.119817,"scheduling_latency_s":0.119833}2346gitlab # [ 423.642402] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-15T23:36:50.909Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"d59680965bea34491c6be664","created_at":"2026-08-15T23:36:50.747Z","trace_propagation_headers":{"sentry-trace":"ca892a4fb973404b8dd624110dbcd22d-81014d31f28446be","baggage":"sentry-trace_id=ca892a4fb973404b8dd624110dbcd22d,sentry-release=Unknown"},"correlation_id":"01M03WJ156QH4ZG73CRQDPZ63D","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-08-15T23:36:50.749Z","job_size_bytes":3,"pid":3466,"sidekiq_tid":"m8s6","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-d59680965bea34491c6be664: done: 0.039627 sec","job_status":"done","queue_duration_s":0.119817,"scheduling_latency_s":0.119833,"redis_calls":7,"redis_duration_s":0.0020080000000000002,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001444,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000564,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026025,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.039627,"completed_at":"2026-08-15T23:36:50.909Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.009142,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2347gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/9ad17214e1c9d713186fc41ecac2f0b2682a968a/statuses2348gitlab # [ 424.279279] gitaly[914]: time="2026-08-15T23:36:52.190Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M03WJ3KM8R2KB49ATM90KGS4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-15T23:37:22.087" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-15T23:36:52.188" grpc.time_ms=1.334 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2349gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/9ad17214e1c9d713186fc41ecac2f0b2682a968a/statuses, in 0.24 seconds)2350gitlab # [ 424.341115] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/08/15:23:36:52 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/9ad17214e1c9d713186fc41ecac2f0b2682a968a/statuses HTTP/1.1" 200 633 "" "curl/8.21.0" 1632351gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/9ad17214e1c9d713186fc41ecac2f0b2682a968a/statuses2352gitlab # [ 425.526891] gitaly[914]: time="2026-08-15T23:36:53.437Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M03WJ4SRSXR7C33R07Y1E897 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-15T23:37:23.235" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-15T23:36:53.436" grpc.time_ms=1.234 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2353gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/9ad17214e1c9d713186fc41ecac2f0b2682a968a/statuses, in 0.24 seconds)2354gitlab # [ 425.579639] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/08/15:23:36:53 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/9ad17214e1c9d713186fc41ecac2f0b2682a968a/statuses HTTP/1.1" 200 633 "" "curl/8.21.0" 1852355gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/9ad17214e1c9d713186fc41ecac2f0b2682a968a/statuses2356gitlab # [ 426.741437] gitaly[914]: time="2026-08-15T23:36:54.652Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M03WJ60JZBQD98S3JRC095ET grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-15T23:37:24.550" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-15T23:36:54.650" grpc.time_ms=1.225 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2357gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/9ad17214e1c9d713186fc41ecac2f0b2682a968a/statuses, in 0.22 seconds)2358gitlab # [ 426.799351] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/08/15:23:36:54 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/9ad17214e1c9d713186fc41ecac2f0b2682a968a/statuses HTTP/1.1" 200 633 "" "curl/8.21.0" 1622359gitlab # [ 426.892144] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-15T23:36:54.802Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"12fb69b04a2132c21db7df42","created_at":"2026-08-15T23:36:54.776Z","trace_propagation_headers":{"sentry-trace":"799dbfef60cc436cb2bc51929bad34f8-63a1189122f0410d","baggage":"sentry-trace_id=799dbfef60cc436cb2bc51929bad34f8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ac21633f9468a4b32a04fa23e0d5806b","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-15T23:36:54.798Z","job_size_bytes":2,"pid":3466,"sidekiq_tid":"m8s6","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-12fb69b04a2132c21db7df42: start","job_status":"start","queue_duration_s":0.003922,"scheduling_latency_s":0.003983}2360gitlab # [ 427.183565] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-15T23:36:55.094Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"12fb69b04a2132c21db7df42","created_at":"2026-08-15T23:36:54.776Z","trace_propagation_headers":{"sentry-trace":"799dbfef60cc436cb2bc51929bad34f8-63a1189122f0410d","baggage":"sentry-trace_id=799dbfef60cc436cb2bc51929bad34f8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ac21633f9468a4b32a04fa23e0d5806b","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-15T23:36:54.798Z","job_size_bytes":2,"pid":3466,"sidekiq_tid":"m8s6","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-12fb69b04a2132c21db7df42: done: 0.292236 sec","job_status":"done","queue_duration_s":0.003922,"scheduling_latency_s":0.003983,"redis_calls":13,"redis_duration_s":0.072949,"redis_read_bytes":11,"redis_write_bytes":1780,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.006319,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":618,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.027603,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":551,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.039027,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":611,"db_count":8,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.049,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.042,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.110969,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00176164,"exclusive_lock_hold_duration_s":0.12380636,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.292236,"completed_at":"2026-08-15T23:36:55.094Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.057501,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2361gitlab # [ 427.282471] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-15T23:36:55.105Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"2f8110eb7261a2d22333bb2e","created_at":"2026-08-15T23:36:54.814Z","trace_propagation_headers":{"sentry-trace":"799dbfef60cc436cb2bc51929bad34f8-63a1189122f0410d","baggage":"sentry-trace_id=799dbfef60cc436cb2bc51929bad34f8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c18c2daf983c79bd4f4363dffcb2669b","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-08-15T23:36:54.831Z","job_size_bytes":2,"pid":3466,"sidekiq_tid":"m8s6","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-2f8110eb7261a2d22333bb2e: start","job_status":"start","queue_duration_s":0.273446,"scheduling_latency_s":0.273496}2362gitlab # [ 427.376727] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-15T23:36:55.287Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"2f8110eb7261a2d22333bb2e","created_at":"2026-08-15T23:36:54.814Z","trace_propagation_headers":{"sentry-trace":"799dbfef60cc436cb2bc51929bad34f8-63a1189122f0410d","baggage":"sentry-trace_id=799dbfef60cc436cb2bc51929bad34f8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c18c2daf983c79bd4f4363dffcb2669b","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-08-15T23:36:54.831Z","job_size_bytes":2,"pid":3466,"sidekiq_tid":"m8s6","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-2f8110eb7261a2d22333bb2e: done: 0.18244 sec","job_status":"done","queue_duration_s":0.273446,"scheduling_latency_s":0.273496,"redis_calls":9,"redis_duration_s":0.020483,"redis_read_bytes":7,"redis_write_bytes":1127,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.002422,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.012005,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":536,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.006056,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":250,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.041042,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.18244,"completed_at":"2026-08-15T23:36:55.287Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.03966,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2363gitlab # [ 427.475037] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-15T23:36:55.300Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":["1"],"class":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker","jid":"6d2622dea607480157ec8174","created_at":"2026-08-15T23:36:54.875Z","trace_propagation_headers":{"sentry-trace":"799dbfef60cc436cb2bc51929bad34f8-63a1189122f0410d","baggage":"sentry-trace_id=799dbfef60cc436cb2bc51929bad34f8,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"fleet_visibility","correlation_id":"3ac1a1848ffb6ebec7e4605d3a174e18","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f3066c5baf1b66987ee2154bc897f8592e7a97485c950408f900b17a65777f1b","size_limiter":"validated","enqueued_at":"2026-08-15T23:36:54.965Z","job_size_bytes":3,"pid":3466,"sidekiq_tid":"m8s6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker JID-6d2622dea607480157ec8174: start","job_status":"start","queue_duration_s":0.334344,"scheduling_latency_s":0.334393}2364gitlab # [ 427.528630] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-15T23:36:55.439Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":["1"],"class":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker","jid":"6d2622dea607480157ec8174","created_at":"2026-08-15T23:36:54.875Z","trace_propagation_headers":{"sentry-trace":"799dbfef60cc436cb2bc51929bad34f8-63a1189122f0410d","baggage":"sentry-trace_id=799dbfef60cc436cb2bc51929bad34f8,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"fleet_visibility","correlation_id":"3ac1a1848ffb6ebec7e4605d3a174e18","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f3066c5baf1b66987ee2154bc897f8592e7a97485c950408f900b17a65777f1b","size_limiter":"validated","enqueued_at":"2026-08-15T23:36:54.965Z","job_size_bytes":3,"pid":3466,"sidekiq_tid":"m8s6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker JID-6d2622dea607480157ec8174: done: 0.139971 sec","job_status":"done","queue_duration_s":0.334344,"scheduling_latency_s":0.334393,"redis_calls":10,"redis_duration_s":0.046803,"redis_read_bytes":9,"redis_write_bytes":1203,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.01639,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.024824,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.005589,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.032681,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00108682,"duration_s":0.139971,"completed_at":"2026-08-15T23:36:55.439Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001951,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2365gitlab # [ 427.597166] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-15T23:36:55.463Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"f692cf8ea7dc9448ce892568","created_at":"2026-08-15T23:36:54.994Z","trace_propagation_headers":{"sentry-trace":"799dbfef60cc436cb2bc51929bad34f8-63a1189122f0410d","baggage":"sentry-trace_id=799dbfef60cc436cb2bc51929bad34f8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"945945d914ec9a184cc169ed3e553b99","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-15T23:36:55.023Z","job_size_bytes":2,"pid":3466,"sidekiq_tid":"m8s6","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-f692cf8ea7dc9448ce892568: start","job_status":"start","queue_duration_s":0.440114,"scheduling_latency_s":0.440163}2366gitlab # [ 427.612646] gitaly[914]: time="2026-08-15T23:36:55.517Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M03WJ6VT9EE92ZDG1SA918VS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-15T23:37:25.415" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-15T23:36:55.515" grpc.time_ms=1.094 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2367gitlab # [ 427.674705] gitaly[914]: time="2026-08-15T23:36:55.586Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=9 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M03WJ6VT9EE92ZDG1SA918VS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-15T23:37:05.249" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-15T23:36:55.569" grpc.time_ms=16.744 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2368gitlab # [ 427.762051] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/08/15:23:36:55 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/9ad17214e1c9d713186fc41ecac2f0b2682a968a HTTP/1.1" 201 669 "" "python-httpx/0.28.1" 2542369gitlab # [ 427.771232] nixbot[3476]: {"ts": "2026-08-15T23:36:55.675Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/9ad17214e1c9d713186fc41ecac2f0b2682a968a \"HTTP/1.1 201 Created\""}2370gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/9ad17214e1c9d713186fc41ecac2f0b2682a968a/statuses2371gitlab # [ 427.815504] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-15T23:36:55.727Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0}2372gitlab # [ 427.856457] gitaly[914]: time="2026-08-15T23:36:55.766Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M03WJ7416CVZQRVKMC3FS2KF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-15T23:37:25.665" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-15T23:36:55.766" grpc.time_ms=0.578 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2373gitlab # [ 427.907721] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-15T23:36:55.817Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"f692cf8ea7dc9448ce892568","created_at":"2026-08-15T23:36:54.994Z","trace_propagation_headers":{"sentry-trace":"799dbfef60cc436cb2bc51929bad34f8-63a1189122f0410d","baggage":"sentry-trace_id=799dbfef60cc436cb2bc51929bad34f8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"945945d914ec9a184cc169ed3e553b99","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-15T23:36:55.023Z","job_size_bytes":2,"pid":3466,"sidekiq_tid":"m8s6","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-f692cf8ea7dc9448ce892568: done: 0.354508 sec","job_status":"done","queue_duration_s":0.440114,"scheduling_latency_s":0.440163,"redis_calls":9,"redis_duration_s":0.229825,"redis_read_bytes":7,"redis_write_bytes":1159,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.005125,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":353,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.222155,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":548,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002545,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":258,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.03576,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.354508,"completed_at":"2026-08-15T23:36:55.817Z","load_balancing_strategy":"primary","db_duration_s":0.00533,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2374gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/9ad17214e1c9d713186fc41ecac2f0b2682a968a/statuses, in 0.17 seconds)2375gitlab # [ 427.970362] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-15T23:36:55.820Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Projects::ScheduleRefreshBuildArtifactsSizeStatisticsWorker","jid":"631aed7a4f7da8199913d48d","created_at":"2026-08-15T23:36:55.072Z","trace_propagation_headers":{"sentry-trace":"799dbfef60cc436cb2bc51929bad34f8-63a1189122f0410d","baggage":"sentry-trace_id=799dbfef60cc436cb2bc51929bad34f8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8f5b6af864e659c4b1fa4e614f076875","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:805014656d48c4962f83ad00758ac8cfab4de244cfbd1d771454e66bd9018911","size_limiter":"validated","enqueued_at":"2026-08-15T23:36:55.102Z","job_size_bytes":2,"pid":3466,"sidekiq_tid":"m8s6","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ScheduleRefreshBuildArtifactsSizeStatisticsWorker JID-631aed7a4f7da8199913d48d: start","job_status":"start","queue_duration_s":0.718482,"scheduling_latency_s":0.718513}2376gitlab # [ 427.988757] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/08/15:23:36:55 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/9ad17214e1c9d713186fc41ecac2f0b2682a968a/statuses HTTP/1.1" 200 671 "" "curl/8.21.0" 1202377gitlab # [ 427.991965] gitaly[914]: time="2026-08-15T23:36:55.845Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=3 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M03WJ7416CVZQRVKMC3FS2KF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-15T23:37:05.031" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-15T23:36:55.832" grpc.time_ms=13.124 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2378gitlab # [ 428.007630] gitaly[914]: time="2026-08-15T23:36:55.846Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M03WJ76GW0DVS5GYE3YK566H grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-15T23:37:25.644" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-15T23:36:55.844" grpc.time_ms=1.358 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2379gitlab # [ 428.021666] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/08/15:23:36:55 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/9ad17214e1c9d713186fc41ecac2f0b2682a968a HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 2312380gitlab # [ 428.024374] nixbot[3476]: {"ts": "2026-08-15T23:36:55.914Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/9ad17214e1c9d713186fc41ecac2f0b2682a968a \"HTTP/1.1 201 Created\""}2381gitlab # [ 428.027253] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-15T23:36:55.926Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Projects::ScheduleRefreshBuildArtifactsSizeStatisticsWorker","jid":"631aed7a4f7da8199913d48d","created_at":"2026-08-15T23:36:55.072Z","trace_propagation_headers":{"sentry-trace":"799dbfef60cc436cb2bc51929bad34f8-63a1189122f0410d","baggage":"sentry-trace_id=799dbfef60cc436cb2bc51929bad34f8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8f5b6af864e659c4b1fa4e614f076875","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:805014656d48c4962f83ad00758ac8cfab4de244cfbd1d771454e66bd9018911","size_limiter":"validated","enqueued_at":"2026-08-15T23:36:55.102Z","job_size_bytes":2,"pid":3466,"sidekiq_tid":"m8s6","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ScheduleRefreshBuildArtifactsSizeStatisticsWorker JID-631aed7a4f7da8199913d48d: done: 0.105264 sec","job_status":"done","queue_duration_s":0.718482,"scheduling_latency_s":0.718513,"redis_calls":20,"redis_duration_s":0.004624,"redis_read_bytes":20,"redis_write_bytes":3248,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.002191,"redis_feature_flag_read_bytes":8,"redis_feature_flag_write_bytes":1346,"redis_queues_calls":2,"redis_queues_duration_s":0.000381,"redis_queues_read_bytes":3,"redis_queues_write_bytes":818,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001415,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":734,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000637,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":350,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.018,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.018,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.037986,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00027618,"duration_s":0.105264,"completed_at":"2026-08-15T23:36:55.926Z","load_balancing_strategy":"primary","db_duration_s":0.018177,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2382gitlab # [ 428.070668] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-15T23:36:55.933Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"4fdfe8055f6eb05ceefa0e50","created_at":"2026-08-15T23:36:55.117Z","trace_propagation_headers":{"sentry-trace":"799dbfef60cc436cb2bc51929bad34f8-63a1189122f0410d","baggage":"sentry-trace_id=799dbfef60cc436cb2bc51929bad34f8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1744704b2e974a17bdb1591c8cbacd62","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-08-15T23:36:55.131Z","job_size_bytes":2,"pid":3466,"sidekiq_tid":"m8s6","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-4fdfe8055f6eb05ceefa0e50: start","job_status":"start","queue_duration_s":0.801605,"scheduling_latency_s":0.801629}2383gitlab # [ 428.085266] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-15T23:36:55.989Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"4fdfe8055f6eb05ceefa0e50","created_at":"2026-08-15T23:36:55.117Z","trace_propagation_headers":{"sentry-trace":"799dbfef60cc436cb2bc51929bad34f8-63a1189122f0410d","baggage":"sentry-trace_id=799dbfef60cc436cb2bc51929bad34f8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1744704b2e974a17bdb1591c8cbacd62","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-08-15T23:36:55.131Z","job_size_bytes":2,"pid":3466,"sidekiq_tid":"m8s6","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-4fdfe8055f6eb05ceefa0e50: done: 0.05658 sec","job_status":"done","queue_duration_s":0.801605,"scheduling_latency_s":0.801629,"redis_calls":11,"redis_duration_s":0.005606,"redis_read_bytes":9,"redis_write_bytes":1464,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000332,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000868,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":536,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.004406,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":591,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.013,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.013,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018886,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00301516,"exclusive_lock_hold_duration_s":0.01455068,"duration_s":0.05658,"completed_at":"2026-08-15T23:36:55.989Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.01788,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2384gitlab # [ 428.127726] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-15T23:36:55.991Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"0f6ed2af76f15582adb556fd","created_at":"2026-08-15T23:36:55.154Z","trace_propagation_headers":{"sentry-trace":"799dbfef60cc436cb2bc51929bad34f8-63a1189122f0410d","baggage":"sentry-trace_id=799dbfef60cc436cb2bc51929bad34f8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9f1b93a1449bad8321a4d29897b99f12","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-15T23:36:55.181Z","job_size_bytes":2,"pid":3466,"sidekiq_tid":"m8s6","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-0f6ed2af76f15582adb556fd: start","job_status":"start","queue_duration_s":0.810327,"scheduling_latency_s":0.810351}2385gitlab # [ 428.141918] gitaly[914]: time="2026-08-15T23:36:56.006Z" level=info msg="finished unary call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M03WJ7BR4CVDR4FN6EPQVMNK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-15T23:37:26.004" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-15T23:36:56.004" grpc.time_ms=1.567 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2386gitlab # [ 428.154793] gitaly[914]: time="2026-08-15T23:36:56.062Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=2 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M03WJ7BR4CVDR4FN6EPQVMNK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-15T23:37:06.051" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-15T23:36:56.051" grpc.time_ms=10.969 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2387gitlab # [ 428.228242] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/08/15:23:36:56 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/9ad17214e1c9d713186fc41ecac2f0b2682a968a HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 2112388gitlab # [ 428.231713] nixbot[3476]: {"ts": "2026-08-15T23:36:56.141Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/9ad17214e1c9d713186fc41ecac2f0b2682a968a \"HTTP/1.1 201 Created\""}2389gitlab # [ 428.335181] nix-daemon[3691]: accepted connection from pid 4441, user nixbot2390gitlab # [ 428.511616] gitaly[914]: time="2026-08-15T23:36:56.423Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=578 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M03WJ7R8RFYBQKNTYTG6F075 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=190 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-15T23:36:56.405" grpc.time_ms=17.503 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc2391gitlab # [ 428.548565] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/08/15:23:36:56 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 962392gitlab # [ 428.626086] gitaly[914]: time="2026-08-15T23:36:56.537Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M03WJ7VAKWEKRH29RWNWTQCM grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-15T23:36:56.519" pid=914 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2393gitlab # [ 428.656665] gitaly[914]: time="2026-08-15T23:36:56.538Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=1 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M03WJ7VAKWEKRH29RWNWTQCM grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-15T23:36:56.519" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc2394gitlab # [ 428.683301] gitlab-workhorse[820]: time="2026-08-15T23:36:56Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672395gitlab # [ 428.686450] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/08/15:23:36:56 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 1122396gitlab # [ 428.689512] gitaly[914]: time="2026-08-15T23:36:56.538Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=1 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M03WJ7VAKWEKRH29RWNWTQCM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-15T23:36:56.519" grpc.time_ms=18.567 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc2397gitlab # [ 428.782372] nix-daemon[3691]: accepted connection from pid 4466, user nixbot2398gitlab # [ 428.787105] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-15T23:36:56.698Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"0f6ed2af76f15582adb556fd","created_at":"2026-08-15T23:36:55.154Z","trace_propagation_headers":{"sentry-trace":"799dbfef60cc436cb2bc51929bad34f8-63a1189122f0410d","baggage":"sentry-trace_id=799dbfef60cc436cb2bc51929bad34f8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9f1b93a1449bad8321a4d29897b99f12","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-15T23:36:55.181Z","job_size_bytes":2,"pid":3466,"sidekiq_tid":"m8s6","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-0f6ed2af76f15582adb556fd: done: 0.706843 sec","job_status":"done","queue_duration_s":0.810327,"scheduling_latency_s":0.810351,"redis_calls":564,"redis_duration_s":0.258888,"redis_read_bytes":562,"redis_write_bytes":49063,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000329,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001054,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":470,"redis_shared_state_calls":557,"redis_shared_state_duration_s":0.257505,"redis_shared_state_read_bytes":556,"redis_shared_state_write_bytes":48290,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.487068,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.706843,"completed_at":"2026-08-15T23:36:56.698Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001346,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2399gitlab # [ 428.864219] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-15T23:36:56.700Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"cf6fa026f620c427234cb383","created_at":"2026-08-15T23:36:55.227Z","trace_propagation_headers":{"sentry-trace":"799dbfef60cc436cb2bc51929bad34f8-63a1189122f0410d","baggage":"sentry-trace_id=799dbfef60cc436cb2bc51929bad34f8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3b4759087b7ca5eae84403f698439768","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-15T23:36:55.252Z","job_size_bytes":2,"pid":3466,"sidekiq_tid":"m8s6","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-cf6fa026f620c427234cb383: start","job_status":"start","queue_duration_s":1.448033,"scheduling_latency_s":1.448066}2400gitlab # [ 428.883284] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-15T23:36:56.740Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"cf6fa026f620c427234cb383","created_at":"2026-08-15T23:36:55.227Z","trace_propagation_headers":{"sentry-trace":"799dbfef60cc436cb2bc51929bad34f8-63a1189122f0410d","baggage":"sentry-trace_id=799dbfef60cc436cb2bc51929bad34f8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3b4759087b7ca5eae84403f698439768","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-15T23:36:55.252Z","job_size_bytes":2,"pid":3466,"sidekiq_tid":"m8s6","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-cf6fa026f620c427234cb383: done: 0.039993 sec","job_status":"done","queue_duration_s":1.448033,"scheduling_latency_s":1.448066,"redis_calls":9,"redis_duration_s":0.00364,"redis_read_bytes":7,"redis_write_bytes":984,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000486,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002489,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":473,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000665,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":208,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02365,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.039993,"completed_at":"2026-08-15T23:36:56.740Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003613,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2401gitlab # [ 428.928747] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-15T23:36:56.742Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"84a59577b85bcce655573a57","created_at":"2026-08-15T23:36:55.279Z","trace_propagation_headers":{"sentry-trace":"799dbfef60cc436cb2bc51929bad34f8-63a1189122f0410d","baggage":"sentry-trace_id=799dbfef60cc436cb2bc51929bad34f8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4cc8e5acc60300757d145c7d574acad1","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-15T23:36:55.297Z","job_size_bytes":2,"pid":3466,"sidekiq_tid":"m8s6","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-84a59577b85bcce655573a57: start","job_status":"start","queue_duration_s":1.445149,"scheduling_latency_s":1.445175}2402gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/9ad17214e1c9d713186fc41ecac2f0b2682a968a/statuses2403gitlab # [ 428.942578] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-15T23:36:56.787Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"84a59577b85bcce655573a57","created_at":"2026-08-15T23:36:55.279Z","trace_propagation_headers":{"sentry-trace":"799dbfef60cc436cb2bc51929bad34f8-63a1189122f0410d","baggage":"sentry-trace_id=799dbfef60cc436cb2bc51929bad34f8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4cc8e5acc60300757d145c7d574acad1","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-15T23:36:55.297Z","job_size_bytes":2,"pid":3466,"sidekiq_tid":"m8s6","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-84a59577b85bcce655573a57: done: 0.045046 sec","job_status":"done","queue_duration_s":1.445149,"scheduling_latency_s":1.445175,"redis_calls":9,"redis_duration_s":0.002938,"redis_read_bytes":7,"redis_write_bytes":1183,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000667,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001613,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000658,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.011,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021396,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.045046,"completed_at":"2026-08-15T23:36:56.787Z","load_balancing_strategy":"primary","db_duration_s":0.013146,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2404gitlab # [ 428.984898] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-15T23:36:56.789Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ObjectStorage::DeleteStaleDirectUploadsWorker","jid":"bedb1e7619e676b09539835d","created_at":"2026-08-15T23:36:55.313Z","trace_propagation_headers":{"sentry-trace":"799dbfef60cc436cb2bc51929bad34f8-63a1189122f0410d","baggage":"sentry-trace_id=799dbfef60cc436cb2bc51929bad34f8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1a38b1d13b46d901d257581c08e62bb5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:da92be7816ff691bea6b0627c50cb73b98e4b5009a988cab37d277c0df9aa326","size_limiter":"validated","enqueued_at":"2026-08-15T23:36:55.327Z","job_size_bytes":2,"pid":3466,"sidekiq_tid":"m8s6","sidekiq_thread_name":"sidekiq.default/processor","message":"ObjectStorage::DeleteStaleDirectUploadsWorker JID-bedb1e7619e676b09539835d: start","job_status":"start","queue_duration_s":1.462606,"scheduling_latency_s":1.462634}2405gitlab # [ 428.999045] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-15T23:36:56.813Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ObjectStorage::DeleteStaleDirectUploadsWorker","jid":"bedb1e7619e676b09539835d","created_at":"2026-08-15T23:36:55.313Z","trace_propagation_headers":{"sentry-trace":"799dbfef60cc436cb2bc51929bad34f8-63a1189122f0410d","baggage":"sentry-trace_id=799dbfef60cc436cb2bc51929bad34f8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1a38b1d13b46d901d257581c08e62bb5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:da92be7816ff691bea6b0627c50cb73b98e4b5009a988cab37d277c0df9aa326","size_limiter":"validated","enqueued_at":"2026-08-15T23:36:55.327Z","job_size_bytes":2,"pid":3466,"sidekiq_tid":"m8s6","sidekiq_thread_name":"sidekiq.default/processor","message":"ObjectStorage::DeleteStaleDirectUploadsWorker JID-bedb1e7619e676b09539835d: done: 0.02388 sec","job_status":"done","queue_duration_s":1.462606,"scheduling_latency_s":1.462634,"redis_calls":12,"redis_duration_s":0.0034000000000000002,"redis_read_bytes":11,"redis_write_bytes":1247,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000523,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":333,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001598,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":618,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001279,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":296,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01313,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00037458,"extra.object_storage_delete_stale_direct_uploads_worker.total_pending_entries":0,"extra.object_storage_delete_stale_direct_uploads_worker.total_deleted_stale_entries":0,"extra.object_storage_delete_stale_direct_uploads_worker.execution_timeout":false,"duration_s":0.02388,"completed_at":"2026-08-15T23:36:56.813Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00059,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2406gitlab # [ 429.046022] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-15T23:36:56.815Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"3569fa3c7f1e9386a1b88b7b","created_at":"2026-08-15T23:36:55.341Z","trace_propagation_headers":{"sentry-trace":"799dbfef60cc436cb2bc51929bad34f8-63a1189122f0410d","baggage":"sentry-trace_id=799dbfef60cc436cb2bc51929bad34f8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"448375307a59abed74890ff1cef5a99e","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-15T23:36:55.379Z","job_size_bytes":2,"pid":3466,"sidekiq_tid":"m8s6","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-3569fa3c7f1e9386a1b88b7b: start","job_status":"start","queue_duration_s":1.436143,"scheduling_latency_s":1.436161}2407gitlab # [ 429.060378] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-15T23:36:56.855Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"3569fa3c7f1e9386a1b88b7b","created_at":"2026-08-15T23:36:55.341Z","trace_propagation_headers":{"sentry-trace":"799dbfef60cc436cb2bc51929bad34f8-63a1189122f0410d","baggage":"sentry-trace_id=799dbfef60cc436cb2bc51929bad34f8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"448375307a59abed74890ff1cef5a99e","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-15T23:36:55.379Z","job_size_bytes":2,"pid":3466,"sidekiq_tid":"m8s6","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-3569fa3c7f1e9386a1b88b7b: done: 0.040412 sec","job_status":"done","queue_duration_s":1.436143,"scheduling_latency_s":1.436161,"redis_calls":9,"redis_duration_s":0.002581,"redis_read_bytes":7,"redis_write_bytes":1026,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000548,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":315,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001462,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":491,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000571,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":220,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.015,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.015,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01577,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.040412,"completed_at":"2026-08-15T23:36:56.855Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.015409,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2408gitlab # [ 429.102445] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-15T23:36:56.857Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"7a19ee0b3c8ffa6bed76e564","created_at":"2026-08-15T23:36:55.420Z","trace_propagation_headers":{"sentry-trace":"799dbfef60cc436cb2bc51929bad34f8-63a1189122f0410d","baggage":"sentry-trace_id=799dbfef60cc436cb2bc51929bad34f8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8a1d0be874a0d135fb5cff736d7982cd","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-15T23:36:55.446Z","job_size_bytes":2,"pid":3466,"sidekiq_tid":"m8s6","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-7a19ee0b3c8ffa6bed76e564: start","job_status":"start","queue_duration_s":1.411248,"scheduling_latency_s":1.411267}2409gitlab # [ 429.117301] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-15T23:36:56.880Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"7a19ee0b3c8ffa6bed76e564","created_at":"2026-08-15T23:36:55.420Z","trace_propagation_headers":{"sentry-trace":"799dbfef60cc436cb2bc51929bad34f8-63a1189122f0410d","baggage":"sentry-trace_id=799dbfef60cc436cb2bc51929bad34f8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8a1d0be874a0d135fb5cff736d7982cd","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-15T23:36:55.446Z","job_size_bytes":2,"pid":3466,"sidekiq_tid":"m8s6","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-7a19ee0b3c8ffa6bed76e564: done: 0.023118 sec","job_status":"done","queue_duration_s":1.411248,"scheduling_latency_s":1.411267,"redis_calls":11,"redis_duration_s":0.002927,"redis_read_bytes":9,"redis_write_bytes":1459,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001022,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":628,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001378,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":563,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000527,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":268,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013615,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.023118,"completed_at":"2026-08-15T23:36:56.880Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001154,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2410gitlab # [ 429.159992] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-15T23:36:56.882Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"4e2f57c2e38d0b49aad29c7f","created_at":"2026-08-15T23:36:55.453Z","trace_propagation_headers":{"sentry-trace":"799dbfef60cc436cb2bc51929bad34f8-63a1189122f0410d","baggage":"sentry-trace_id=799dbfef60cc436cb2bc51929bad34f8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1b239d930199e707c76949a96fb416b6","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-15T23:36:55.471Z","job_size_bytes":2,"pid":3466,"sidekiq_tid":"m8s6","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-4e2f57c2e38d0b49aad29c7f: start","job_status":"start","queue_duration_s":1.410621,"scheduling_latency_s":1.410637}2411gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/9ad17214e1c9d713186fc41ecac2f0b2682a968a/statuses, in 0.21 seconds)2412gitlab # [ 429.174938] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-15T23:36:56.893Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0}2413(finished: subtest: eval and build post commit statuses, in 7.47 seconds)2414(finished: run the VM test script, in 502.55 seconds)2415test script finished in 502.58s2416cleanup2417kill QemuMachine (pid 46)2418gitlab # [ 429.178618] sidekiq-cluster[3466]: {"severity":"INFO","time":"2026-08-15T23:36:56.901Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"4e2f57c2e38d0b49aad29c7f","created_at":"2026-08-15T23:36:55.453Z","trace_propagation_headers":{"sentry-trace":"799dbfef60cc436cb2bc51929bad34f8-63a1189122f0410d","baggage":"sentry-trace_id=799dbfef60cc436cb2bc51929bad34f8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1b239d930199e707c76949a96fb416b6","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-15T23:36:55.471Z","job_size_bytes":2,"pid":3466,"sidekiq_tid":"m8s6","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-4e2f57c2e38d0b49aad29c7f: done: 0.018978 sec","job_status":"done","queue_duration_s":1.410621,"scheduling_latency_s":1.410637,"redis_calls":9,"redis_duration_s":0.0024289999999999997,"redis_read_bytes":7,"redis_write_bytes":1178,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000548,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001365,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":557,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000516,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":264,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/41m77i1296n33p6liin8ynr6wh3h6b7m-python3-3.14.6/bin/python3.14)2419(finished: cleanup, in 1.30 seconds)2420additionally exposed symbols:2421 gitlab,2422 vlan1,2423 start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh2424[]2425[{'id': 1, 'url': 'http://buildbot:8010/webhooks/gitlab', 'name': None, 'description': None, 'created_at': '2026-08-15T23:35:14.811Z', 'push_events': True, 'tag_push_events': False, 'merge_requests_events': True, 'repository_update_events': False, 'enable_ssl_verification': True, 'alert_status': 'executable', 'disabled_until': None, 'push_events_branch_filter': None, 'branch_filter_strategy': 'wildcard', 'custom_webhook_template': None, 'token_present': True, 'signing_token_present': False, 'project_id': 1, 'issues_events': False, 'confidential_issues_events': False, 'note_events': False, 'confidential_note_events': None, 'pipeline_events': False, 'wiki_page_events': False, 'deployment_events': False, 'feature_flag_events': False, 'job_events': False, 'releases_events': False, 'milestone_events': False, 'emoji_events': False, 'resource_access_token_events': False, 'resource_deploy_token_events': False, 'vulnerability_events': False}]2426[]2427[]2428[]2429[]2430[]2431[]2432[]2433[]2434[]2435[]2436[]2437[]2438[]2439[]2440[]2441[]2442[]2443[]2444[]2445[]2446[]2447[]2448[]2449[]2450[]2451[]2452[]2453[]2454[]2455[]2456[]2457[]2458[]2459[]2460[]2461[]2462[]2463[]2464[]2465[]2466[]2467[]2468[]2469[]2470[]2471[]2472[]2473[]2474[]2475[]2476[]2477[]2478[]2479[]2480[]2481[]2482[]2483[]2484[]2485[]2486[]2487[]2488[]2489[]2490[]2491[]2492[]2493[]2494[]2495[]2496[]2497[]2498[]2499[]2500[]2501[]2502[]2503[]2504[]2505[]2506[]2507[]2508[]2509[]2510[]2511[]2512[]2513[]2514[{'id': 2, 'project_id': 1, 'number': 2, 'tree_hash': 'cefc112e8680bb0f9569544b9656644ac3312d93', 'commit_sha': '9ad17214e1c9d713186fc41ecac2f0b2682a968a', 'branch': 'master', 'pr_number': None, 'pr_author': None, 'status': 'pending', 'eval_warnings': None, 'error': None, 'created_at': '2026-08-15T23:36:49.567321Z', 'started_at': None, 'finished_at': None}]2515[]2516[{'id': 5, 'sha': '9ad17214e1c9d713186fc41ecac2f0b2682a968a', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluating flake', 'created_at': '2026-08-15T23:36:49.988Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2517[{'id': 5, 'sha': '9ad17214e1c9d713186fc41ecac2f0b2682a968a', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluating flake', 'created_at': '2026-08-15T23:36:49.988Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2518[{'id': 5, 'sha': '9ad17214e1c9d713186fc41ecac2f0b2682a968a', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluating flake', 'created_at': '2026-08-15T23:36:49.988Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2519[{'id': 5, 'sha': '9ad17214e1c9d713186fc41ecac2f0b2682a968a', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluating flake', 'created_at': '2026-08-15T23:36:49.988Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2520[{'id': 5, 'sha': '9ad17214e1c9d713186fc41ecac2f0b2682a968a', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluation succeeded (1 warning)', 'created_at': '2026-08-15T23:36:49.988Z', 'started_at': None, 'finished_at': '2026-08-15T23:36:55.620Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2521[{'id': 5, 'sha': '9ad17214e1c9d713186fc41ecac2f0b2682a968a', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluation succeeded (1 warning)', 'created_at': '2026-08-15T23:36:49.988Z', 'started_at': None, 'finished_at': '2026-08-15T23:36:55.620Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}, {'id': 6, 'sha': '9ad17214e1c9d713186fc41ecac2f0b2682a968a', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-build', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': '0 attributes built', 'created_at': '2026-08-15T23:36:55.882Z', 'started_at': None, 'finished_at': '2026-08-15T23:36:56.098Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]