vm-test-run-nixbot-gitlab
default.checks.aarch64-linux.nixbot-gitlab
· build #209
· raw
1tribuchet: building on eliza2Machine state will be reset. To keep it, pass --keep-machine-state3start all VLans4(finished: start all VLans, in 0.00 seconds)5Test will time out and terminate in 3600 seconds6run the VM test script7start all VMs8gitlab: starting vm9gitlab: QEMU running (pid 46)10gitlab # Disk image does not exist, creating the virtualisation disk image...11gitlab # Formatting '/build/vm-state-gitlab/tmp.xcj20fiHCx', fmt=raw size=107374182412gitlab # mke2fs 1.47.4 (6-Mar-2025)13(finished: start all VMs, in 67.31 seconds)14gitlab # Discarding device blocks: 0/262144 done15gitlab: waiting for unit setup-gitlab.service16gitlab # Creating filesystem with 262144 4k blocks and 65536 inodes17gitlab: waiting for the VM to finish booting18gitlab # Filesystem UUID: 67ed1514-16cb-40ac-b8f2-c69f2a9d982219gitlab # Superblock backups stored on blocks:20gitlab # 32768, 98304, 163840, 22937621gitlab # 22gitlab # Allocating group tables: 0/8 done23gitlab # Writing inode tables: 0/8 done24gitlab # Creating journal (8192 blocks): done25gitlab # Writing superblocks and filesystem accounting information: 0/8 done26gitlab # 27gitlab # Virtualisation disk image created.28gitlab # Creating Nix store image...29gitlab # Created Nix store image.30gitlab # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40]31gitlab # [ 0.000000] Linux version 6.18.43 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Thu Aug 6 17:27:09 UTC 202632gitlab # [ 0.000000] KASLR enabled33gitlab # [ 0.000000] random: crng init done34gitlab # [ 0.000000] Machine model: linux,dummy-virt35gitlab # [ 0.000000] efi: UEFI not found.36gitlab # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT37gitlab # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x00000001bfffffff]38gitlab # [ 0.000000] NODE_DATA(0) allocated [mem 0x1bfdeb740-0x1bfdeeebf]39gitlab # [ 0.000000] Zone ranges:40gitlab # [ 0.000000] DMA [mem 0x0000000040000000-0x00000000ffffffff]41gitlab # [ 0.000000] DMA32 empty42gitlab # [ 0.000000] Normal [mem 0x0000000100000000-0x00000001bfffffff]43gitlab # [ 0.000000] Device empty44gitlab # [ 0.000000] Movable zone start for each node45gitlab # [ 0.000000] Early memory node ranges46gitlab # [ 0.000000] node 0: [mem 0x0000000040000000-0x00000001bfffffff]47gitlab # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x00000001bfffffff]48gitlab # [ 0.000000] cma: Reserved 32 MiB at 0x00000000fe00000049gitlab # [ 0.000000] psci: probing for conduit method from DT.50gitlab # [ 0.000000] psci: PSCIv1.3 detected in firmware.51gitlab # [ 0.000000] psci: Using standard PSCI v0.2 function IDs52gitlab # [ 0.000000] psci: Trusted OS migration not required53gitlab # [ 0.000000] psci: SMC Calling Convention v1.154gitlab # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003)55gitlab # [ 0.000000] percpu: Embedded 76 pages/cpu s186712 r8192 d116392 u31129656gitlab # [ 0.000000] Detected PIPT I-cache on CPU057gitlab # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm)58gitlab # [ 0.000000] CPU features: detected: GICv3 CPU interface59gitlab # [ 0.000000] CPU features: detected: Spectre-v460gitlab # [ 0.000000] CPU features: detected: Spectre-BHB61gitlab # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_3862gitlab # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_2363gitlab # [ 0.000000] alternatives: applying boot alternatives64gitlab # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/912r8qy7i51qp904kz49jszmj0r6x67f-nixos-system-gitlab-test/init regInfo=/nix/store/ib0vk82cmzklc88pgjcqglvyxxpc6jps-closure-info/registration console=ttyAMA0,115200n8 console=tty065gitlab # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/ib0vk82cmzklc88pgjcqglvyxxpc6jps-closure-info/registration", will be passed to user space.66gitlab # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes67gitlab # [ 0.000000] Dentry cache hash table entries: 1048576 (order: 11, 8388608 bytes, linear)68gitlab # [ 0.000000] Inode-cache hash table entries: 524288 (order: 10, 4194304 bytes, linear)69gitlab # [ 0.000000] software IO TLB: area num 4.70gitlab # [ 0.000000] software IO TLB: mapped [mem 0x00000000fa000000-0x00000000fe000000] (64MB)71gitlab # [ 0.000000] Fallback order for Node 0: 072gitlab # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 157286473gitlab # [ 0.000000] Policy zone: Normal74gitlab # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off75gitlab # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=176gitlab # [ 0.000000] allocated 12582912 bytes of page_ext77gitlab # [ 0.000000] ftrace: allocating 74867 entries in 294 pages78gitlab # [ 0.000000] ftrace: allocated 294 pages with 4 groups79gitlab # [ 0.000000] rcu: Hierarchical RCU implementation.80gitlab # [ 0.000000] rcu: RCU event tracing is enabled.81gitlab # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=4.82gitlab # [ 0.000000] Trampoline variant of Tasks RCU enabled.83gitlab # [ 0.000000] Rude variant of Tasks RCU enabled.84gitlab # [ 0.000000] Tracing variant of Tasks RCU enabled.85gitlab # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.86gitlab # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=487gitlab # [ 0.000000] RCU Tasks: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.88gitlab # [ 0.000000] RCU Tasks Rude: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.89gitlab # [ 0.000000] RCU Tasks Trace: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.90gitlab # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 091gitlab # [ 0.000000] GICv3: 256 SPIs implemented92gitlab # [ 0.000000] GICv3: 0 Extended SPIs implemented93gitlab # [ 0.000000] Root IRQ handler: gic_handle_irq94gitlab # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI95gitlab # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=096gitlab # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a000097gitlab # [ 0.000000] ITS [mem 0x08080000-0x0809ffff]98gitlab # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @100f10000 (indirect, esz 8, psz 64K, shr 1)99gitlab # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @100f20000 (flat, esz 8, psz 64K, shr 1)100gitlab # [ 0.000000] GICv3: using LPI property table @0x0000000100f30000101gitlab # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000100f40000102gitlab # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.103gitlab # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns104gitlab # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt).105gitlab # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns106gitlab # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns107gitlab # [ 0.000027] arm-pv: using stolen time PV108gitlab # [ 0.000370] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)109gitlab # [ 0.000565] Console: colour dummy device 80x25110gitlab # [ 0.000573] printk: legacy console [tty0] enabled111gitlab # [ 0.000752] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000)112gitlab # [ 0.000758] pid_max: default: 32768 minimum: 301113gitlab # [ 0.000828] LSM: initializing lsm=capability,landlock,yama,bpf,ima114gitlab # [ 0.000957] landlock: Up and running.115gitlab # [ 0.000960] Yama: becoming mindful.116gitlab # [ 0.001375] LSM support for eBPF active117gitlab # [ 0.001561] Mount-cache hash table entries: 16384 (order: 5, 131072 bytes, linear)118gitlab # [ 0.001664] Mountpoint-cache hash table entries: 16384 (order: 5, 131072 bytes, linear)119gitlab # [ 0.002735] cacheinfo: Unable to detect cache hierarchy for CPU 0120gitlab # [ 0.003429] rcu: Hierarchical SRCU implementation.121gitlab # [ 0.003433] rcu: Max phase no-delay instances is 1000.122gitlab # [ 0.003587] Timer migration: 1 hierarchy levels; 8 children per group; 1 crossnode level123gitlab # [ 0.004661] fsl-mc MSI: its@8080000 domain created124gitlab # [ 0.004753] EFI services will not be available.125gitlab # [ 0.004912] smp: Bringing up secondary CPUs ...126gitlab # [ 0.005547] Detected PIPT I-cache on CPU1127gitlab # [ 0.005645] GICv3: CPU1: found redistributor 1 region 0:0x00000000080c0000128gitlab # [ 0.005765] GICv3: CPU1: using allocated LPI pending table @0x0000000100f50000129gitlab # [ 0.005888] CPU1: Booted secondary processor 0x0000000001 [0xc00fac40]130gitlab # [ 0.006900] Detected PIPT I-cache on CPU2131gitlab # [ 0.007003] GICv3: CPU2: found redistributor 2 region 0:0x00000000080e0000132gitlab # [ 0.007123] GICv3: CPU2: using allocated LPI pending table @0x0000000100f60000133gitlab # [ 0.007244] CPU2: Booted secondary processor 0x0000000002 [0xc00fac40]134gitlab # [ 0.008270] Detected PIPT I-cache on CPU3135gitlab # [ 0.008385] GICv3: CPU3: found redistributor 3 region 0:0x0000000008100000136gitlab # [ 0.008506] GICv3: CPU3: using allocated LPI pending table @0x0000000100f70000137gitlab # [ 0.008629] CPU3: Booted secondary processor 0x0000000003 [0xc00fac40]138gitlab # [ 0.009114] smp: Brought up 1 node, 4 CPUs139gitlab # [ 0.009140] SMP: Total of 4 processors activated.140gitlab # [ 0.009142] CPU: All CPU(s) started at EL1141gitlab # [ 0.009151] CPU features: detected: Branch Target Identification142gitlab # [ 0.009155] CPU features: detected: ARMv8.4 Translation Table Level143gitlab # [ 0.009157] CPU features: detected: Instruction cache invalidation not required for I/D coherence144gitlab # [ 0.009161] CPU features: detected: Data cache clean to the PoU not required for I/D coherence145gitlab # [ 0.009164] CPU features: detected: Common not Private translations146gitlab # [ 0.009167] CPU features: detected: CRC32 instructions147gitlab # [ 0.009169] CPU features: detected: Data cache clean to Point of Deep Persistence148gitlab # [ 0.009172] CPU features: detected: Data cache clean to Point of Persistence149gitlab # [ 0.009175] CPU features: detected: Data independent timing control (DIT)150gitlab # [ 0.009178] CPU features: detected: E0PD151gitlab # [ 0.009180] CPU features: detected: Enhanced Counter Virtualization152gitlab # [ 0.009183] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF)153gitlab # [ 0.009186] CPU features: detected: Enhanced Virtualization Traps154gitlab # [ 0.009188] CPU features: detected: Fine Grained Traps155gitlab # [ 0.009191] CPU features: detected: Generic authentication (architected QARMA5 algorithm)156gitlab # [ 0.009195] CPU features: detected: RCpc load-acquire (LDAPR)157gitlab # [ 0.009197] CPU features: detected: LSE atomic instructions158gitlab # [ 0.009200] CPU features: detected: Privileged Access Never159gitlab # [ 0.009202] CPU features: detected: PMUv3160gitlab # [ 0.009205] CPU features: detected: RAS Extension Support161gitlab # [ 0.009207] CPU features: detected: RASv1p1 Extension Support162gitlab # [ 0.009210] CPU features: detected: Random Number Generator163gitlab # [ 0.009212] CPU features: detected: Speculation barrier (SB)164gitlab # [ 0.009214] CPU features: detected: Stage-2 Force Write-Back165gitlab # [ 0.009217] CPU features: detected: TLB range maintenance instructions166gitlab # [ 0.009220] CPU features: detected: Speculative Store Bypassing Safe (SSBS)167gitlab # [ 0.009346] alternatives: applying system-wide alternatives168gitlab # [ 0.012257] CPU features: detected: BBM Level 2 without TLB conflict abort169gitlab # [ 0.012420] Memory: 5963756K/6291456K available (24448K kernel code, 7090K rwdata, 26340K rodata, 4736K init, 1106K bss, 272908K reserved, 32768K cma-reserved)170gitlab # [ 0.013824] devtmpfs: initialized171gitlab # [ 0.017714] posixtimers hash table entries: 2048 (order: 3, 32768 bytes, linear)172gitlab # [ 0.017778] futex hash table entries: 1024 (65536 bytes on 1 NUMA nodes, total 64 KiB, linear).173gitlab # [ 0.017970] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL174gitlab # [ 0.017974] 0 pages in range for non-PLT usage175gitlab # [ 0.017975] 508288 pages in range for PLT usage176gitlab # [ 0.018088] pinctrl core: initialized pinctrl subsystem177gitlab # [ 0.018836] DMI not present or invalid.178gitlab # [ 0.021927] NET: Registered PF_NETLINK/PF_ROUTE protocol family179gitlab # [ 0.024567] DMA: preallocated 1024 KiB GFP_KERNEL pool for atomic allocations180gitlab # [ 0.024834] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations181gitlab # [ 0.026567] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations182gitlab # [ 0.026589] audit: initializing netlink subsys (disabled)183gitlab # [ 0.026879] audit: type=2000 audit(0.024:1): state=initialized audit_enabled=0 res=1184gitlab # [ 0.027351] thermal_sys: Registered thermal governor 'fair_share'185gitlab # [ 0.027354] thermal_sys: Registered thermal governor 'bang_bang'186gitlab # [ 0.027359] thermal_sys: Registered thermal governor 'step_wise'187gitlab # [ 0.027361] thermal_sys: Registered thermal governor 'user_space'188gitlab # [ 0.027364] thermal_sys: Registered thermal governor 'power_allocator'189gitlab # [ 0.027442] cpuidle: using governor ladder190gitlab # [ 0.027464] cpuidle: using governor menu191gitlab # [ 0.027667] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers.192gitlab # [ 0.027870] ASID allocator initialised with 65536 entries193gitlab # [ 0.029023] Serial: AMBA PL011 UART driver194gitlab # [ 0.034174] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1195gitlab # [ 0.034483] printk: console [ttyAMA0] enabled196gitlab # [ 0.044510] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages197gitlab # [ 0.044535] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page198gitlab # [ 0.044544] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages199gitlab # [ 0.044552] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page200gitlab # [ 0.044561] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages201gitlab # [ 0.044568] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page202gitlab # [ 0.044577] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages203gitlab # [ 0.044585] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page204gitlab # [ 0.058331] fbcon: Taking over console205gitlab # [ 0.058343] ACPI: Interpreter disabled.206gitlab # [ 0.059364] iommu: Default domain type: Translated207gitlab # [ 0.059382] iommu: DMA domain TLB invalidation policy: strict mode208gitlab # [ 0.068851] SCSI subsystem initialized209gitlab # [ 0.069230] usbcore: registered new interface driver usbfs210gitlab # [ 0.069257] usbcore: registered new interface driver hub211gitlab # [ 0.069273] usbcore: registered new device driver usb212gitlab # [ 0.069535] pps_core: LinuxPPS API ver. 1 registered213gitlab # [ 0.069538] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>214gitlab # [ 0.069555] PTP clock support registered215gitlab # [ 0.069593] EDAC MC: Ver: 3.0.0216gitlab # [ 0.070213] scmi_core: SCMI protocol bus registered217gitlab # [ 0.071209] FPGA manager framework218gitlab # [ 0.071936] vgaarb: loaded219gitlab # [ 0.074213] clocksource: Switched to clocksource arch_sys_counter220gitlab # [ 0.075640] VFS: Disk quotas dquot_6.6.0221gitlab # [ 0.075703] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)222gitlab # [ 0.076464] netfs: FS-Cache loaded223gitlab # [ 0.076812] pnp: PnP ACPI: disabled224gitlab # [ 0.086107] NET: Registered PF_INET protocol family225gitlab # [ 0.088513] IP idents hash table entries: 131072 (order: 8, 1048576 bytes, linear)226gitlab # [ 0.149295] tcp_listen_portaddr_hash hash table entries: 4096 (order: 4, 65536 bytes, linear)227gitlab # [ 0.149368] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)228gitlab # [ 0.149432] TCP established hash table entries: 65536 (order: 7, 524288 bytes, linear)229gitlab # [ 0.149831] TCP bind hash table entries: 65536 (order: 9, 2097152 bytes, linear)230gitlab # [ 0.150794] TCP: Hash tables configured (established 65536 bind 65536)231gitlab # [ 0.150955] MPTCP token hash table entries: 8192 (order: 6, 196608 bytes, linear)232gitlab # [ 0.151042] UDP hash table entries: 4096 (order: 6, 262144 bytes, linear)233gitlab # [ 0.151237] UDP-Lite hash table entries: 4096 (order: 6, 262144 bytes, linear)234gitlab # [ 0.151497] NET: Registered PF_UNIX/PF_LOCAL protocol family235gitlab # [ 0.151525] NET: Registered PF_XDP protocol family236gitlab # [ 0.151546] PCI: CLS 0 bytes, default 64237gitlab # [ 0.151881] Trying to unpack rootfs image as initramfs...238gitlab # [ 0.162860] kvm [1]: HYP mode not available239gitlab # [ 0.238287] Initialise system trusted keyrings240gitlab # [ 0.238553] workingset: timestamp_bits=42 max_order=21 bucket_order=0241gitlab # [ 0.239214] squashfs: version 4.0 (2009/01/31) Phillip Lougher242gitlab # [ 0.239347] 9p: Installing v9fs 9p2000 file system support243gitlab # [ 0.254554] Key type asymmetric registered244gitlab # [ 0.254569] Asymmetric key parser 'x509' registered245gitlab # [ 0.254642] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242)246gitlab # [ 0.254801] io scheduler mq-deadline registered247gitlab # [ 0.254807] io scheduler kyber registered248gitlab # [ 0.263929] pl061_gpio 9030000.pl061: PL061 GPIO chip registered249gitlab # [ 0.266396] ledtrig-cpu: registered to indicate activity on CPUs250gitlab # [ 0.266920] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges:251gitlab # [ 0.266940] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000252gitlab # [ 0.266954] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000253gitlab # [ 0.266963] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000254gitlab # [ 0.267000] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits255gitlab # [ 0.267027] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff]256gitlab # [ 0.267186] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00257gitlab # [ 0.267197] pci_bus 0000:00: root bus resource [bus 00-ff]258gitlab # [ 0.267202] pci_bus 0000:00: root bus resource [io 0x0000-0xffff]259gitlab # [ 0.267207] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff]260gitlab # [ 0.267211] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff]261gitlab # [ 0.267340] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint262gitlab # [ 0.268129] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint263gitlab # [ 0.268502] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f]264gitlab # [ 0.268521] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff]265gitlab # [ 0.268561] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]266gitlab # [ 0.268580] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref]267gitlab # [ 0.269348] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint268gitlab # [ 0.269755] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f]269gitlab # [ 0.269774] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff]270gitlab # [ 0.269813] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]271gitlab # [ 0.270612] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint272gitlab # [ 0.270897] pci 0000:00:03.0: BAR 0 [io 0x0000-0x001f]273gitlab # [ 0.270916] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff]274gitlab # [ 0.270955] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]275gitlab # [ 0.271740] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint276gitlab # [ 0.272030] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f]277gitlab # [ 0.272048] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff]278gitlab # [ 0.272088] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]279gitlab # [ 0.272801] pci 0000:00:05.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint280gitlab # [ 0.273187] pci 0000:00:05.0: BAR 0 [io 0x0000-0x007f]281gitlab # [ 0.273205] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff]282gitlab # [ 0.273245] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]283gitlab # [ 0.273979] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint284gitlab # [ 0.274317] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f]285gitlab # [ 0.274334] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff]286gitlab # [ 0.274373] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]287gitlab # [ 0.275124] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint288gitlab # [ 0.275413] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f]289gitlab # [ 0.275431] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff]290gitlab # [ 0.275474] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]291gitlab # [ 0.275492] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref]292gitlab # [ 0.276276] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint293gitlab # [ 0.276601] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff]294gitlab # [ 0.276639] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]295gitlab # [ 0.277371] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint296gitlab # [ 0.277695] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff]297gitlab # [ 0.277733] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]298gitlab # [ 0.278389] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint299gitlab # [ 0.278683] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff]300gitlab # [ 0.279070] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint301gitlab # [ 0.279489] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f]302gitlab # [ 0.279507] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff]303gitlab # [ 0.279545] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]304gitlab # [ 0.280293] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint305gitlab # [ 0.280572] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f]306gitlab # [ 0.280589] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff]307gitlab # [ 0.280635] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]308gitlab # [ 0.281637] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned309gitlab # [ 0.281646] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned310gitlab # [ 0.281652] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned311gitlab # [ 0.281721] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned312gitlab # [ 0.281783] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned313gitlab # [ 0.281847] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned314gitlab # [ 0.281909] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned315gitlab # [ 0.281974] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned316gitlab # [ 0.282037] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned317gitlab # [ 0.282108] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned318gitlab # [ 0.282186] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned319gitlab # [ 0.282266] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned320gitlab # [ 0.282351] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned321gitlab # [ 0.282414] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned322gitlab # [ 0.282440] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned323gitlab # [ 0.282466] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned324gitlab # [ 0.282499] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned325gitlab # [ 0.282525] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned326gitlab # [ 0.282551] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned327gitlab # [ 0.282577] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned328gitlab # [ 0.282604] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned329gitlab # [ 0.282638] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned330gitlab # [ 0.282665] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned331gitlab # [ 0.282693] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned332gitlab # [ 0.282727] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned333gitlab # [ 0.282753] pci 0000:00:05.0: BAR 0 [io 0x1000-0x107f]: assigned334gitlab # [ 0.282784] pci 0000:00:06.0: BAR 0 [io 0x1080-0x10ff]: assigned335gitlab # [ 0.282810] pci 0000:00:0b.0: BAR 0 [io 0x1100-0x113f]: assigned336gitlab # [ 0.282836] pci 0000:00:01.0: BAR 0 [io 0x1140-0x115f]: assigned337gitlab # [ 0.282861] pci 0000:00:02.0: BAR 0 [io 0x1160-0x117f]: assigned338gitlab # [ 0.282895] pci 0000:00:03.0: BAR 0 [io 0x1180-0x119f]: assigned339gitlab # [ 0.282920] pci 0000:00:04.0: BAR 0 [io 0x11a0-0x11bf]: assigned340gitlab # [ 0.282946] pci 0000:00:07.0: BAR 0 [io 0x11c0-0x11df]: assigned341gitlab # [ 0.282972] pci 0000:00:0c.0: BAR 0 [io 0x11e0-0x11ff]: assigned342gitlab # [ 0.283004] pci_bus 0000:00: resource 4 [io 0x0000-0xffff]343gitlab # [ 0.283012] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff]344gitlab # [ 0.283017] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff]345gitlab # [ 0.284803] pci 0000:00:0a.0: enabling device (0000 -> 0002)346gitlab # [ 0.301832] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003)347gitlab # [ 0.304838] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003)348gitlab # [ 0.307539] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003)349gitlab # [ 0.310275] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003)350gitlab # [ 0.314012] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003)351gitlab # [ 0.318347] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003)352gitlab # [ 0.321025] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003)353gitlab # [ 0.323912] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002)354gitlab # [ 0.328327] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002)355gitlab # [ 0.332007] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003)356gitlab # [ 0.334810] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003)357gitlab # [ 0.342352] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled358gitlab # [ 0.344758] msm_serial: driver initialized359gitlab # [ 0.344962] SuperH (H)SCI(F) driver initialized360gitlab # [ 0.345048] STM32 USART driver initialized361gitlab # [ 0.384825] loop: module loaded362gitlab # [ 0.385332] virtio_blk virtio4: 4/0/0 default/read/poll queues363gitlab # [ 0.390731] virtio_blk virtio4: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)364gitlab # [ 0.395418] virtio_blk virtio5: 4/0/0 default/read/poll queues365gitlab # [ 0.400499] virtio_blk virtio5: [vdb] 12145296 512-byte logical blocks (6.22 GB/5.79 GiB)366gitlab # [ 0.405812] megasas: 07.734.00.00-rc1367gitlab # [ 0.408083] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff]368gitlab # [ 0.413755] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000369gitlab # [ 0.413794] Intel/Sharp Extended Query Table at 0x0031370gitlab # [ 0.418952] Using buffer write method371gitlab # [ 0.419064] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff]372gitlab # [ 0.425690] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000373gitlab # [ 0.425728] Intel/Sharp Extended Query Table at 0x0031374gitlab # [ 0.429770] Using buffer write method375gitlab # [ 0.429803] Concatenating MTD devices:376gitlab # [ 0.429810] (0): "0.flash"377gitlab # [ 0.429816] (1): "0.flash"378gitlab # [ 0.429821] into device "0.flash"379gitlab # [ 0.648931] Freeing initrd memory: 27184K380gitlab # [ 0.661581] tun: Universal TUN/TAP device driver, 1.6381gitlab # [ 0.667410] thunder_xcv, ver 1.0382gitlab # [ 0.667496] thunder_bgx, ver 1.0383gitlab # [ 0.667536] nicpf, ver 1.0384gitlab # [ 0.668684] e1000: Intel(R) PRO/1000 Network Driver385gitlab # [ 0.668692] e1000: Copyright (c) 1999-2006 Intel Corporation.386gitlab # [ 0.668737] e1000e: Intel(R) PRO/1000 Network Driver387gitlab # [ 0.668746] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.388gitlab # [ 0.668808] igb: Intel(R) Gigabit Ethernet Network Driver389gitlab # [ 0.668816] igb: Copyright (c) 2007-2014 Intel Corporation.390gitlab # [ 0.668856] igbvf: Intel(R) Gigabit Virtual Function Network Driver391gitlab # [ 0.668863] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.392gitlab # [ 0.669125] sky2: driver version 1.30393gitlab # [ 0.672280] usbcore: registered new interface driver usb-storage394gitlab # [ 0.672506] usbcore: registered new interface driver usbserial_generic395gitlab # [ 0.672533] usbserial: USB Serial support registered for generic396gitlab # [ 0.673233] ehci-pci 0000:00:0a.0: EHCI Host Controller397gitlab # [ 0.673292] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 1398gitlab # [ 0.673756] hv_vmbus: registering driver hyperv_keyboard399gitlab # [ 0.673989] ehci-pci 0000:00:0a.0: irq 15, io mem 0x10089000400gitlab # [ 0.675536] rtc-pl031 9010000.pl031: registered as rtc0401gitlab # [ 0.675638] rtc-pl031 9010000.pl031: setting system clock to 2026-08-13T13:13:54 UTC (1786626834)402gitlab # [ 0.676242] i2c_dev: i2c /dev entries driver403gitlab # [ 0.681619] sdhci: Secure Digital Host Controller Interface driver404gitlab # [ 0.681627] sdhci: Copyright(c) Pierre Ossman405gitlab # [ 0.682158] Synopsys Designware Multimedia Card Interface Driver406gitlab # [ 0.682352] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.00407gitlab # [ 0.682924] sdhci-pltfm: SDHCI platform and OF driver helper408gitlab # [ 0.683386] hub 1-0:1.0: USB hub found409gitlab # [ 0.683426] hub 1-0:1.0: 6 ports detected410gitlab # [ 0.686179] hid: raw HID events driver (C) Jiri Kosina411gitlab # [ 0.686824] usbcore: registered new interface driver usbhid412gitlab # [ 0.686831] usbhid: USB HID core driver413gitlab # [ 0.727850] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available414gitlab # [ 0.732719] drop_monitor: Initializing network drop monitor service415gitlab # [ 0.733062] NET: Registered PF_INET6 protocol family416gitlab # [ 0.735106] Segment Routing with IPv6417gitlab # [ 0.735141] In-situ OAM (IOAM) with IPv6418gitlab # [ 0.735233] NET: Registered PF_PACKET protocol family419gitlab # [ 0.735522] 9pnet: Installing 9P2000 support420gitlab # [ 0.740066] Key type dns_resolver registered421gitlab # [ 0.759369] registered taskstats version 1422gitlab # [ 0.759977] Loading compiled-in X.509 certificates423gitlab # [ 0.784993] Demotion targets for Node 0: null424gitlab # [ 0.785255] Key type .fscrypt registered425gitlab # [ 0.785263] Key type fscrypt-provisioning registered426gitlab # [ 0.785475] ima: No TPM chip found, activating TPM-bypass!427gitlab # [ 0.785500] ima: Allocated hash algorithm: sha1428gitlab # [ 0.785533] ima: No architecture policies found429gitlab # [ 0.786872] input: gpio-keys as /devices/platform/gpio-keys/input/input0430gitlab # [ 0.812371] clk: Disabling unused clocks431gitlab # [ 0.812402] PM: genpd: Disabling unused power domains432gitlab # [ 0.817062] Freeing unused kernel memory: 4736K433gitlab # [ 0.817273] Run /init as init process434gitlab # [ 0.848251] systemd[1]: Successfully made /usr/ read-only.435gitlab # [ 0.946286] usb 1-1: new high-speed USB device number 2 using ehci-pci436gitlab # [ 1.107161] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input1437gitlab # [ 1.182807] systemd[1]: systemd 261.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)438gitlab # [ 1.182878] systemd[1]: Detected virtualization qemu.439gitlab # [ 1.182943] systemd[1]: Detected architecture arm64.440gitlab # [ 1.182959] systemd[1]: Running in initrd.441gitlab # [ 1.183837] systemd[1]: Initializing machine ID from random generator.442gitlab # [ 1.184097] systemd[1]: Hostname set to <gitlab>.443gitlab # [ 1.215095] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input0444gitlab # [ 1.334300] usb 1-2: new high-speed USB device number 3 using ehci-pci445gitlab # [ 1.449907] systemd[1]: bpf-restrict-fs: LSM BPF program attached446gitlab # [ 1.490528] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input2447gitlab # [ 1.490976] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input0448gitlab # [ 1.553916] systemd[1]: Queued start job for default target Initrd Default Target.449gitlab # [ 1.574713] systemd[1]: Created slice Slice /system/modprobe.450gitlab # [ 1.575078] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.451gitlab # [ 1.575131] systemd[1]: Expecting device /dev/disk/by-label/nix-store...452gitlab # [ 1.575154] systemd[1]: Expecting device /dev/disk/by-label/nixos...453gitlab # [ 1.575191] systemd[1]: Reached target Path Units.454gitlab # [ 1.575217] systemd[1]: Reached target Slice Units.455gitlab # [ 1.575250] systemd[1]: Reached target Swaps.456gitlab # [ 1.575280] systemd[1]: Reached target Timer Units.457gitlab # [ 1.575527] systemd[1]: Listening on D-Bus System Message Bus Socket.458gitlab # [ 1.575811] systemd[1]: Listening on Journal Socket (/dev/log).459gitlab # [ 1.576057] systemd[1]: Listening on Journal Sockets.460gitlab # [ 1.576346] systemd[1]: Listening on udev Control Socket.461gitlab # [ 1.576492] systemd[1]: Listening on udev Kernel Socket.462gitlab # [ 1.576524] systemd[1]: Reached target Socket Units.463gitlab # [ 1.579116] systemd[1]: Starting Create List of Static Device Nodes...464gitlab # [ 1.581647] systemd[1]: Starting Load Kernel Module 9pnet_virtio...465gitlab # [ 1.581751] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs466gitlab # [ 1.584571] systemd[1]: Mounting Kernel Configuration File System...467gitlab # [ 1.608314] systemd[1]: Starting Journal Service...468gitlab # [ 1.613838] systemd[1]: Starting Load Kernel Modules...469gitlab # [ 1.613979] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os470gitlab # [ 1.622369] systemd[1]: Starting Coldplug All udev Devices...471gitlab # [ 1.624620] systemd[1]: Finished Create List of Static Device Nodes.472gitlab # [ 1.625861] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.473gitlab # [ 1.627837] systemd[1]: Finished Load Kernel Module 9pnet_virtio.474gitlab # [ 1.628250] systemd[1]: Mounted Kernel Configuration File System.475gitlab # [ 1.634626] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...476gitlab # [ 1.657526] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.477gitlab # [ 1.659546] systemd[1]: Starting Create Static Device Nodes in /dev...478gitlab # [ 1.666998] [drm] pci: virtio-gpu-pci detected at 0000:00:08.0479gitlab # [ 1.667331] [drm] features: -virgl +edid -resource_blob -host_visible480gitlab # [ 1.667338] [drm] features: -context_init481gitlab # [ 1.668949] [drm] number of scanouts: 1482gitlab # [ 1.668976] [drm] number of cap sets: 0483gitlab # [ 1.672843] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.484gitlab # [ 1.677897] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev485gitlab # [ 1.677910] systemd[1]: Finished Create Static Device Nodes in /dev.486gitlab # [ 1.678308] systemd[1]: Reached target Preparation for Local File Systems.487gitlab # [ 1.678335] systemd[1]: Reached target Local File Systems.488gitlab # [ 1.683864] systemd[1]: Starting Rule-based Manager for Device Events and Files...489gitlab # [ 1.684323] systemd-journald[96]: Collecting audit messages is disabled.490gitlab # [ 1.691153] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic491gitlab # [ 1.691193] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 0492gitlab # [ 1.713314] Console: switching to colour frame buffer device 160x50493gitlab # [ 1.723502] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device494gitlab # [ 1.733309] systemd[1]: Started Rule-based Manager for Device Events and Files.495gitlab # [ 1.747009] systemd[1]: Finished Load Kernel Modules.496gitlab # [ 1.750779] systemd[1]: Starting Apply Kernel Variables...497gitlab # [ 1.766776] systemd[1]: Starting Virtual Console Setup...498gitlab # [ 1.785913] systemd[1]: Started Journal Service.499gitlab # [ 1.785417] systemd-modules-load[97]: Using 4 probe threads500gitlab # [ 1.787471] systemd-modules-load[97]: Module 'virtio_balloon' is built in501gitlab # [ 1.788773] systemd-modules-load[97]: Module 'virtio_console' is built in502gitlab # [ 1.790590] systemd-modules-load[97]: Module 'virtio_rng' is built in503gitlab # [ 1.792795] systemd-modules-load[97]: Inserted module 'dm_mod'504gitlab # [ 1.794159] systemd-udevd[106]: Using default interface naming scheme 'v261'.505gitlab # [ 1.796339] systemd-modules-load[97]: Inserted module 'virtio_gpu'506gitlab # [ 1.797433] systemd[1]: Starting Create System Files and Directories...507gitlab # [ 1.802048] systemd[1]: Finished Apply Kernel Variables.508gitlab # [ 1.808248] systemd[1]: Finished Create System Files and Directories.509gitlab # [ 1.811967] systemd-vconsole-setup[118]: Configuration of first virtual console was skipped, ignoring remaining ones.510gitlab # [ 1.815917] systemd[1]: Finished Virtual Console Setup.511gitlab # [ 2.435564] systemd[1]: Finished Coldplug All udev Devices.512gitlab # [ 2.438601] systemd[1]: Reached target System Initialization.513gitlab # [ 2.441278] systemd[1]: Reached target Basic System.514gitlab # [ 2.706643] (udev-worker)[113]: Network interface NamePolicy= disabled on kernel command line.515gitlab # [ 2.710095] (udev-worker)[108]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.516gitlab # [ 2.715281] (udev-worker)[108]: Network interface NamePolicy= disabled on kernel command line.517gitlab # [ 2.731797] systemd[1]: Found device /dev/disk/by-label/nixos.518gitlab # [ 2.737081] systemd[1]: Reached target Initrd Root Device.519gitlab # [ 2.741988] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...520gitlab # [ 2.747428] systemd[1]: Found device /dev/disk/by-label/nix-store.521gitlab # [ 2.789222] systemd-fsck[151]: nixos: clean, 12/65536 files, 13019/262144 blocks522gitlab # [ 2.797131] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.523gitlab # [ 2.799996] systemd[1]: Mounting /sysroot...524gitlab # [ 2.844698] EXT4-fs (vda): mounted filesystem 67ed1514-16cb-40ac-b8f2-c69f2a9d9822 r/w with ordered data mode. Quota mode: none.525gitlab # [ 2.845552] systemd[1]: Mounted /sysroot.526gitlab # [ 2.847805] systemd[1]: Reached target Initrd Root File System.527gitlab # [ 2.849293] systemd[1]: Starting Mountpoints Configured in the Real Root...528gitlab # [ 2.882675] systemd-sysroot-fstab-check[160]: /sysroot should be mounted in the initrd, will request daemon-reload.529gitlab # [ 2.885154] systemd[1]: Reload requested from client PID 160 ('systemd-sysroot') (unit initrd-parse-etc.service)...530gitlab # [ 2.887630] systemd[1]: Reloading...531gitlab # [ 2.989683] systemd[1]: Reloading finished in 104 ms.532gitlab # [ 3.035049] systemd-sysroot-fstab-check[160]: Requesting initrd-fs.target/start/replace...533gitlab # [ 3.037160] systemd-sysroot-fstab-check[160]: Requesting swap.target/start/replace...534gitlab # [ 3.041696] systemd[1]: Starting Load Kernel Module 9pnet_virtio...535gitlab # [ 3.044058] systemd[1]: initrd-parse-etc.service: Deactivated successfully.536gitlab # [ 3.052351] systemd[1]: Finished Mountpoints Configured in the Real Root.537gitlab # [ 3.053407] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies.538gitlab # [ 3.063538] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.539gitlab # [ 3.064899] systemd[1]: Finished Load Kernel Module 9pnet_virtio.540gitlab # [ 3.356835] (udev-worker)[134]: mtd0ro: Failed to find and pin callout binary "/nix/store/x3ma60wd3w0db1m4dr1xln72q96lnm3b-systemd-261.1/lib/udev/mtd_probe": No such file or directory541gitlab # [ 3.360778] (udev-worker)[134]: mtd0ro: /nix/store/x3ma60wd3w0db1m4dr1xln72q96lnm3b-systemd-261.1/lib/udev/rules.d/75-probe_mtd.rules:5 IMPORT{program}="mtd_probe $devnode": Failed to execute "mtd_probe /dev/mtd0ro", ignoring: No such file or directory542gitlab # [ 3.371179] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.543gitlab # [ 3.372659] systemd[1]: Stopped Virtual Console Setup.544gitlab # [ 3.373781] systemd[1]: Stopping Virtual Console Setup...545gitlab # [ 3.376311] systemd[1]: Starting Virtual Console Setup...546gitlab # [ 3.393071] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.547gitlab # [ 3.394309] systemd[1]: Stopped Virtual Console Setup.548gitlab # [ 3.395764] systemd[1]: Starting Virtual Console Setup...549gitlab # [ 3.436093] systemd-vconsole-setup[183]: Configuration of first virtual console was skipped, ignoring remaining ones.550gitlab # [ 3.439294] systemd[1]: Finished Virtual Console Setup.551gitlab # [ 3.630433] systemd[1]: Mounting /sysroot/nix/.ro-store...552gitlab # [ 3.634199] systemd[1]: Mounting /sysroot/nix/.rw-store...553gitlab # [ 3.640186] systemd[1]: Mounting /sysroot/run...554gitlab # [ 3.655154] systemd[1]: Mounting /sysroot/tmp/shared...555gitlab # [ 3.664624] systemd[1]: Mounting /sysroot/tmp/xchg...556gitlab # [ 3.675381] systemd[1]: Mounted /sysroot/nix/.rw-store.557gitlab # [ 3.684514] systemd[1]: Starting rw-sysroot-nix-store.service...558gitlab # [ 3.692554] systemd[1]: Mounted /sysroot/run.559gitlab # [ 3.705776] systemd[1]: Mounted /sysroot/tmp/shared.560gitlab # [ 3.711410] erofs (device vdb): mounted with root inode @ nid 128.561gitlab # [ 3.715249] systemd[1]: Mounted /sysroot/tmp/xchg.562gitlab # [ 3.717913] systemd[1]: Mounted /sysroot/nix/.ro-store.563gitlab # [ 3.720214] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.564gitlab # [ 3.723219] systemd[1]: Finished rw-sysroot-nix-store.service.565gitlab # [ 4.628245] systemd[1]: Mounting /sysroot/nix/store...566gitlab # [ 4.695750] systemd[1]: Mounted /sysroot/nix/store.567gitlab # [ 4.698183] systemd[1]: Reached target Initrd File Systems.568gitlab # [ 4.700634] systemd[1]: Starting Find NixOS closure...569gitlab # [ 4.703839] systemd[1]: Starting Create Volatile Files and Directories in the Real Root...570gitlab # [ 4.744791] systemd[1]: Finished Create Volatile Files and Directories in the Real Root.571gitlab # [ 4.748479] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully.572gitlab # [ 4.768857] systemd[1]: Finished Find NixOS closure.573gitlab # [ 4.771144] systemd[1]: Reached target Initrd Default Target.574gitlab # [ 4.773776] systemd[1]: Starting Cleaning Up and Shutting Down Daemons...575gitlab # [ 4.824744] systemd[1]: Stopped target Initrd Default Target.576gitlab # [ 4.827273] systemd[1]: Stopped target Basic System.577gitlab # [ 4.829583] systemd[1]: Stopped target Initrd Root Device.578gitlab # [ 4.831937] systemd[1]: Stopped target Path Units.579gitlab # [ 4.834319] systemd[1]: systemd-ask-password-console.path: Deactivated successfully.580gitlab # [ 4.837634] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch.581gitlab # [ 4.840906] systemd[1]: Stopped target Slice Units.582gitlab # [ 4.843034] systemd[1]: Stopped target Socket Units.583gitlab # [ 4.848152] systemd[1]: Stopped target System Initialization.584gitlab # [ 4.852818] systemd[1]: Stopped target Swaps.585gitlab # [ 4.855977] systemd[1]: Stopped target Timer Units.586gitlab # [ 4.860377] systemd[1]: dbus.socket: Deactivated successfully.587gitlab # [ 4.864073] systemd[1]: Closed D-Bus System Message Bus Socket.588gitlab # [ 4.866963] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully.589gitlab # [ 4.870439] systemd[1]: Stopped Find NixOS closure.590gitlab # [ 4.872288] systemd[1]: Starting Load Kernel Module 9pnet_virtio...591gitlab # [ 4.874563] systemd[1]: Starting rw-sysroot-nix-store.service...592gitlab # [ 4.876740] systemd[1]: systemd-sysctl.service: Deactivated successfully.593gitlab # [ 4.878853] systemd[1]: Stopped Apply Kernel Variables.594gitlab # [ 4.880530] systemd[1]: systemd-modules-load.service: Deactivated successfully.595gitlab # [ 4.882626] systemd[1]: Stopped Load Kernel Modules.596gitlab # [ 4.884102] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully.597gitlab # [ 4.886283] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root.598gitlab # [ 4.888403] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully.599gitlab # [ 4.890296] systemd[1]: Stopped Create System Files and Directories.600gitlab # [ 4.891944] systemd[1]: Stopped target Local File Systems.601gitlab # [ 4.893441] systemd[1]: Stopped target Preparation for Local File Systems.602gitlab # [ 4.895137] systemd[1]: systemd-udev-trigger.service: Deactivated successfully.603gitlab # [ 4.896908] systemd[1]: Stopped Coldplug All udev Devices.604gitlab # [ 4.898204] systemd[1]: Stopping Rule-based Manager for Device Events and Files...605gitlab # [ 4.900042] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.606gitlab # [ 4.901688] systemd[1]: Stopped Virtual Console Setup.607gitlab # [ 4.902890] systemd[1]: initrd-cleanup.service: Deactivated successfully.608gitlab # [ 4.904433] systemd[1]: Finished Cleaning Up and Shutting Down Daemons.609gitlab # [ 4.905927] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.610gitlab # [ 4.907542] systemd[1]: Finished Load Kernel Module 9pnet_virtio.611gitlab # [ 4.908989] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.612gitlab # [ 4.910594] systemd[1]: Finished rw-sysroot-nix-store.service.613gitlab # [ 4.911918] systemd[1]: systemd-udevd.service: Deactivated successfully.614gitlab # [ 4.913542] systemd[1]: Stopped Rule-based Manager for Device Events and Files.615gitlab # [ 4.915144] systemd[1]: systemd-udevd.service: Consumed 2.730s CPU time over 3.212s wall clock time, 31.5M memory peak.616gitlab # [ 4.917556] systemd[1]: systemd-udevd-control.socket: Deactivated successfully.617gitlab # [ 4.919187] systemd[1]: Closed udev Control Socket.618gitlab # [ 4.920340] systemd[1]: Starting Cleanup udev Database...619gitlab # [ 4.921563] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully.620gitlab # [ 4.923245] systemd[1]: Stopped Create Static Device Nodes in /dev.621gitlab # [ 4.924694] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully.622gitlab # [ 4.926486] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully.623gitlab # [ 4.928122] systemd[1]: kmod-static-nodes.service: Deactivated successfully.624gitlab # [ 4.929867] systemd[1]: Stopped Create List of Static Device Nodes.625gitlab # [ 5.020419] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully.626gitlab # [ 5.023743] systemd[1]: Finished Cleanup udev Database.627gitlab # [ 5.026220] systemd[1]: Reached target Switch Root.628gitlab # [ 5.028386] systemd[1]: Starting NixOS Activation...629gitlab # [ 5.205582] initrd-nixos-activation-start[223]: booting system configuration /nix/store/912r8qy7i51qp904kz49jszmj0r6x67f-nixos-system-gitlab-test630gitlab # [ 5.267289] initrd-nixos-activation-start[223]: running activation script...631gitlab # [ 5.580801] initrd-nixos-activation-start[246]: setting up /etc...632gitlab # [ 5.786157] systemd[1]: initrd-nixos-activation.service: Deactivated successfully.633gitlab # [ 5.789924] systemd[1]: Finished NixOS Activation.634gitlab # [ 5.792116] systemd[1]: Starting Switch Root...635gitlab # [ 5.844958] systemd[1]: Switching root.636gitlab # [ 5.955076] systemd-journald[96]: Received SIGTERM from PID 1 (systemd).637gitlab # [ 6.588247] systemd[1]: systemd 261.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)638gitlab # [ 6.588392] systemd[1]: Detected virtualization qemu.639gitlab # [ 6.588476] systemd[1]: Detected architecture arm64.640gitlab # [ 6.588659] systemd[1]: Detected first boot.641gitlab # [ 6.590064] systemd[1]: Initializing machine ID from random generator.642gitlab # [ 6.855482] systemd[1]: bpf-restrict-fs: LSM BPF program attached643gitlab # [ 6.974629] systemd[1]: Applying preset policy.644gitlab # [ 7.186305] systemd[1]: Populated /etc with preset unit settings.645gitlab # [ 7.329825] systemd[1]: initrd-switch-root.service: Deactivated successfully.646gitlab # [ 7.330286] systemd[1]: Stopped initrd-switch-root.service.647gitlab # [ 7.334556] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1.648gitlab # [ 7.341477] systemd[1]: Created slice Slice /system/getty.649gitlab # [ 7.345423] systemd[1]: Created slice GitLab DevOps Platform Slice.650gitlab # [ 7.349570] systemd[1]: Created slice User and Session Slice.651gitlab # [ 7.352350] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.652gitlab # [ 7.353742] systemd[1]: Started Forward Password Requests to Wall Directory Watch.653gitlab # [ 7.355036] systemd[1]: Expecting device /dev/hvc0...654gitlab # [ 7.356175] systemd[1]: Expecting device /dev/ttyAMA0...655gitlab # [ 7.357277] systemd[1]: Reached target Local Encrypted Volumes.656gitlab # [ 7.358621] systemd[1]: Stopped target initrd-fs.target.657gitlab # [ 7.359825] systemd[1]: Stopped target initrd-root-fs.target.658gitlab # [ 7.360896] systemd[1]: Stopped target initrd-switch-root.target.659gitlab # [ 7.361998] systemd[1]: Reached target Virtual Machines and Containers.660gitlab # [ 7.363138] systemd[1]: Reached target Path Units.661gitlab # [ 7.364240] systemd[1]: Reached target Remote File Systems.662gitlab # [ 7.365307] systemd[1]: Reached target Slice Units.663gitlab # [ 7.366387] systemd[1]: Reached target Swaps.664gitlab # [ 7.370452] systemd[1]: Listening on Query the User Interactively for a Password.665gitlab # [ 7.374735] systemd[1]: Listening on Process Core Dump Socket.666gitlab # [ 7.377871] systemd[1]: Listening on Credential Encryption/Decryption.667gitlab # [ 7.381578] systemd[1]: Listening on Factory Reset Management.668gitlab # [ 7.382970] systemd[1]: Listening on Hostname Service Socket.669gitlab # [ 7.393205] systemd[1]: Starting Journal Log Access Socket...670gitlab # [ 7.395458] systemd[1]: Listening on Journal Audit Socket.671gitlab # [ 7.399395] systemd[1]: Listening on Console Output Muting Service Socket.672gitlab # [ 7.400996] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket.673gitlab # [ 7.402119] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os674gitlab # [ 7.403186] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki675gitlab # [ 7.409341] systemd[1]: Listening on Disk Repartitioning Service Socket.676gitlab # [ 7.410707] systemd[1]: Listening on udev Control Socket.677gitlab # [ 7.412085] systemd[1]: Listening on udev Varlink Socket.678gitlab # [ 7.420485] systemd[1]: Mounting Huge Pages File System...679gitlab # [ 7.430082] systemd[1]: Mounting POSIX Message Queue File System...680gitlab # [ 7.439965] systemd[1]: Mounting Kernel Debug File System...681gitlab # [ 7.454516] systemd[1]: Mounting Kernel Trace File System...682gitlab # [ 7.464575] systemd[1]: Starting Create List of Static Device Nodes...683gitlab # [ 7.469389] systemd[1]: Starting Load Kernel Module 9pnet_virtio...684gitlab # [ 7.470291] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs685gitlab # [ 7.482544] systemd[1]: Mounting Kernel Configuration File System...686gitlab # [ 7.483433] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm687gitlab # [ 7.484242] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore688gitlab # [ 7.495529] systemd[1]: Starting Load Kernel Module fuse...689gitlab # [ 7.496320] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67690gitlab # [ 7.506192] systemd[1]: Starting Journal Service...691gitlab # [ 7.509835] systemd[1]: Starting Load Kernel Modules...692gitlab # [ 7.518441] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer...693gitlab # [ 7.527363] systemd[1]: Starting Remount Root and Kernel File Systems...694gitlab # [ 7.530447] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os695gitlab # [ 7.543949] systemd[1]: Starting Coldplug All udev Devices...696gitlab # [ 7.548719] fuse: init (API version 7.45)697gitlab # [ 7.552830] systemd-journald[317]: Collecting audit messages is enabled.698gitlab # [ 7.555770] systemd[1]: Listening on Journal Log Access Socket.699gitlab # [ 7.556435] systemd[1]: Mounted Huge Pages File System.700gitlab # [ 7.558554] systemd[1]: Mounted POSIX Message Queue File System.701gitlab # [ 7.561053] systemd[1]: Mounted Kernel Debug File System.702gitlab # [ 7.561687] systemd[1]: Mounted Kernel Trace File System.703gitlab # [ 7.562893] systemd[1]: Finished Create List of Static Device Nodes.704gitlab # [ 7.563754] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.705gitlab # [ 7.564518] systemd[1]: Finished Load Kernel Module 9pnet_virtio.706gitlab # [ 7.565269] systemd[1]: Mounted Kernel Configuration File System.707gitlab # [ 7.566173] systemd[1]: modprobe@fuse.service: Deactivated successfully.708gitlab # [ 7.571688] systemd[1]: Queued start job for default target Multi-User System.[ 7.566966] systemd[1]: Finished Load Kernel Module fuse.709gitlab # 710gitlab # [ 7.586390] systemd[1]: Mounting FUSE Control File System...711gitlab # [ 7.587331] systemd[1]: Unnecessary job was removed for /dev/vdb.[ 7.588007] EXT4-fs (vda): re-mounted 67ed1514-16cb-40ac-b8f2-c69f2a9d9822.712gitlab # 713gitlab # [ 7.591094] systemd[1]: systemd-journald.service: Deactivated successfully.714gitlab # [ 7.592814] systemd-modules-load[318]: Using 3 probe threads715gitlab # [ 7.594019] systemd-modules-load[318]: Module 'atkbd' is built in716gitlab # [ 7.595181] systemd-modules-load[318]: Module 'loop' is built in717gitlab # [ 7.596339] systemd-modules-load[318]: Inserted module 'tls'718gitlab # [ 7.602568] systemd-oomd[319]: No swap; memory pressure usage will be degraded719gitlab # [ 7.615445] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...720gitlab # [ 7.617505] systemd[1]: Started Journal Service.721gitlab # [ 7.617418] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer.722gitlab # [ 7.621670] systemd[1]: Finished Load Kernel Modules.723gitlab # [ 7.623338] systemd[1]: Finished Remount Root and Kernel File Systems.724gitlab # [ 7.624653] systemd[1]: Mounted FUSE Control File System.725gitlab # [ 7.635021] systemd[1]: Listening on Disk Image Download Service Socket.726gitlab # [ 7.637853] systemd[1]: Starting Firewall...727gitlab # [ 7.644653] systemd[1]: Starting Flush Journal to Persistent Storage...728gitlab # [ 7.647855] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore729gitlab # [ 7.651374] systemd[1]: Starting Load/Save OS Random Seed...730gitlab # [ 7.653598] systemd[1]: Starting Apply Kernel Variables...731gitlab # [ 7.656151] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os732gitlab # [ 7.672162] systemd-journald[317]: Received client request to flush runtime journal.733gitlab # [ 7.699387] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.734gitlab # [ 7.700910] systemd[1]: Starting Create Static Device Nodes in /dev...735gitlab # [ 7.702017] systemd[1]: Finished Apply Kernel Variables.736gitlab # [ 7.702796] systemd[1]: Finished Load/Save OS Random Seed.737gitlab # [ 7.703562] systemd[1]: Reached target First Boot Complete.738gitlab # [ 7.704377] systemd[1]: Finished Create Static Device Nodes in /dev.739gitlab # [ 7.705274] systemd[1]: Reached target Preparation for Local File Systems.740gitlab # [ 7.706230] systemd[1]: Starting Rule-based Manager for Device Events and Files...741gitlab # [ 7.707247] systemd[1]: Finished Flush Journal to Persistent Storage.742gitlab # [ 7.764858] systemd-udevd[354]: Using default interface naming scheme 'v261'.743gitlab # [ 7.794512] systemd[1]: Started Rule-based Manager for Device Events and Files.744gitlab # [ 8.119125] systemd[1]: Finished Firewall.745gitlab # [ 8.188261] systemd[1]: Finished Coldplug All udev Devices.746gitlab # [ 8.271235] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs747gitlab # [ 8.372230] systemd[1]: Condition check resulted in /dev/hvc0 being skipped.748gitlab # [ 8.375916] (udev-worker)[473]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.749gitlab # [ 8.380312] (udev-worker)[473]: Network interface NamePolicy= disabled on kernel command line.750gitlab # [ 8.384743] (udev-worker)[471]: Network interface NamePolicy= disabled on kernel command line.751gitlab # [ 8.387728] systemd[1]: Condition check resulted in /dev/ttyAMA0 being skipped.752gitlab # [ 8.389659] systemd[1]: Mounting /run/wrappers...753gitlab # [ 8.407593] systemd[1]: Condition check resulted in Virtio network device being skipped.754gitlab # [ 8.409749] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore755gitlab # [ 8.412292] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67756gitlab # [ 8.415515] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore757gitlab # [ 8.418281] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os758gitlab # [ 8.420066] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os759gitlab # [ 8.421843] systemd[1]: Mounted /run/wrappers.760gitlab # [ 8.423326] systemd[1]: Reached target Local File Systems.761gitlab # [ 8.424487] systemd[1]: Listening on Boot Loader Control Service Socket.762gitlab # [ 8.426323] systemd[1]: Starting register-nix-paths.service...763gitlab # [ 8.432497] systemd[1]: Starting Create SUID/SGID Wrappers...764gitlab # [ 8.436151] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met.765gitlab # [ 8.448710] systemd[1]: Starting Save Transient machine-id to Disk...766gitlab # [ 8.460226] systemd[1]: Starting Create System Files and Directories...767gitlab # [ 8.482828] systemd[1]: etc-machine\x2did.mount: Deactivated successfully.768gitlab # [ 8.485007] systemd[1]: Finished Save Transient machine-id to Disk.769gitlab # [ 8.501616] systemd[1]: Finished Create System Files and Directories.770gitlab # [ 8.504772] systemd[1]: Starting Rebuild Journal Catalog...771gitlab # [ 8.508436] mousedev: PS/2 mouse device common for all mice772gitlab # [ 8.510550] systemd[1]: Starting Record System Boot/Shutdown in UTMP...773gitlab # [ 8.552265] systemd[1]: Finished Record System Boot/Shutdown in UTMP.774gitlab # [ 8.566359] systemd[1]: Finished Rebuild Journal Catalog.775gitlab # [ 8.568543] systemd[1]: Starting Update is Completed...776gitlab # [ 8.604111] systemd[1]: Finished Update is Completed.777gitlab # [ 8.630875] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully.778gitlab # [ 8.632000] systemd[1]: Finished Create SUID/SGID Wrappers.779gitlab # [ 8.633004] systemd[1]: suid-sgid-wrappers.service: Consumed 133ms CPU time over 197ms wall clock time, 6.2M memory peak, 1.9M read from disk.780gitlab # [ 8.890084] systemd[1]: Finished register-nix-paths.service.781gitlab # [ 8.891094] systemd[1]: Reached target System Initialization.782gitlab # [ 8.893511] systemd[1]: Started Discard unused filesystem blocks once a week.783gitlab # [ 8.894608] systemd[1]: Started logrotate.timer.784gitlab # [ 8.895329] systemd[1]: Started Daily Cleanup of Temporary Directories.785gitlab # [ 8.896338] systemd[1]: Reached target Timer Units.786gitlab # [ 8.897080] systemd[1]: Listening on D-Bus System Message Bus Socket.787gitlab # [ 8.898009] systemd[1]: Listening on Nix Daemon Socket.788gitlab # [ 8.909538] systemd[1]: Starting nixbot CI service socket...789gitlab # [ 8.912141] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket.790gitlab # [ 8.913746] systemd[1]: Listening on nixbot CI service socket.791gitlab # [ 8.914639] systemd[1]: Reached target Socket Units.792gitlab # [ 8.915380] systemd[1]: Starting D-Bus System Message Bus...793gitlab # [ 8.924841] input: QEMU Virtio Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:09.0/virtio8/input/input3794gitlab # [ 8.956480] dbus-broker-launch[559]: Looking up NSS user entry for 'systemd-timesync'...795gitlab # [ 8.958085] dbus-broker-launch[559]: NSS returned no entry for 'systemd-timesync'796gitlab # [ 8.959273] dbus-broker-launch[559]: Invalid user-name in /nix/store/9zcyylhndlnizbwn48627991zr1jxg4p-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync"797gitlab # [ 8.961740] systemd[1]: Started D-Bus System Message Bus.798gitlab # [ 8.972279] dbus-broker-launch[559]: Ready799gitlab # [ 8.973661] systemd[1]: Reached target Basic System.800gitlab # [ 8.980424] systemd[1]: Started backdoor.service.801gitlab # [ 8.982592] systemd[1]: Starting gitlab-config.service...802gitlab # [ 8.997950] systemd[1]: Starting Import lastlog data into lastlog2 database...803gitlab # connecting to host...804gitlab # [ 9.007615] systemd[1]: Starting Logrotate configuration check...805gitlab # [ 9.008983] systemd[1]: Starting Name Service Cache Daemon (nsncd)...806gitlab # [ 9.013849] systemd[1]: Starting Post-Boot Actions...807gitlab # [ 9.016909] systemd[1]: Started Reset console on configuration changes.808gitlab # [ 9.026206] systemd[1]: Starting resolvconf update...809gitlab: Guest shell says: b'Spawning backdoor root shell...\n'810gitlab # [ 9.033617] logrotate[568]: warning: logrotate in debug mode does nothing except printing debug messages! Consider using verbose mode (-v) instead if this is not what you want.811gitlab # [ 9.035537] logrotate[568]: reading config file /nix/store/22afkmbkaxyx50bj9lbkkpmz7pd69hsf-logrotate.conf812gitlab: connected to guest root shell813gitlab # [ 9.038830] logrotate[568]: note: 'monthly' overrides previously specified 'weekly'814gitlab: (connecting took 9.48 seconds)815gitlab # [ 9.039779] logrotate[568]: Reading state from file: /var/lib/logrotate.status816gitlab: (finished: waiting for the VM to finish booting, in 9.48 seconds)817gitlab # [ 9.041430] logrotate[568]: state file /var/lib/logrotate.status does not exist818gitlab # [ 9.042856] logrotate[568]: Allocating hash table for state file, size 64 entries819gitlab # [ 9.044357] logrotate[568]: Handling 4 logs820gitlab # [ 9.044906] logrotate[568]: rotating pattern: "/var/log/btmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed821gitlab # [ 9.046749] logrotate[568]: considering log /var/log/btmp822gitlab # [ 9.047403] logrotate[568]: Creating new state823gitlab # [ 9.048095] logrotate[568]: Now: 2026-08-13 13:14824gitlab # [ 9.048738] logrotate[568]: Last rotated at 2026-08-13 13:00825gitlab # [ 9.049555] logrotate[568]: log does not need rotating (log has already been rotated)826gitlab # [ 9.051689] logrotate[568]: rotating pattern: "/var/log/wtmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed827gitlab # [ 9.057049] logrotate[568]: considering log /var/log/wtmp828gitlab # [ 9.057926] logrotate[568]: Creating new state829gitlab # [ 9.058654] logrotate[568]: Now: 2026-08-13 13:14830gitlab # [ 9.059454] logrotate[568]: Last rotated at 2026-08-13 13:00831gitlab # [ 9.063650] logrotate[568]: log does not need rotating (log has already been rotated)832gitlab # [ 9.068197] logrotate[568]: rotating pattern: "/var/gitlab/state/log/*.log" after 1 days empty log files are not rotated, (30 rotations), old logs are removed833gitlab # [ 9.070016] logrotate[568]: switching euid from 0 to 165 and egid from 0 to 165 (pid 568)834gitlab # [ 9.071088] logrotate[568]: considering log /var/gitlab/state/log/*.log835gitlab # [ 9.071961] logrotate[568]: log /var/gitlab/state/log/*.log does not exist -- skipping836gitlab # [ 9.073384] logrotate[568]: Creating new state837gitlab # [ 9.074006] logrotate[568]: switching euid from 165 to 0 and egid from 165 to 0 (pid 568)838gitlab # [ 9.075071] logrotate[568]: rotating pattern: "/var/log/nginx/*.log" weekly empty log files are not rotated, (26 rotations), old logs are removed839gitlab # [ 9.080235] logrotate[568]: switching euid from 0 to 60 and egid from 0 to 60 (pid 568)840gitlab # [ 9.081349] logrotate[568]: considering log /var/log/nginx/*.log841gitlab # [ 9.082141] logrotate[568]: log /var/log/nginx/*.log does not exist -- skipping842gitlab # [ 9.083098] logrotate[568]: Creating new state843gitlab # [ 9.083764] logrotate[568]: not running postrotate script, since no logs were rotated844gitlab # [ 9.088193] logrotate[568]: switching euid from 60 to 0 and egid from 60 to 0 (pid 568)845gitlab # [ 9.089324] systemd[1]: Finished Logrotate configuration check.846gitlab # [ 9.090320] systemd[1]: Finished Post-Boot Actions.847gitlab # [ 9.096679] systemd[1]: Started Name Service Cache Daemon (nsncd).848gitlab # [ 9.097893] nsncd[570]: Aug 13 13:14:02.923 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"849gitlab # [ 9.099879] systemd[1]: Finished Import lastlog data into lastlog2 database.850gitlab # [ 9.115656] systemd[1]: Reached target Host and Network Name Lookups.851gitlab # [ 9.116878] systemd[1]: Reached target User and Group Name Lookups.852gitlab # [ 9.122511] systemd[1]: Starting User Login Management...853gitlab # [ 9.127778] systemd[1]: Starting Virtual Console Setup...854gitlab # [ 9.158607] systemd[1]: Stopped target Host and Network Name Lookups.855gitlab # [ 9.160989] systemd[1]: Stopping Host and Network Name Lookups...856gitlab # [ 9.162260] systemd[1]: Stopped target User and Group Name Lookups.857gitlab # [ 9.164392] systemd[1]: Stopping User and Group Name Lookups...858gitlab # [ 9.165560] systemd[1]: Stopping Name Service Cache Daemon (nsncd)...859gitlab # [ 9.166795] systemd[1]: nscd.service: Deactivated successfully.860gitlab # [ 9.168115] systemd[1]: Stopped Name Service Cache Daemon (nsncd).861gitlab # [ 9.169158] systemd[1]: nscd.service: Consumed 23ms CPU time over 157ms wall clock time, 7.4M memory peak, 5.8M read from disk.862gitlab # [ 9.176374] systemd[1]: Starting Name Service Cache Daemon (nsncd)...863gitlab # [ 9.185231] systemd-logind[628]: New seat seat0.864gitlab # [ 9.191939] systemd-logind[628]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard)865gitlab # [ 9.193734] systemd-logind[628]: Watching system buttons on /dev/input/event1 (QEMU QEMU USB Keyboard)866gitlab # [ 9.195102] systemd-logind[628]: Watching system buttons on /dev/input/event0 (gpio-keys)867gitlab # [ 9.197020] systemd[1]: Started User Login Management.868gitlab # [ 9.204759] systemd[1]: Starting linger-users.service...869gitlab # [ 9.207059] systemd[1]: Finished resolvconf update.870gitlab # [ 9.210838] systemd-vconsole-setup[633]: Configuration of first virtual console was skipped, ignoring remaining ones.871gitlab # [ 9.215466] systemd[1]: Finished Virtual Console Setup.872gitlab # [ 9.217692] systemd[1]: Reached target Preparation for Network.873gitlab # [ 9.222958] nsncd[666]: Aug 13 13:14:03.046 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"874gitlab # [ 9.225372] systemd[1]: Starting DHCP Client...875gitlab # [ 9.226757] systemd[1]: Starting Address configuration of eth1...876gitlab # [ 9.230022] systemd[1]: Starting Extra networking commands....877gitlab # [ 9.230882] systemd[1]: Started Name Service Cache Daemon (nsncd).878gitlab # [ 9.231756] systemd[1]: linger-users.service: Deactivated successfully.879gitlab # [ 9.234368] systemd[1]: Finished linger-users.service.880gitlab # [ 9.237300] systemd[1]: Reached target Host and Network Name Lookups.881gitlab # [ 9.238433] systemd[1]: Reached target User and Group Name Lookups.882gitlab # [ 9.255058] network-addresses-eth1-start[689]: adding address 192.168.1.1/24... done883gitlab # [ 9.259993] network-addresses-eth1-start[689]: adding address 2001:db8:1::1/64... done884gitlab # [ 9.266554] systemd[1]: Finished Address configuration of eth1.885gitlab # [ 9.309926] systemd[1]: Finished Extra networking commands..886gitlab # [ 9.310771] systemd[1]: Reached target Network.887gitlab # [ 9.314800] systemd[1]: Starting gitlab-workhorse.service...888gitlab # [ 9.316732] dhcpcd[706]: dhcpcd-10.3.2 starting889gitlab # [ 9.318026] systemd[1]: Starting Nginx Web Server...890gitlab # [ 9.319308] dhcpcd[758]: dev: loaded udev891gitlab # [ 9.323533] systemd[1]: Starting PostgreSQL Server...892gitlab # [ 9.333786] 8021q: 802.1Q VLAN Support v1.8893gitlab # [ 9.332570] systemd[1]: Starting Redis Server - redis-gitlab...894gitlab # [ 9.336215] 8021q: adding VLAN 0 to HW filter on device eth1895gitlab # [ 9.337769] systemd[1]: Starting Permit User Sessions...896gitlab # [ 9.350328] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.897gitlab # [ 9.376165] systemd[1]: Finished Permit User Sessions.898gitlab # [ 9.381926] systemd[1]: Started Getty on tty1.899gitlab # [ 9.382157] cfg80211: Loading compiled-in X.509 certificates for regulatory database900gitlab # [ 9.384791] systemd[1]: Reached target Login Prompts.901gitlab # [ 9.394835] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7'902gitlab # [ 9.395326] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600'903gitlab # [ 9.397073] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2904gitlab # [ 9.397385] cfg80211: failed to load regulatory.db905gitlab # [ 9.442074] 8021q: adding VLAN 0 to HW filter on device eth0906gitlab # [ 9.441417] dhcpcd[758]: eth0: waiting for carrier907gitlab # [ 9.443161] dhcpcd[758]: eth0: carrier acquired908gitlab # [ 9.449252] dhcpcd[758]: DUID 00:01:00:01:32:10:7f:9b:52:54:00:12:34:56909gitlab # [ 9.450686] dhcpcd[758]: eth0: IAID 00:12:34:56910gitlab # [ 9.451359] dhcpcd[758]: eth0: adding address fe80::5054:ff:fe12:3456911gitlab # [ 9.477418] nginx-pre-start[788]: nginx: the configuration file /nix/store/ybdwy2xmslvjmdkxgrrhy1x5rwh45z0q-nginx.conf syntax is ok912gitlab # [ 9.479704] nginx-pre-start[788]: nginx: configuration file /nix/store/ybdwy2xmslvjmdkxgrrhy1x5rwh45z0q-nginx.conf test is successful913gitlab # [ 9.482099] systemd[1]: Started Nginx Web Server.914gitlab # [ 9.512405] redis-server[783]: Supervised by systemd. Please make sure you set appropriate values for TimeoutStartSec and TimeoutStopSec in your service unit.915gitlab # [ 9.514527] redis-server[783]: oO0OoO0OoO0Oo Redis is starting oO0OoO0OoO0Oo916gitlab # [ 9.517789] redis-server[783]: Redis version=8.8.1, bits=64, commit=00000000, modified=0, pid=783, just started917gitlab # [ 9.519734] redis-server[783]: Configuration loaded918gitlab # [ 9.521161] redis[783]: monotonic clock: ARM CNTVCT @ 1000 ticks/us919gitlab # [ 9.522270] systemd[1]: Started Redis Server - redis-gitlab.920gitlab # [ 9.523250] redis[783]: Running mode=standalone, port=0.921gitlab # [ 9.524157] redis[783]: Server initialized922gitlab # [ 9.524984] redis[783]: Ready to accept connections unix923gitlab # [ 9.525914] redis[783]: WARNING: Redis does not require authentication. Redis will accept connections from any local client.924gitlab # [ 9.529078] postgresql-pre-start[792]: The files belonging to this database system will be owned by user "postgres".925gitlab # [ 9.531174] postgresql-pre-start[792]: This user must also own the server process.926gitlab # [ 9.532395] postgresql-pre-start[792]: The database cluster will be initialized with locale "en_US.UTF-8".927gitlab # [ 9.533828] postgresql-pre-start[792]: The default database encoding has accordingly been set to "UTF8".928gitlab # [ 9.536597] postgresql-pre-start[792]: The default text search configuration will be set to "english".929gitlab # [ 9.538290] postgresql-pre-start[792]: Data page checksums are enabled.930gitlab # [ 9.539823] postgresql-pre-start[792]: fixing permissions on existing directory /var/lib/postgresql/18 ... ok931gitlab # [ 9.541884] postgresql-pre-start[792]: creating subdirectories ... ok932gitlab # [ 9.543855] postgresql-pre-start[792]: selecting dynamic shared memory implementation ... posix933gitlab # [ 9.574516] postgresql-pre-start[792]: selecting default "max_connections" ... 100934gitlab # [ 9.621520] postgresql-pre-start[792]: selecting default "shared_buffers" ... 128MB935gitlab # [ 9.945374] systemd[1]: Started gitlab-workhorse.service.936gitlab # [ 10.064470] postgresql-pre-start[792]: selecting default time zone ... UTC937gitlab # [ 10.068166] postgresql-pre-start[792]: creating configuration files ... ok938gitlab # [ 10.166608] gitlab-workhorse[817]: time="2026-08-13T13:14:03Z" level=info msg=Starting build_time=19700101.000000 version=19.0.4939gitlab # [ 10.169251] gitlab-workhorse[817]: time="2026-08-13T13:14:03Z" level=info msg="Using redis/go-redis"940gitlab # [ 10.171104] gitlab-workhorse[817]: time="2026-08-13T13:14:03Z" level=info msg="Running upstream server" address=/run/gitlab/gitlab-workhorse.socket network=unix941gitlab # [ 10.344261] postgresql-pre-start[792]: running bootstrap script ... ok942gitlab # [ 11.039003] postgresql-pre-start[792]: performing post-bootstrap initialization ... ok943gitlab # [ 11.059368] dhcpcd[758]: eth0: soliciting a DHCP lease944gitlab # [ 11.073000] dhcpcd[758]: eth0: offered 10.0.2.15 from 10.0.2.2945gitlab # [ 11.088373] dhcpcd[758]: eth0: probing address 10.0.2.15/24946gitlab # [ 11.336895] postgresql-pre-start[792]: syncing data to disk ... ok947gitlab # [ 11.339669] postgresql-pre-start[792]: initdb: warning: enabling "trust" authentication for local connections948gitlab # [ 11.343980] postgresql-pre-start[792]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb.949gitlab # [ 11.350441] postgresql-pre-start[792]: Success. You can now start the database server using:950gitlab # [ 11.354121] postgresql-pre-start[792]: pg_ctl -D /var/lib/postgresql/18 -l logfile start951gitlab # [ 11.434105] dhcpcd[758]: eth0: soliciting an IPv6 router952gitlab # [ 11.436814] dhcpcd[758]: eth0: Router Advertisement from fe80::2953gitlab # [ 11.439466] dhcpcd[758]: eth0: adding address fec0::5054:ff:fe12:3456/64954gitlab # [ 11.442390] dhcpcd[758]: eth0: adding route to fec0::/64955gitlab # [ 11.444778] dhcpcd[758]: eth0: adding default route via fe80::2956gitlab # [ 11.538334] postgres[850]: [850] LOG: starting PostgreSQL 18.4 on aarch64-unknown-linux-gnu, compiled by clang version 21.1.8, 64-bit957gitlab # [ 11.543631] postgres[850]: [850] LOG: listening on IPv6 address "::1", port 5432958gitlab # [ 11.547261] postgres[850]: [850] LOG: listening on IPv4 address "127.0.0.1", port 5432959gitlab # [ 11.550844] postgres[850]: [850] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432"960gitlab # [ 11.561694] postgres[860]: [860] LOG: database system was shut down at 2026-08-13 13:14:04 GMT961gitlab # [ 11.571448] postgres[850]: [850] LOG: database system is ready to accept connections962gitlab # [ 11.576214] systemd[1]: Started PostgreSQL Server.963gitlab # [ 11.582081] systemd[1]: Starting PostgreSQL Setup Scripts...964gitlab # [ 11.851000] kmklqy2bdnfisygngf3cnp8jwzlh0j09-gitlab-config[870]: mkdir -p /var/gitlab/state/home/.ssh: OK965gitlab # [ 11.856230] kmklqy2bdnfisygngf3cnp8jwzlh0j09-gitlab-config[870]: chmod 700 /var/gitlab/state/home/.ssh: OK966gitlab # [ 11.891245] postgresql-setup-start[875]: CREATE DATABASE967gitlab # [ 11.924303] systemd[1]: Finished gitlab-config.service.968gitlab # [ 11.929925] postgresql-setup-start[892]: CREATE ROLE969gitlab # [ 11.931021] systemd[1]: Started gitaly.service.970gitlab # [ 11.948086] postgresql-setup-start[896]: ALTER DATABASE971gitlab # [ 11.983372] postgresql-setup-start[902]: CREATE ROLE972gitlab # [ 11.987456] systemd[1]: Finished PostgreSQL Setup Scripts.973gitlab # [ 11.988749] systemd[1]: Reached target PostgreSQL.974gitlab # [ 11.991734] systemd[1]: Starting gitlab-db-config.service...975gitlab # [ 11.994644] systemd[1]: Starting gitlab-postgresql.service...976gitlab # [ 12.202117] gitlab-postgresql-start[912]: CREATE DATABASE977gitlab # [ 12.257231] gitlab-postgresql-start[923]: CREATE EXTENSION978gitlab # [ 12.382303] gitlab-postgresql-start[925]: CREATE EXTENSION979gitlab # [ 12.386671] systemd[1]: Finished gitlab-postgresql.service.980gitlab # [ 12.623308] gitaly[895]: time="2026-08-13T13:14:06.447Z" level=warning msg="The current configurations will cause Gitaly to fail to start up in future versions. Please run 'gitaly configuration validate < /nix/store/0r0qd84zrxhqq373hk9spv8j9pg0qlnq-gitaly.toml' and fix the errors that are printed." pid=895981gitlab # [ 12.648726] gitaly[895]: time="2026-08-13T13:14:06.448Z" level=info msg="maxprocs: Leaving GOMAXPROCS=4: CPU quota undefined" pid=895982gitlab # [ 12.652840] gitaly[895]: time="2026-08-13T13:14:06.448Z" level=info msg="grpc prometheus histograms enabled" latencies="[0.001 0.005 0.025 0.1 0.5 1 10 30 60 300 1500]" pid=895983gitlab # [ 12.657667] gitaly[895]: time="2026-08-13T13:14:06.448Z" level=error msg="error initializing distributed tracing" error="tracing is disabled" pid=895984gitlab # [ 12.663446] gitaly[895]: time="2026-08-13T13:14:06.448Z" level=info msg="Starting Gitaly" pid=895 version=985gitlab # [ 12.871888] gitaly[895]: time="2026-08-13T13:14:06.698Z" level=info msg="finished unpacking auxiliary binaries" duration_ms=248 pid=895986gitlab # [ 12.874440] gitaly[895]: time="2026-08-13T13:14:06.698Z" level=info msg="finished initializing bootstrap" duration_ms=0 pid=895987gitlab # [ 12.876317] gitaly[895]: time="2026-08-13T13:14:06.698Z" level=info msg="finished initializing command factory" duration_ms=0 pid=895988gitlab # [ 12.878181] gitaly[895]: time="2026-08-13T13:14:06.698Z" level=info msg="using Git binary" binary_path=/run/gitaly/gitaly-895/git-exec-1963311019.d/git pid=895989gitlab # [ 12.880208] gitaly[895]: time="2026-08-13T13:14:06.703Z" level=info msg="finished detecting git version" duration_ms=4 pid=895990gitlab # [ 12.882018] gitaly[895]: time="2026-08-13T13:14:06.703Z" level=info msg="using Git version" pid=895 version=2.53.g991gitlab # [ 12.883659] gitaly[895]: time="2026-08-13T13:14:06.703Z" level=info msg="clearing disk cache object folder" pid=895 storage=default992gitlab # [ 12.885698] gitaly[895]: time="2026-08-13T13:14:06.704Z" level=info msg="moving disk cache object folder" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache2544829644 pid=895 storage=default993gitlab # [ 12.888392] gitaly[895]: time="2026-08-13T13:14:06.704Z" level=info msg="disk cache object folder doesn't exist, no need to remove" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache2544829644 pid=895 storage=default994gitlab # [ 12.891657] gitaly[895]: time="2026-08-13T13:14:06.704Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/cache path=/var/gitlab/state/repositories/+gitaly/cache pid=895995gitlab # [ 12.894999] gitaly[895]: time="2026-08-13T13:14:06.704Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/state path=/var/gitlab/state/repositories/+gitaly/state pid=895996gitlab # [ 12.898303] gitaly[895]: time="2026-08-13T13:14:06.704Z" level=info msg="cleared all cache object files" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache2544829644 clear_duration_ms=0 pid=895 storage=default997gitlab # [ 12.901197] gitaly[895]: time="2026-08-13T13:14:06.725Z" level=info msg="counting repositories" pid=895998gitlab # [ 12.902573] gitaly[895]: time="2026-08-13T13:14:06.725Z" level=info msg="starting to count repositories" pid=895 storage_path=/var/gitlab/state/repositories999gitlab # [ 12.904778] gitaly[895]: time="2026-08-13T13:14:06.725Z" level=info msg="finished tempdir cleaner walk" pid=895 storage=default time_ms=01000gitlab # [ 12.906610] gitaly[895]: time="2026-08-13T13:14:06.725Z" level=info msg="completed counting repositories" counting_duration_ms=0 pid=895 storage_path=/var/gitlab/state/repositories1001gitlab # [ 12.909182] gitaly[895]: time="2026-08-13T13:14:06.725Z" level=info msg="completed counting all repositories" counting_duration=0 pid=8951002gitlab # [ 12.911007] gitaly[895]: time="2026-08-13T13:14:06.725Z" level=warning msg="Unable to set SO_REUSEPORT: zero downtime upgrades will not work" error="operation not supported" pid=8951003gitlab # [ 12.913649] gitaly[895]: time="2026-08-13T13:14:06.725Z" level=info msg="listening at address" address=/var/gitlab/state/tmp/sockets/gitaly.socket pid=895 schema=unix1004gitlab # [ 12.915898] gitaly[895]: time="2026-08-13T13:14:06.725Z" level=info msg="listening at address" address=/run/gitaly/gitaly-895/sock.d/intern pid=895 schema=unix1005gitlab # [ 12.918233] gitaly[895]: time="2026-08-13T13:14:06.727Z" level=info msg="starting prometheus listener" address="localhost:9236" pid=8951006gitlab # [ 12.920173] gitaly[895]: time="2026-08-13T13:14:06.727Z" level=info msg="Started Gitaly" duration_ms=278 pid=8951007gitlab # [ 12.921750] gitaly[895]: time="2026-08-13T13:14:06.727Z" level=info msg="Gitaly graceful stop timeout duration" duration_s=1m0s pid=8951008gitlab # [ 12.923665] gitaly[895]: time="2026-08-13T13:14:06.727Z" level=info msg="maintenance: daily scheduled" pid=895 scheduled="2026-08-14 12:00:00 +0000 UTC"1009gitlab # [ 13.287799] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[910]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1010gitlab # [ 13.298022] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[910]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1011gitlab # [ 13.308074] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[910]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1012gitlab # [ 15.608857] dhcpcd[758]: eth0: leased 10.0.2.15 for 86400 seconds1013gitlab # [ 15.609180] dhcpcd[758]: eth0: adding route to 10.0.2.0/241014gitlab # [ 15.609357] dhcpcd[758]: eth0: adding default route via 10.0.2.21015gitlab # [ 15.723153] systemd[1]: Started DHCP Client.1016gitlab # [ 15.727102] systemd[1]: Reached target Network is Online.1017gitlab # [ 16.299292] gitaly[895]: time="2026-08-13T13:14:10.124Z" level=info msg="License database preloaded" duration_ms=3636 pid=8951018gitlab # [ 59.246564] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[910]: W, [2026-08-13T13:14:53.071532 #910] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1019gitlab # [ 60.224958] gitlab-workhorse[817]: time="2026-08-13T13:14:54Z" level=error correlation_id= duration_ms=1 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1020gitlab # [ 62.403073] postgres[1434]: [1434] ERROR: relation "feature_gates" does not exist at character 5231021gitlab # [ 62.403539] postgres[1434]: [1434] STATEMENT: SELECT a.attname, format_type(a.atttypid, a.atttypmod),1022gitlab # [ 62.403676] postgres[1434]: pg_get_expr(d.adbin, d.adrelid), a.attnotnull, a.atttypid, a.atttypmod,1023gitlab # [ 62.403799] postgres[1434]: c.collname, col_description(a.attrelid, a.attnum) AS comment,1024gitlab # [ 62.403923] postgres[1434]: attidentity AS identity,1025gitlab # [ 62.420462] postgres[1434]: attgenerated as attgenerated1026gitlab # [ 62.422988] postgres[1434]: FROM pg_attribute a1027gitlab # [ 62.425234] postgres[1434]: LEFT JOIN pg_attrdef d ON a.attrelid = d.adrelid AND a.attnum = d.adnum1028gitlab # [ 62.428990] postgres[1434]: LEFT JOIN pg_type t ON a.atttypid = t.oid1029gitlab # [ 62.431688] postgres[1434]: LEFT JOIN pg_collation c ON a.attcollation = c.oid AND a.attcollation <> t.typcollation1030gitlab # [ 62.435968] postgres[1434]: WHERE a.attrelid = '"feature_gates"'::regclass1031gitlab # [ 62.438862] postgres[1434]: AND a.attnum > 0 AND NOT a.attisdropped1032gitlab # [ 62.441682] postgres[1434]: ORDER BY a.attnum1033gitlab # [ 62.443610] postgres[1434]:1034gitlab # [ 67.543790] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[1485]: psql:/var/gitlab/state/db/structure.sql:9: NOTICE: extension "btree_gist" already exists, skipping1035gitlab # [ 67.544307] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[1485]: psql:/var/gitlab/state/db/structure.sql:11: NOTICE: extension "pg_trgm" already exists, skipping1036gitlab # [ 70.234754] gitlab-workhorse[817]: time="2026-08-13T13:15:04Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1037gitlab # [ 80.245907] gitlab-workhorse[817]: time="2026-08-13T13:15:14Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1038gitlab # [ 90.254262] gitlab-workhorse[817]: time="2026-08-13T13:15:24Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1039gitlab # [ 94.984743] postgres[1597]: [1597] ERROR: relation "table_without_models" does not exist1040gitlab # [ 94.986585] postgres[1597]: [1597] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1041gitlab # [ 100.263918] gitlab-workhorse[817]: time="2026-08-13T13:15:34Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1042gitlab # [ 110.265049] gitlab-workhorse[817]: time="2026-08-13T13:15:44Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1043gitlab # [ 120.266116] gitlab-workhorse[817]: time="2026-08-13T13:15:54Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1044gitlab # [ 125.353427] systemd[1]: Finished gitlab-db-config.service.1045gitlab # [ 125.360072] systemd[1]: Started gitlab-sidekiq.service.1046gitlab # [ 125.365159] systemd[1]: Starting gitlab.service...1047gitlab # [ 125.909732] bundle[1981]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1048gitlab # [ 125.916199] bundle[1981]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1049gitlab # [ 125.923123] bundle[1981]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1050gitlab # [ 130.270620] gitlab-workhorse[817]: time="2026-08-13T13:16:04Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1051gitlab # [ 130.670236] bundle[1981]: {"timestamp":"2026-08-13T13:16:04.467Z","pid":1981,"message":"* Enabling systemd notification integration"}1052gitlab # [ 130.675377] bundle[1981]: {"timestamp":"2026-08-13T13:16:04.495Z","pid":1981,"message":"Puma starting in cluster mode..."}1053gitlab # [ 130.679950] bundle[1981]: {"timestamp":"2026-08-13T13:16:04.495Z","pid":1981,"message":"* Puma version: 8.0.1 (\"Into the Arena\")"}1054gitlab # [ 130.685689] bundle[1981]: {"timestamp":"2026-08-13T13:16:04.495Z","pid":1981,"message":"* Ruby version: ruby 3.3.10 (2025-10-23 revision 343ea05002) [aarch64-linux]"}1055gitlab # [ 130.691605] bundle[1981]: {"timestamp":"2026-08-13T13:16:04.495Z","pid":1981,"message":"* Min threads: 0"}1056gitlab # [ 130.695625] bundle[1981]: {"timestamp":"2026-08-13T13:16:04.495Z","pid":1981,"message":"* Max threads: 4"}1057gitlab # [ 130.699746] bundle[1981]: {"timestamp":"2026-08-13T13:16:04.495Z","pid":1981,"message":"* Environment: production"}1058gitlab # [ 130.704110] bundle[1981]: {"timestamp":"2026-08-13T13:16:04.495Z","pid":1981,"message":"* Master PID: 1981"}1059gitlab # [ 130.707987] bundle[1981]: {"timestamp":"2026-08-13T13:16:04.495Z","pid":1981,"message":"* Workers: 2"}1060gitlab # [ 130.711787] bundle[1981]: {"timestamp":"2026-08-13T13:16:04.495Z","pid":1981,"message":"* Restarts: (✔) hot (✖) phased (✖) refork"}1061gitlab # [ 130.716922] bundle[1981]: {"timestamp":"2026-08-13T13:16:04.495Z","pid":1981,"message":"* Preloading application"}1062gitlab # [ 130.721770] sidekiq-cluster[1980]: {"severity":"INFO","time":"2026-08-13T13:16:04.476Z","message":"Starting cluster with 1 processes"}1063gitlab # [ 140.275437] gitlab-workhorse[817]: time="2026-08-13T13:16:14Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1064gitlab # [ 150.282224] gitlab-workhorse[817]: time="2026-08-13T13:16:24Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1065gitlab # [ 160.292960] gitlab-workhorse[817]: time="2026-08-13T13:16:34Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1066gitlab # [ 168.983515] bundle[1981]: W, [2026-08-13T13:16:42.808763 #1981] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1067gitlab # [ 170.302444] gitlab-workhorse[817]: time="2026-08-13T13:16:44Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1068gitlab # [ 172.902400] sidekiq-cluster[2031]: 2026-08-13T13:16:46.727Z pid=2031 tid=wnb INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>2031, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>428060672}1069gitlab # [ 173.179704] sidekiq-cluster[2031]: W, [2026-08-13T13:16:47.005907 #2031] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1070gitlab # [ 173.326786] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:16:47.153Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"}1071gitlab # [ 176.714297] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:16:50.539Z","message":"GitLab reliable fetch activated!"}1072gitlab # [ 176.714750] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:16:50.539Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1073gitlab # [ 176.748155] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:16:50.574Z","message":"Cron Jobs - added job with name bbo_users_delete_unconfirmed_secondary in the namespace default"}1074gitlab # [ 176.755167] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:16:50.577Z","message":"Cron Jobs - added job with name background_operation_environments_auto_delete in the namespace default"}1075gitlab # [ 176.762502] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:16:50.580Z","message":"Cron Jobs - added job with name adjourned_group_deletion_worker in the namespace default"}1076gitlab # [ 176.769194] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:16:50.583Z","message":"Cron Jobs - added job with name authn_data_retention_authentication_event_archive_worker in the namespace default"}1077gitlab # [ 176.776618] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:16:50.586Z","message":"Cron Jobs - added job with name delete_expired_trigger_token_worker in the namespace default"}1078gitlab # [ 176.783259] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:16:50.589Z","message":"Cron Jobs - added job with name adjourned_projects_deletion_cron_worker in the namespace default"}1079gitlab # [ 176.789483] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:16:50.591Z","message":"Cron Jobs - added job with name stuck_ci_jobs_worker in the namespace default"}1080gitlab # [ 176.794493] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:16:50.593Z","message":"Cron Jobs - added job with name drop_timed_out_worker in the namespace default"}1081gitlab # [ 176.799141] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:16:50.595Z","message":"Cron Jobs - added job with name pipeline_schedule_worker in the namespace default"}1082gitlab # [ 176.803612] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:16:50.597Z","message":"Cron Jobs - added job with name ci_schedule_bulk_delete_job_artifact_cron_worker in the namespace default"}1083gitlab # [ 176.808280] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:16:50.599Z","message":"Cron Jobs - added job with name update_locked_unknown_artifacts_worker in the namespace default"}1084gitlab # [ 176.812238] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:16:50.601Z","message":"Cron Jobs - added job with name ci_partitioning_worker in the namespace default"}1085gitlab # [ 176.815638] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:16:50.604Z","message":"Cron Jobs - added job with name ci_pipelines_expire_artifacts_worker in the namespace default"}1086gitlab # [ 176.819383] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:16:50.606Z","message":"Cron Jobs - added job with name ci_schedule_delete_objects_worker in the namespace default"}1087gitlab # [ 176.822907] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:16:50.608Z","message":"Cron Jobs - added job with name environments_auto_stop_cron_worker in the namespace default"}1088gitlab # [ 176.826327] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:16:50.611Z","message":"Cron Jobs - added job with name repository_check_worker in the namespace default"}1089gitlab # [ 176.829336] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:16:50.613Z","message":"Cron Jobs - added job with name admin_email_worker in the namespace default"}1090gitlab # [ 176.832119] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:16:50.616Z","message":"Cron Jobs - added job with name personal_access_tokens_expiring_worker in the namespace default"}1091gitlab # [ 176.835047] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:16:50.619Z","message":"Cron Jobs - added job with name deploy_tokens_expiring_worker in the namespace default"}1092gitlab # [ 176.837927] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:16:50.622Z","message":"Cron Jobs - added job with name personal_access_tokens_expired_notification_worker in the namespace default"}1093gitlab # [ 176.840917] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:16:50.625Z","message":"Cron Jobs - added job with name resource_access_tokens_inactive_tokens_deletion_cron_worker in the namespace default"}1094gitlab # [ 176.843903] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:16:50.628Z","message":"Cron Jobs - added job with name repository_archive_cache_worker in the namespace default"}1095gitlab # [ 176.846647] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:16:50.630Z","message":"Cron Jobs - added job with name import_export_project_cleanup_worker in the namespace default"}1096gitlab # [ 176.849302] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:16:50.632Z","message":"Cron Jobs - added job with name gitlab_import_import_file_cleanup_worker in the namespace default"}1097gitlab # [ 176.851769] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:16:50.635Z","message":"Cron Jobs - added job with name ci_archive_traces_cron_worker in the namespace default"}1098gitlab # [ 176.854239] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:16:50.638Z","message":"Cron Jobs - added job with name members_expiring_worker in the namespace default"}1099gitlab # [ 176.856459] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:16:50.641Z","message":"Cron Jobs - added job with name remove_expired_members_worker in the namespace default"}1100gitlab # [ 176.858624] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:16:50.644Z","message":"Cron Jobs - added job with name remove_expired_group_links_worker in the namespace default"}1101gitlab # [ 176.861006] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:16:50.647Z","message":"Cron Jobs - added job with name remove_unaccepted_member_invites_worker in the namespace default"}1102gitlab # [ 176.863373] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:16:50.650Z","message":"Cron Jobs - added job with name prune_old_events_worker in the namespace default"}1103gitlab # [ 176.865643] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:16:50.652Z","message":"Cron Jobs - added job with name gitlab_export_prune_project_export_jobs_worker in the namespace default"}1104gitlab # [ 176.867999] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:16:50.655Z","message":"Cron Jobs - added job with name trending_projects_worker in the namespace default"}1105gitlab # [ 176.870055] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:16:50.658Z","message":"Cron Jobs - added job with name remove_unreferenced_lfs_objects_worker in the namespace default"}1106gitlab # [ 176.872286] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:16:50.661Z","message":"Cron Jobs - added job with name bulk_imports_stale_import_worker in the namespace default"}1107gitlab # [ 176.874673] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:16:50.663Z","message":"Cron Jobs - added job with name import_stuck_project_import_jobs in the namespace default"}1108gitlab # [ 176.876868] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:16:50.665Z","message":"Cron Jobs - added job with name jira_import_stuck_jira_import_jobs in the namespace default"}1109gitlab # [ 176.878952] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:16:50.668Z","message":"Cron Jobs - added job with name stuck_export_jobs_worker in the namespace default"}1110gitlab # [ 176.881057] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:16:50.670Z","message":"Cron Jobs - added job with name gitlab_service_ping_worker in the namespace default"}1111gitlab # [ 176.883087] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:16:50.673Z","message":"Cron Jobs - added job with name stuck_merge_jobs_worker in the namespace default"}1112gitlab # [ 176.885165] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:16:50.674Z","message":"Cron Jobs - added job with name pages_domain_verification_cron_worker in the namespace default"}1113gitlab # [ 176.887298] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:16:50.677Z","message":"Cron Jobs - added job with name pages_domain_removal_cron_worker in the namespace default"}1114gitlab # [ 176.889531] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:16:50.680Z","message":"Cron Jobs - added job with name pages_domain_ssl_renewal_cron_worker in the namespace default"}1115gitlab # [ 176.891624] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:16:50.686Z","message":"Cron Jobs - added job with name issue_due_scheduler_worker in the namespace default"}1116gitlab # [ 176.893809] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:16:50.690Z","message":"Cron Jobs - added job with name schedule_migrate_external_diffs_worker in the namespace default"}1117gitlab # [ 176.895968] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:16:50.696Z","message":"Cron Jobs - added job with name namespaces_prune_aggregation_schedules_worker in the namespace default"}1118gitlab # [ 176.898389] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:16:50.701Z","message":"Cron Jobs - added job with name container_expiration_policy_worker in the namespace default"}1119gitlab # [ 176.900541] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:16:50.705Z","message":"Cron Jobs - added job with name cleanup_container_registry_worker in the namespace default"}1120gitlab # [ 176.902603] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:16:50.709Z","message":"Cron Jobs - added job with name image_ttl_group_policy_worker in the namespace default"}1121gitlab # [ 176.904716] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:16:50.713Z","message":"Cron Jobs - added job with name cleanup_dependency_proxy_worker in the namespace default"}1122gitlab # [ 176.906789] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:16:50.717Z","message":"Cron Jobs - added job with name cleanup_package_registry_worker in the namespace default"}1123gitlab # [ 176.908937] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:16:50.721Z","message":"Cron Jobs - added job with name x509_issuer_crl_check_worker in the namespace default"}1124gitlab # [ 176.910965] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:16:50.725Z","message":"Cron Jobs - added job with name users_create_statistics_worker in the namespace default"}1125gitlab # [ 176.920247] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:16:50.746Z","message":"Cron Jobs - added job with name authorized_project_update_periodic_recalculate_worker in the namespace default"}1126gitlab # [ 176.923933] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:16:50.750Z","message":"Cron Jobs - added job with name update_container_registry_info_worker in the namespace default"}1127gitlab # [ 176.928840] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:16:50.753Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_manager in the namespace default"}1128gitlab # [ 176.931874] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:16:50.756Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_dropper in the namespace default"}1129gitlab # [ 176.935356] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:16:50.758Z","message":"Cron Jobs - added job with name analytics_usage_trends_count_job_trigger_worker in the namespace default"}1130gitlab # [ 177.011070] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:16:50.835Z","message":"Cron Jobs - added job with name member_invitation_reminder_emails_worker in the namespace default"}1131gitlab # [ 177.018274] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:16:50.839Z","message":"Cron Jobs - added job with name schedule_merge_request_cleanup_refs_worker in the namespace default"}1132gitlab # [ 177.025387] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:16:50.842Z","message":"Cron Jobs - added job with name manage_evidence_worker in the namespace default"}1133gitlab # [ 177.031653] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:16:50.844Z","message":"Cron Jobs - added job with name publish_release_worker in the namespace default"}1134gitlab # [ 177.038082] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:16:50.846Z","message":"Cron Jobs - added job with name user_status_cleanup_batch_worker in the namespace default"}1135gitlab # [ 177.044677] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:16:50.851Z","message":"Cron Jobs - added job with name ssh_keys_expired_notification_worker in the namespace default"}1136gitlab # [ 177.050879] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:16:50.854Z","message":"Cron Jobs - added job with name ssh_keys_expiring_soon_notification_worker in the namespace default"}1137gitlab # [ 177.058217] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:16:50.857Z","message":"Cron Jobs - added job with name users_deactivate_dormant_users_worker in the namespace default"}1138gitlab # [ 177.064517] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:16:50.861Z","message":"Cron Jobs - added job with name ci_delete_unit_tests_worker in the namespace default"}1139gitlab # [ 177.070326] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:16:50.864Z","message":"Cron Jobs - added job with name batched_background_migrations_worker in the namespace default"}1140gitlab # [ 177.076110] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:16:50.866Z","message":"Cron Jobs - added job with name batched_background_migration_worker_ci_database in the namespace default"}1141gitlab # [ 177.081956] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:16:50.868Z","message":"Cron Jobs - added job with name batched_background_migration_worker_sec_database in the namespace default"}1142gitlab # [ 177.087883] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:16:50.871Z","message":"Cron Jobs - added job with name background_operations_worker_main_database in the namespace default"}1143gitlab # [ 177.093232] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:16:50.873Z","message":"Cron Jobs - added job with name background_operations_worker_ci_database in the namespace default"}1144gitlab # [ 177.098273] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:16:50.880Z","message":"Cron Jobs - added job with name background_operations_worker_sec_database in the namespace default"}1145gitlab # [ 177.103331] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:16:50.887Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_main_database in the namespace default"}1146gitlab # [ 177.108711] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:16:50.895Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_ci_database in the namespace default"}1147gitlab # [ 177.113677] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:16:50.899Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_sec_database in the namespace default"}1148gitlab # [ 177.118372] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:16:50.906Z","message":"Cron Jobs - added job with name issues_reschedule_stuck_issue_rebalances in the namespace default"}1149gitlab # [ 177.122594] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:16:50.912Z","message":"Cron Jobs - added job with name projects_schedule_refresh_build_artifacts_size_statistics_worker in the namespace default"}1150gitlab # [ 177.127026] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:16:50.916Z","message":"Cron Jobs - added job with name inactive_projects_deletion_cron_worker in the namespace default"}1151gitlab # [ 177.130822] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:16:50.921Z","message":"Cron Jobs - added job with name loose_foreign_keys_cleanup_worker in the namespace default"}1152gitlab # [ 177.134319] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:16:50.924Z","message":"Cron Jobs - added job with name loose_foreign_keys_ci_pipelines_builds_cleanup_worker in the namespace default"}1153gitlab # [ 177.138004] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:16:50.928Z","message":"Cron Jobs - added job with name loose_foreign_keys_merge_request_diff_commit_cleanup_worker in the namespace default"}1154gitlab # [ 177.142406] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:16:50.931Z","message":"Cron Jobs - added job with name batched_git_ref_updates_cleanup_scheduler_worker in the namespace default"}1155gitlab # [ 177.145728] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:16:50.936Z","message":"Cron Jobs - added job with name ci_runner_versions_reconciliation_worker in the namespace default"}1156gitlab # [ 177.148844] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:16:50.938Z","message":"Cron Jobs - added job with name users_migrate_records_to_ghost_user_in_batches_worker in the namespace default"}1157gitlab # [ 177.152132] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:16:50.941Z","message":"Cron Jobs - added job with name ci_runners_stale_machines_cleanup_worker in the namespace default"}1158gitlab # [ 177.155197] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:16:50.945Z","message":"Cron Jobs - added job with name packages_cleanup_delete_orphaned_dependencies_worker in the namespace default"}1159gitlab # [ 177.158687] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:16:50.948Z","message":"Cron Jobs - added job with name cleanup_dangling_debian_package_files_worker in the namespace default"}1160gitlab # [ 177.161958] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:16:50.951Z","message":"Cron Jobs - added job with name object_storage_delete_stale_direct_uploads_worker in the namespace default"}1161gitlab # [ 177.165301] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:16:50.953Z","message":"Cron Jobs - added job with name service_desk_custom_email_verification_cleanup in the namespace default"}1162gitlab # [ 177.168473] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:16:50.956Z","message":"Cron Jobs - added job with name deactivated_pages_deployments_delete_cron_worker in the namespace default"}1163gitlab # [ 177.171531] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:16:50.958Z","message":"Cron Jobs - added job with name ci_schedule_unlock_pipelines_in_queue_worker in the namespace default"}1164gitlab # [ 177.174632] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:16:50.962Z","message":"Cron Jobs - added job with name ci_catalog_resources_process_sync_events_worker in the namespace default"}1165gitlab # [ 177.177626] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:16:50.963Z","message":"Cron Jobs - added job with name namespaces_process_outdated_namespace_descendants_cron_worker in the namespace default"}1166gitlab # [ 177.180652] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:16:50.965Z","message":"Cron Jobs - added job with name performance_bar_stats in the namespace default"}1167gitlab # [ 177.183048] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:16:50.969Z","message":"Cron Jobs - added job with name ci_catalog_resources_aggregate_last30_day_usage_worker in the namespace default"}1168gitlab # [ 177.185955] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:16:50.973Z","message":"Cron Jobs - added job with name ci_catalog_resources_cleanup_last_usages_worker in the namespace default"}1169gitlab # [ 177.188588] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:16:50.975Z","message":"Cron Jobs - added job with name ci_click_house_finished_pipelines_sync_worker in the namespace default"}1170gitlab # [ 177.191071] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:16:50.977Z","message":"Cron Jobs - added job with name deactivate_expired_deployments_cron_worker in the namespace default"}1171gitlab # [ 177.193694] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:16:50.989Z","message":"Cron Jobs - added job with name database_monitor_locked_tables_cron_worker in the namespace default"}1172gitlab # [ 177.196185] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:16:50.992Z","message":"Cron Jobs - added job with name merge_requests_process_scheduled_merge in the namespace default"}1173gitlab # [ 177.198498] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:16:50.994Z","message":"Cron Jobs - added job with name ci_schedule_old_pipelines_removal_cron_worker in the namespace default"}1174gitlab # [ 177.200956] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:16:50.998Z","message":"Cron Jobs - added job with name version_version_check_cron in the namespace default"}1175gitlab # [ 177.203066] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:16:51.000Z","message":"Cron Jobs - added job with name import_placeholder_user_cleanup_worker in the namespace default"}1176gitlab # [ 177.205357] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:16:51.003Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_grant_archive_worker in the namespace default"}1177gitlab # [ 177.207676] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:16:51.006Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_token_archive_worker in the namespace default"}1178gitlab # [ 177.210105] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:16:51.008Z","message":"Cron Jobs - added job with name lost_transaction_recovery_worker in the namespace default"}1179gitlab # [ 177.212136] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:16:51.010Z","message":"Cron Jobs - added job with name topology_service_stale_requests_cleanup_worker in the namespace default"}1180gitlab # [ 177.214289] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:16:51.014Z","message":"Cron Jobs - added job with name cells_schedule_claims_verification_worker in the namespace default"}1181gitlab # [ 177.216506] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:16:51.016Z","message":"Cron Jobs - added job with name concurrency_limit_resume_worker in the namespace default"}1182gitlab # [ 180.303717] gitlab-workhorse[817]: time="2026-08-13T13:16:54Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1183gitlab # [ 190.304753] gitlab-workhorse[817]: time="2026-08-13T13:17:04Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1184gitlab # [ 200.316487] gitlab-workhorse[817]: time="2026-08-13T13:17:14Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1185gitlab # [ 210.317606] gitlab-workhorse[817]: time="2026-08-13T13:17:24Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1186gitlab # [ 216.556200] postgres[2741]: [2741] ERROR: relation "table_without_models" does not exist1187gitlab # [ 216.556645] postgres[2741]: [2741] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1188gitlab # [ 220.317884] postgres[2789]: [2789] ERROR: relation "table_without_models" does not exist1189gitlab # [ 220.321469] postgres[2789]: [2789] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1190gitlab # [ 220.326503] gitlab-workhorse[817]: time="2026-08-13T13:17:34Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1191gitlab # [ 221.581306] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:17:35.401Z","message":"Booted Rails 7.2.3.1 application in production environment"}1192gitlab # [ 221.583731] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:17:35.410Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [aarch64-linux]"}1193gitlab # [ 221.590447] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:17:35.410Z","message":"See LICENSE and the LGPL-3.0 for licensing details."}1194gitlab # [ 221.595955] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:17:35.410Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"}1195gitlab # [ 221.602352] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:17:35.412Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1196gitlab # [ 224.321263] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:17:38.146Z","message":"Cleaning working queues"}1197gitlab # [ 224.322752] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:17:38.148Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"fe9b51650733db1f6e0869cd","created_at":"2026-08-13T13:15:58.700Z","trace_propagation_headers":{"sentry-trace":"a507b66239994892913a5d4848ea7c65-a55fee376fd84b1f","baggage":"sentry-trace_id=a507b66239994892913a5d4848ea7c65,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"61e4f6e695a1ba9881a1ef35ec425e24","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-08-13T13:15:58.711Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-fe9b51650733db1f6e0869cd: start","job_status":"start","queue_duration_s":99.437181,"scheduling_latency_s":99.437233}1198gitlab # [ 224.697062] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:17:38.522Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"fe9b51650733db1f6e0869cd","created_at":"2026-08-13T13:15:58.700Z","trace_propagation_headers":{"sentry-trace":"a507b66239994892913a5d4848ea7c65-a55fee376fd84b1f","baggage":"sentry-trace_id=a507b66239994892913a5d4848ea7c65,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"61e4f6e695a1ba9881a1ef35ec425e24","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-08-13T13:15:58.711Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-fe9b51650733db1f6e0869cd: done: 0.373759 sec","job_status":"done","queue_duration_s":99.437181,"scheduling_latency_s":99.437233,"redis_calls":29,"redis_duration_s":0.012198,"redis_read_bytes":282,"redis_write_bytes":3632,"redis_feature_flag_calls":18,"redis_feature_flag_duration_s":0.007288,"redis_feature_flag_read_bytes":272,"redis_feature_flag_write_bytes":2385,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.0031,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":688,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00181,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":559,"db_count":15,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.024,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.02,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.179533,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.18947998,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.373759,"completed_at":"2026-08-13T13:17:38.522Z","load_balancing_strategy":"primary","db_duration_s":0.105829,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1199gitlab # [ 227.608260] bundle[1981]: {"timestamp":"2026-08-13T13:17:41.433Z","pid":1981,"message":"* Listening on unix:///var/gitlab/state//tmp/sockets/gitlab.socket"}1200gitlab # [ 227.608595] bundle[1981]: {"timestamp":"2026-08-13T13:17:41.433Z","pid":1981,"message":"! WARNING: Detected 2 Thread(s) started in app boot:"}1201gitlab # [ 227.608772] bundle[1981]: {"timestamp":"2026-08-13T13:17:41.433Z","pid":1981,"message":"! #\u003cThread:0x0000fd44f00ae550 /nix/store/zj7sa5zsg6vhnyq28b8v0x1jajz1gpvc-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:72 sleep\u003e - /nix/store/zj7sa5zsg6vhnyq28b8v0x1jajz1gpvc-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:90:in `sleep'"}1202gitlab # [ 227.608899] bundle[1981]: {"timestamp":"2026-08-13T13:17:41.433Z","pid":1981,"message":"! #\u003cThread:0x0000fd44f02bea48 /nix/store/lnly88svq5ykjs8ynaw5cm3g88z1lvsm-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:18 sleep\u003e - /nix/store/lnly88svq5ykjs8ynaw5cm3g88z1lvsm-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:20:in `sleep'"}1203gitlab # [ 227.609050] bundle[1981]: {"timestamp":"2026-08-13T13:17:41.433Z","pid":1981,"message":"Use Ctrl-C to stop"}1204gitlab # [ 227.609170] bundle[1981]: {"timestamp":"2026-08-13T13:17:41.434Z","pid":1981,"message":"Sending status to systemd every 1.0 sec"}1205gitlab # [ 230.787818] bundle[1981]: {"timestamp":"2026-08-13T13:17:44.612Z","pid":1981,"message":"- Worker 0 (PID: 2907) booted in 3.14s, phase: 0"}1206gitlab # [ 230.788187] bundle[1981]: {"timestamp":"2026-08-13T13:17:44.613Z","pid":1981,"message":"- Worker 1 (PID: 2911) booted in 3.12s, phase: 0"}1207gitlab # [ 230.796412] systemd[1]: Started gitlab.service.1208gitlab # [ 230.797951] systemd[1]: Reached target Common target for all GitLab services..1209gitlab # [ 230.802108] systemd[1]: Starting setup-gitlab.service...1210gitlab # [ 230.844445] setup-gitlab-start[2964]: + timeout 900 bash -c 'until curl -fs http://gitlab/users/sign_in > /dev/null; do sleep 5; done'1211gitlab # [ 231.760293] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/13:13:17:45 +0000] "GET /users/sign_in HTTP/1.1" 200 10655 "" "curl/8.21.0" 8651212gitlab # [ 231.764360] setup-gitlab-start[2964]: + TOKEN=nixbot-test-token-of-20-chars1213gitlab # [ 231.765632] setup-gitlab-start[2964]: + runuser -u gitlab -- /run/current-system/sw/bin/gitlab-rails runner $'\n ApplicationSetting.current.update!(allow_local_requests_from_web_hooks_and_services: true)\n Rails.cache.clear\n token = User.find_by_username(\'root\').personal_access_tokens.create!(\n name: \'nixbot\', scopes: [:api], expires_at: 7.days.from_now)\n token.set_token(\'nixbot-test-token-of-20-chars\')\n token.save!\n'1214gitlab # [ 231.779907] runuser[2981]: pam_unix(runuser:session): session opened for user gitlab(uid=165) by (uid=0)1215gitlab # [ 232.352860] setup-gitlab-start[2982]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1216gitlab # [ 232.359452] setup-gitlab-start[2982]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1217gitlab # [ 232.365976] setup-gitlab-start[2982]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1218gitlab # [ 233.206284] setup-gitlab-start[2982]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1219gitlab # [ 233.206651] setup-gitlab-start[2982]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1220gitlab # [ 233.209112] setup-gitlab-start[2982]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1221gitlab # [ 237.998884] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:17:51.823Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"efc98532057c62ef807ffc16","created_at":"2026-08-13T13:17:51.718Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-20120ecbeb694008","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"34038a8dfc3fa0cfa22bb326b1c5f94d","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-13T13:17:51.820Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-efc98532057c62ef807ffc16: start","job_status":"start","queue_duration_s":0.003276,"scheduling_latency_s":0.003339}1222gitlab # [ 238.224655] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:17:52.049Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"efc98532057c62ef807ffc16","created_at":"2026-08-13T13:17:51.718Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-20120ecbeb694008","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"34038a8dfc3fa0cfa22bb326b1c5f94d","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-13T13:17:51.820Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-efc98532057c62ef807ffc16: done: 0.226459 sec","job_status":"done","queue_duration_s":0.003276,"scheduling_latency_s":0.003339,"redis_calls":10,"redis_duration_s":0.024853,"redis_read_bytes":9,"redis_write_bytes":1061,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.003857,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.019695,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":550,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001301,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":208,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.01,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.044975,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00184626,"duration_s":0.226459,"completed_at":"2026-08-13T13:17:52.049Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.032153,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1223gitlab # [ 238.316374] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:17:52.060Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"b908424b44a9739966cb1a5b","created_at":"2026-08-13T13:17:51.843Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-20120ecbeb694008","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1aa4aadae7a538f710aa4adab510ee2b","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-13T13:17:51.876Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-b908424b44a9739966cb1a5b: start","job_status":"start","queue_duration_s":0.183192,"scheduling_latency_s":0.183246}1224gitlab # [ 239.547535] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:17:53.372Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"b908424b44a9739966cb1a5b","created_at":"2026-08-13T13:17:51.843Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-20120ecbeb694008","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1aa4aadae7a538f710aa4adab510ee2b","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-13T13:17:51.876Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-b908424b44a9739966cb1a5b: done: 1.312278 sec","job_status":"done","queue_duration_s":0.183192,"scheduling_latency_s":0.183246,"redis_calls":565,"redis_duration_s":0.711674,"redis_read_bytes":564,"redis_write_bytes":49139,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000876,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002225,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":546,"redis_shared_state_calls":557,"redis_shared_state_duration_s":0.708573,"redis_shared_state_read_bytes":558,"redis_shared_state_write_bytes":48290,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.680041,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00044702,"duration_s":1.312278,"completed_at":"2026-08-13T13:17:53.372Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001039,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1225gitlab # [ 239.551022] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:17:53.374Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"10e8edd4ca85a3748d92b80c","created_at":"2026-08-13T13:17:51.944Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-20120ecbeb694008","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c600fc250ced5e904ab5f9cacfc2a12e","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-13T13:17:51.954Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-10e8edd4ca85a3748d92b80c: start","job_status":"start","queue_duration_s":1.420548,"scheduling_latency_s":1.420577}1226gitlab # [ 240.034069] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:17:53.859Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"10e8edd4ca85a3748d92b80c","created_at":"2026-08-13T13:17:51.944Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-20120ecbeb694008","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c600fc250ced5e904ab5f9cacfc2a12e","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-13T13:17:51.954Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-10e8edd4ca85a3748d92b80c: done: 0.484893 sec","job_status":"done","queue_duration_s":1.420548,"scheduling_latency_s":1.420577,"redis_calls":14,"redis_duration_s":0.005169,"redis_read_bytes":13,"redis_write_bytes":1641,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.00153,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":576,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001968,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001671,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":511,"db_count":131,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":131,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.06,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":129,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":84,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.057,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.404926,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00139274,"exclusive_lock_hold_duration_s":0.43464852,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"ci","turbo_mode":false},"duration_s":0.484893,"completed_at":"2026-08-13T13:17:53.859Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.092832,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1227gitlab # [ 240.151744] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:17:53.862Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"d57fe5393b9342dad2416a0a","created_at":"2026-08-13T13:17:51.972Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-20120ecbeb694008","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9893cbe8d4cb8debe66c6f4ef4b9bd7d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-13T13:17:51.989Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-d57fe5393b9342dad2416a0a: start","job_status":"start","queue_duration_s":1.872162,"scheduling_latency_s":1.872189}1228gitlab # [ 240.192642] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:17:54.017Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"d57fe5393b9342dad2416a0a","created_at":"2026-08-13T13:17:51.972Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-20120ecbeb694008","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9893cbe8d4cb8debe66c6f4ef4b9bd7d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-13T13:17:51.989Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-d57fe5393b9342dad2416a0a: done: 0.155872 sec","job_status":"done","queue_duration_s":1.872162,"scheduling_latency_s":1.872189,"redis_calls":12,"redis_duration_s":0.004693,"redis_read_bytes":11,"redis_write_bytes":1612,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00061,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":347,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002338,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":654,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001745,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":611,"db_count":7,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.02,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.019,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.046552,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00073102,"exclusive_lock_hold_duration_s":0.12029446,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.155872,"completed_at":"2026-08-13T13:17:54.017Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.09635,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1229gitlab # [ 240.267962] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:17:54.021Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"b1260f412b618d6caf3a40fe","created_at":"2026-08-13T13:17:52.034Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-20120ecbeb694008","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"05c10f0139315a54df39e1db7b9ddfa5","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-13T13:17:52.053Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-b1260f412b618d6caf3a40fe: start","job_status":"start","queue_duration_s":1.968573,"scheduling_latency_s":1.96864}1230gitlab # [ 240.287263] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:17:54.111Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"b1260f412b618d6caf3a40fe","created_at":"2026-08-13T13:17:52.034Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-20120ecbeb694008","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"05c10f0139315a54df39e1db7b9ddfa5","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-13T13:17:52.053Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-b1260f412b618d6caf3a40fe: done: 0.089412 sec","job_status":"done","queue_duration_s":1.968573,"scheduling_latency_s":1.96864,"redis_calls":16,"redis_duration_s":0.006404,"redis_read_bytes":15,"redis_write_bytes":1942,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.003584,"redis_feature_flag_read_bytes":8,"redis_feature_flag_write_bytes":1148,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002109,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":574,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000711,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":220,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.018,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.018,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.051154,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00059454,"duration_s":0.089412,"completed_at":"2026-08-13T13:17:54.111Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.020936,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1231gitlab # [ 240.334027] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:17:54.113Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"321a4eda9835c48233801905","created_at":"2026-08-13T13:17:52.067Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-20120ecbeb694008","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"538e129d2548f7690a53ec4eb3854fc0","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-13T13:17:52.121Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-321a4eda9835c48233801905: start","job_status":"start","queue_duration_s":1.992256,"scheduling_latency_s":1.992286}1232gitlab # [ 240.348668] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:17:54.150Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"321a4eda9835c48233801905","created_at":"2026-08-13T13:17:52.067Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-20120ecbeb694008","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"538e129d2548f7690a53ec4eb3854fc0","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-13T13:17:52.121Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-321a4eda9835c48233801905: done: 0.036636 sec","job_status":"done","queue_duration_s":1.992256,"scheduling_latency_s":1.992286,"redis_calls":12,"redis_duration_s":0.003998,"redis_read_bytes":11,"redis_write_bytes":1482,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.00163,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":610,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001787,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":626,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000581,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":246,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022072,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00047424,"duration_s":0.036636,"completed_at":"2026-08-13T13:17:54.150Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001538,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1233gitlab # [ 240.391515] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:17:54.152Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"ee8f04114b5265b6f3cf5017","created_at":"2026-08-13T13:17:52.172Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-20120ecbeb694008","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"154d4bcb784ba23a1c26215e167f1033","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-13T13:17:52.198Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-ee8f04114b5265b6f3cf5017: start","job_status":"start","queue_duration_s":1.954533,"scheduling_latency_s":1.954558}1234gitlab # [ 240.406167] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:17:54.200Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"ee8f04114b5265b6f3cf5017","created_at":"2026-08-13T13:17:52.172Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-20120ecbeb694008","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"154d4bcb784ba23a1c26215e167f1033","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-13T13:17:52.198Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-ee8f04114b5265b6f3cf5017: done: 0.047979 sec","job_status":"done","queue_duration_s":1.954533,"scheduling_latency_s":1.954558,"redis_calls":13,"redis_duration_s":0.004668,"redis_read_bytes":12,"redis_write_bytes":1668,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000592,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002461,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":728,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001615,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":603,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.031215,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.01442414,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.047979,"completed_at":"2026-08-13T13:17:54.200Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005128,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1235gitlab # [ 240.450308] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:17:54.202Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"e7c6574a1b2b25515d871fc7","created_at":"2026-08-13T13:17:52.226Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-20120ecbeb694008","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d6597ee9de9d015e065be0642ad4ee2f","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-13T13:17:52.251Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-e7c6574a1b2b25515d871fc7: start","job_status":"start","queue_duration_s":1.951804,"scheduling_latency_s":1.951828}1236gitlab # [ 240.465126] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:17:54.241Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"e7c6574a1b2b25515d871fc7","created_at":"2026-08-13T13:17:52.226Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-20120ecbeb694008","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d6597ee9de9d015e065be0642ad4ee2f","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-13T13:17:52.251Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-e7c6574a1b2b25515d871fc7: done: 0.038535 sec","job_status":"done","queue_duration_s":1.951804,"scheduling_latency_s":1.951828,"redis_calls":12,"redis_duration_s":0.004179,"redis_read_bytes":11,"redis_write_bytes":1489,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000547,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001795,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001837,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":560,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020484,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00069816,"exclusive_lock_hold_duration_s":0.01157656,"duration_s":0.038535,"completed_at":"2026-08-13T13:17:54.241Z","load_balancing_strategy":"primary","db_duration_s":0.006153,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1237gitlab # [ 240.507110] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:17:54.243Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"1bcbc537ad3c96a12162deb4","created_at":"2026-08-13T13:17:52.288Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-20120ecbeb694008","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e477679d34ef31827f02338a8055785b","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-13T13:17:52.310Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-1bcbc537ad3c96a12162deb4: start","job_status":"start","queue_duration_s":1.933724,"scheduling_latency_s":1.933748}1238gitlab # [ 240.521325] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:17:54.273Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"1bcbc537ad3c96a12162deb4","created_at":"2026-08-13T13:17:52.288Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-20120ecbeb694008","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e477679d34ef31827f02338a8055785b","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-13T13:17:52.310Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-1bcbc537ad3c96a12162deb4: done: 0.029185 sec","job_status":"done","queue_duration_s":1.933724,"scheduling_latency_s":1.933748,"redis_calls":12,"redis_duration_s":0.003396,"redis_read_bytes":11,"redis_write_bytes":1511,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000641,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001495,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00126,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":566,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016029,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00064026,"exclusive_lock_hold_duration_s":0.00459152,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.029185,"completed_at":"2026-08-13T13:17:54.273Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002776,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1239gitlab # [ 240.564976] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:17:54.274Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"ff8c2933946ba500a3ae0ea0","created_at":"2026-08-13T13:17:52.329Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-20120ecbeb694008","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"134880d18356fd272e4604ed69477eb7","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-13T13:17:52.349Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-ff8c2933946ba500a3ae0ea0: start","job_status":"start","queue_duration_s":1.924748,"scheduling_latency_s":1.924768}1240gitlab # [ 240.579420] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:17:54.291Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0}1241gitlab # [ 240.583145] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:17:54.301Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"ff8c2933946ba500a3ae0ea0","created_at":"2026-08-13T13:17:52.329Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-20120ecbeb694008","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"134880d18356fd272e4604ed69477eb7","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-13T13:17:52.349Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-ff8c2933946ba500a3ae0ea0: done: 0.026598 sec","job_status":"done","queue_duration_s":1.924748,"scheduling_latency_s":1.924768,"redis_calls":10,"redis_duration_s":0.003218,"redis_read_bytes":9,"redis_write_bytes":1199,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000788,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001879,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":618,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000551,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":242,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01603,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0004541,"duration_s":0.026598,"completed_at":"2026-08-13T13:17:54.301Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000867,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1242gitlab # [ 240.626105] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:17:54.303Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ArchiveTracesCronWorker","jid":"487f4fa48565693fd7997d1c","created_at":"2026-08-13T13:17:52.376Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-20120ecbeb694008","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1d3711037ed3ceb24456ad35867dc439","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f0234f524ae629146c97646d3c809b290751f669b415a8b01cafe8f68b01506d","size_limiter":"validated","enqueued_at":"2026-08-13T13:17:52.396Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ArchiveTracesCronWorker JID-487f4fa48565693fd7997d1c: start","job_status":"start","queue_duration_s":1.906221,"scheduling_latency_s":1.906238}1243gitlab # [ 240.639629] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:17:54.366Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ArchiveTracesCronWorker","jid":"487f4fa48565693fd7997d1c","created_at":"2026-08-13T13:17:52.376Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-20120ecbeb694008","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1d3711037ed3ceb24456ad35867dc439","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f0234f524ae629146c97646d3c809b290751f669b415a8b01cafe8f68b01506d","size_limiter":"validated","enqueued_at":"2026-08-13T13:17:52.396Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ArchiveTracesCronWorker JID-487f4fa48565693fd7997d1c: done: 0.063078 sec","job_status":"done","queue_duration_s":1.906221,"scheduling_latency_s":1.906238,"redis_calls":12,"redis_duration_s":0.003767,"redis_read_bytes":11,"redis_write_bytes":1354,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000604,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":297,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001758,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":538,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001405,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":519,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.022,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.021,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026434,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00060058,"exclusive_lock_hold_duration_s":0.039212620000000004,"duration_s":0.063078,"completed_at":"2026-08-13T13:17:54.366Z","load_balancing_strategy":"primary","db_duration_s":0.027356,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1244gitlab # [ 240.682806] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:17:54.368Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"8b6933461347ea5c8816f00c","created_at":"2026-08-13T13:17:52.430Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-20120ecbeb694008","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6cd2abd61dad563e1bf581e08b157712","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-13T13:17:52.452Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-8b6933461347ea5c8816f00c: start","job_status":"start","queue_duration_s":1.915882,"scheduling_latency_s":1.915903}1245gitlab # [ 240.696411] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:17:54.383Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0}1246gitlab # [ 240.700034] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:17:54.392Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"8b6933461347ea5c8816f00c","created_at":"2026-08-13T13:17:52.430Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-20120ecbeb694008","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6cd2abd61dad563e1bf581e08b157712","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-13T13:17:52.452Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-8b6933461347ea5c8816f00c: done: 0.023922 sec","job_status":"done","queue_duration_s":1.915882,"scheduling_latency_s":1.915903,"redis_calls":10,"redis_duration_s":0.002793,"redis_read_bytes":9,"redis_write_bytes":1253,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000657,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":351,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001547,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":646,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000589,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":256,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013333,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00037574,"duration_s":0.023922,"completed_at":"2026-08-13T13:17:54.392Z","load_balancing_strategy":"primary","db_duration_s":0.000848,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1247gitlab # [ 240.741051] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:17:54.393Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"84aa2c611509eec88fc78cef","created_at":"2026-08-13T13:17:52.480Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-20120ecbeb694008","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d6e73175bfcdf6ef72a1207ee528a0ad","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-13T13:17:52.502Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-84aa2c611509eec88fc78cef: start","job_status":"start","queue_duration_s":1.891451,"scheduling_latency_s":1.891469}1248gitlab # [ 240.755748] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:17:54.456Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"84aa2c611509eec88fc78cef","created_at":"2026-08-13T13:17:52.480Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-20120ecbeb694008","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d6e73175bfcdf6ef72a1207ee528a0ad","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-13T13:17:52.502Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-84aa2c611509eec88fc78cef: done: 0.062323 sec","job_status":"done","queue_duration_s":1.891451,"scheduling_latency_s":1.891469,"redis_calls":12,"redis_duration_s":0.0037070000000000002,"redis_read_bytes":11,"redis_write_bytes":1622,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000534,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":349,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001668,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":658,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001505,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":615,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.026,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.026,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025262,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00084374,"exclusive_lock_hold_duration_s":0.027676879999999997,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.062323,"completed_at":"2026-08-13T13:17:54.455Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.027554,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1249gitlab # [ 240.801001] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:17:54.458Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"0679ced17b79fbb8bd204e3d","created_at":"2026-08-13T13:17:52.528Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-20120ecbeb694008","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d66f1ea45f6070b685802fda1c92b6d4","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-13T13:17:52.549Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-0679ced17b79fbb8bd204e3d: start","job_status":"start","queue_duration_s":1.908635,"scheduling_latency_s":1.908656}1250gitlab # [ 240.815648] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:17:54.474Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0}1251gitlab # [ 240.819239] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:17:54.483Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"0679ced17b79fbb8bd204e3d","created_at":"2026-08-13T13:17:52.528Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-20120ecbeb694008","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d66f1ea45f6070b685802fda1c92b6d4","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-13T13:17:52.549Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-0679ced17b79fbb8bd204e3d: done: 0.025222 sec","job_status":"done","queue_duration_s":1.908635,"scheduling_latency_s":1.908656,"redis_calls":10,"redis_duration_s":0.0026709999999999998,"redis_read_bytes":9,"redis_write_bytes":1291,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000579,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":359,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001541,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000551,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014151,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00038042,"duration_s":0.025222,"completed_at":"2026-08-13T13:17:54.483Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000749,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1252gitlab # [ 240.862138] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:17:54.485Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"aab162eadb60417374297722","created_at":"2026-08-13T13:17:52.619Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-20120ecbeb694008","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"107a96ef3f6c5c2b2aa7b99ac20f146e","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-13T13:17:52.655Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-aab162eadb60417374297722: start","job_status":"start","queue_duration_s":1.8301,"scheduling_latency_s":1.83012}1253gitlab # [ 240.877713] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:17:54.499Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0}1254gitlab # [ 240.880918] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:17:54.507Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"aab162eadb60417374297722","created_at":"2026-08-13T13:17:52.619Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-20120ecbeb694008","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"107a96ef3f6c5c2b2aa7b99ac20f146e","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-13T13:17:52.655Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-aab162eadb60417374297722: done: 0.021921 sec","job_status":"done","queue_duration_s":1.8301,"scheduling_latency_s":1.83012,"redis_calls":10,"redis_duration_s":0.002753,"redis_read_bytes":9,"redis_write_bytes":1207,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000539,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001697,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000517,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012401,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00038244,"duration_s":0.021921,"completed_at":"2026-08-13T13:17:54.507Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000674,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1255gitlab # [ 240.924933] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:17:54.509Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"cd3ee6475f5869d0f86835d0","created_at":"2026-08-13T13:17:52.689Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-20120ecbeb694008","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"bed4f1088836c32eeb77fe84db7eeb49","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-08-13T13:17:52.710Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-cd3ee6475f5869d0f86835d0: start","job_status":"start","queue_duration_s":1.798717,"scheduling_latency_s":1.798734}1256gitlab # [ 240.939098] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:17:54.549Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"cd3ee6475f5869d0f86835d0","created_at":"2026-08-13T13:17:52.689Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-20120ecbeb694008","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"bed4f1088836c32eeb77fe84db7eeb49","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-08-13T13:17:52.710Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-cd3ee6475f5869d0f86835d0: done: 0.040008 sec","job_status":"done","queue_duration_s":1.798717,"scheduling_latency_s":1.798734,"redis_calls":19,"redis_duration_s":0.004854,"redis_read_bytes":22,"redis_write_bytes":4781,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001096,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":672,"redis_queues_calls":2,"redis_queues_duration_s":0.000452,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3011,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.002445,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":814,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000861,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":284,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026737,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0003398,"duration_s":0.040008,"completed_at":"2026-08-13T13:17:54.549Z","load_balancing_strategy":"primary","db_duration_s":0.003259,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1257gitlab # [ 240.982205] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:17:54.550Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"632f2522d87ba0c45095039d","created_at":"2026-08-13T13:17:52.732Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-20120ecbeb694008","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2232ef3551018b0b30dc9161f43783bb","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-13T13:17:52.752Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-632f2522d87ba0c45095039d: start","job_status":"start","queue_duration_s":1.798204,"scheduling_latency_s":1.798219}1258gitlab # [ 240.995516] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:17:54.585Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"632f2522d87ba0c45095039d","created_at":"2026-08-13T13:17:52.732Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-20120ecbeb694008","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2232ef3551018b0b30dc9161f43783bb","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-13T13:17:52.752Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-632f2522d87ba0c45095039d: done: 0.034295 sec","job_status":"done","queue_duration_s":1.798204,"scheduling_latency_s":1.798219,"redis_calls":10,"redis_duration_s":0.002584,"redis_read_bytes":9,"redis_write_bytes":1157,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000543,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001517,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000524,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020419,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00034112,"duration_s":0.034295,"completed_at":"2026-08-13T13:17:54.584Z","load_balancing_strategy":"primary","db_duration_s":0.006165,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1259gitlab # [ 241.037217] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:17:54.586Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"58b58dc905b8bdb6424c1fc0","created_at":"2026-08-13T13:17:52.796Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-20120ecbeb694008","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"17a90f32b7b437500584f2bfee50ebcf","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-13T13:17:52.816Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-58b58dc905b8bdb6424c1fc0: start","job_status":"start","queue_duration_s":1.769735,"scheduling_latency_s":1.769752}1260gitlab # [ 241.052138] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:17:54.599Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0}1261gitlab # [ 241.055850] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:17:54.606Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"58b58dc905b8bdb6424c1fc0","created_at":"2026-08-13T13:17:52.796Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-20120ecbeb694008","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"17a90f32b7b437500584f2bfee50ebcf","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-13T13:17:52.816Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-58b58dc905b8bdb6424c1fc0: done: 0.020053 sec","job_status":"done","queue_duration_s":1.769735,"scheduling_latency_s":1.769752,"redis_calls":10,"redis_duration_s":0.002414,"redis_read_bytes":9,"redis_write_bytes":1283,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00052,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001413,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":662,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000481,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":264,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010982,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00033888,"duration_s":0.020053,"completed_at":"2026-08-13T13:17:54.606Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00064,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1262gitlab # [ 241.099944] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:17:54.608Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"8cf67a7b8e36e51cc30d5e83","created_at":"2026-08-13T13:17:52.857Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-20120ecbeb694008","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"09fc27cd9e87e2ff296525a63464dab3","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-13T13:17:52.877Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-8cf67a7b8e36e51cc30d5e83: start","job_status":"start","queue_duration_s":1.730629,"scheduling_latency_s":1.730644}1263gitlab # [ 241.115123] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:17:54.628Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"8cf67a7b8e36e51cc30d5e83","created_at":"2026-08-13T13:17:52.857Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-20120ecbeb694008","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"09fc27cd9e87e2ff296525a63464dab3","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-13T13:17:52.877Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-8cf67a7b8e36e51cc30d5e83: done: 0.020178 sec","job_status":"done","queue_duration_s":1.730629,"scheduling_latency_s":1.730644,"redis_calls":10,"redis_duration_s":0.002585,"redis_read_bytes":9,"redis_write_bytes":1299,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000718,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":361,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001364,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":670,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000503,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":268,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011415,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0003357,"duration_s":0.020178,"completed_at":"2026-08-13T13:17:54.628Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000578,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1264gitlab # [ 241.158118] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:17:54.630Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"42a1ea61e5339ab63bf0ac10","created_at":"2026-08-13T13:17:52.901Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-20120ecbeb694008","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5d8026c36eb90e916c959e9ba82d4315","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-13T13:17:52.921Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-42a1ea61e5339ab63bf0ac10: start","job_status":"start","queue_duration_s":1.709711,"scheduling_latency_s":1.709757}1265gitlab # [ 241.171765] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:17:54.662Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0}1266gitlab # [ 241.175322] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:17:54.678Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"42a1ea61e5339ab63bf0ac10","created_at":"2026-08-13T13:17:52.901Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-20120ecbeb694008","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5d8026c36eb90e916c959e9ba82d4315","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-13T13:17:52.921Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-42a1ea61e5339ab63bf0ac10: done: 0.047649 sec","job_status":"done","queue_duration_s":1.709711,"scheduling_latency_s":1.709757,"redis_calls":10,"redis_duration_s":0.002759,"redis_read_bytes":9,"redis_write_bytes":1261,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000546,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":353,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001632,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":650,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000581,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":258,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.027879,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00051942,"duration_s":0.047649,"completed_at":"2026-08-13T13:17:54.678Z","load_balancing_strategy":"primary","db_duration_s":0.000778,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1267gitlab # [ 241.217220] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:17:54.680Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"bb6250f4edbfb11e65e146d6","created_at":"2026-08-13T13:17:52.945Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-20120ecbeb694008","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5dec8df1243a009fce9a0e929f5b5a1e","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-13T13:17:52.965Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-bb6250f4edbfb11e65e146d6: start","job_status":"start","queue_duration_s":1.71534,"scheduling_latency_s":1.715369}1268gitlab # [ 241.230856] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:17:54.740Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"bb6250f4edbfb11e65e146d6","created_at":"2026-08-13T13:17:52.945Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-20120ecbeb694008","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5dec8df1243a009fce9a0e929f5b5a1e","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-13T13:17:52.965Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-bb6250f4edbfb11e65e146d6: done: 0.060132 sec","job_status":"done","queue_duration_s":1.71534,"scheduling_latency_s":1.715369,"redis_calls":10,"redis_duration_s":0.0028899999999999998,"redis_read_bytes":9,"redis_write_bytes":1289,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000647,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001664,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000579,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.016,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.016,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.029676,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00037024,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.060132,"completed_at":"2026-08-13T13:17:54.740Z","load_balancing_strategy":"primary","db_duration_s":0.018585,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1269gitlab # [ 241.275189] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:17:54.742Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"6da1429a0c3a7a26d4f8fc78","created_at":"2026-08-13T13:17:52.984Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-20120ecbeb694008","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5c6a384cbdc68ee21b57a33631860259","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-13T13:17:53.006Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-6da1429a0c3a7a26d4f8fc78: start","job_status":"start","queue_duration_s":1.735843,"scheduling_latency_s":1.735864}1270gitlab # [ 241.288708] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:17:54.970Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"6da1429a0c3a7a26d4f8fc78","created_at":"2026-08-13T13:17:52.984Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-20120ecbeb694008","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5c6a384cbdc68ee21b57a33631860259","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-13T13:17:53.006Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-6da1429a0c3a7a26d4f8fc78: done: 0.227699 sec","job_status":"done","queue_duration_s":1.735843,"scheduling_latency_s":1.735864,"redis_calls":71,"redis_duration_s":0.011746,"redis_read_bytes":120,"redis_write_bytes":42674,"redis_feature_flag_calls":10,"redis_feature_flag_duration_s":0.0016,"redis_feature_flag_read_bytes":10,"redis_feature_flag_write_bytes":1471,"redis_queues_calls":2,"redis_queues_duration_s":0.000753,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37485,"redis_queues_metadata_calls":56,"redis_queues_metadata_duration_s":0.008919,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3418,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000474,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":300,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.212843,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0002732,"duration_s":0.227699,"completed_at":"2026-08-13T13:17:54.970Z","load_balancing_strategy":"primary","db_duration_s":0.001803,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1271gitlab # [ 241.331959] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:17:54.971Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"7f26d009cfe5903be274e40a","created_at":"2026-08-13T13:17:54.527Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-20d9e041b30f4419","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"bed4f1088836c32eeb77fe84db7eeb49","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:17:54.541Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-7f26d009cfe5903be274e40a: start","job_status":"start","queue_duration_s":0.430721,"scheduling_latency_s":0.43074}1272gitlab # [ 241.344391] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:17:54.988Z","message":"No existing merge request to be cleaned up."}1273gitlab # [ 241.346020] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:17:55.003Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"7f26d009cfe5903be274e40a","created_at":"2026-08-13T13:17:54.527Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-20d9e041b30f4419","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"bed4f1088836c32eeb77fe84db7eeb49","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:17:54.541Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-7f26d009cfe5903be274e40a: done: 0.0319 sec","job_status":"done","queue_duration_s":0.430721,"scheduling_latency_s":0.43074,"redis_calls":13,"redis_duration_s":0.0019950000000000002,"redis_read_bytes":12,"redis_write_bytes":1401,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000312,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":301,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000671,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":431,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001012,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":669,"db_count":4,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021047,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00025048,"duration_s":0.0319,"completed_at":"2026-08-13T13:17:55.003Z","load_balancing_strategy":"primary","db_duration_s":0.003358,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1274gitlab # [ 241.386487] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:17:55.004Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"cbfa82f6590f6068bc643739","created_at":"2026-08-13T13:17:54.527Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-20d9e041b30f4419","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"bed4f1088836c32eeb77fe84db7eeb49","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:17:54.541Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-cbfa82f6590f6068bc643739: start","job_status":"start","queue_duration_s":0.463858,"scheduling_latency_s":0.463876}1275gitlab # [ 241.398891] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:17:55.015Z","message":"No existing merge request to be cleaned up."}1276gitlab # [ 241.400581] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:17:55.023Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"cbfa82f6590f6068bc643739","created_at":"2026-08-13T13:17:54.527Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-20d9e041b30f4419","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"bed4f1088836c32eeb77fe84db7eeb49","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:17:54.541Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-cbfa82f6590f6068bc643739: done: 0.018147 sec","job_status":"done","queue_duration_s":0.463858,"scheduling_latency_s":0.463876,"redis_calls":10,"redis_duration_s":0.0013289999999999999,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000559,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.00077,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012806,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018147,"completed_at":"2026-08-13T13:17:55.023Z","load_balancing_strategy":"primary","db_duration_s":0.001361,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1277gitlab # [ 241.439654] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:17:55.024Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"6d0ea1ab8ee3e7d6f691fbd1","created_at":"2026-08-13T13:17:54.527Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-20d9e041b30f4419","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"bed4f1088836c32eeb77fe84db7eeb49","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:17:54.541Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-6d0ea1ab8ee3e7d6f691fbd1: start","job_status":"start","queue_duration_s":0.483038,"scheduling_latency_s":0.483054}1278gitlab # [ 241.451945] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:17:55.034Z","message":"No existing merge request to be cleaned up."}1279gitlab # [ 241.453770] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:17:55.042Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"6d0ea1ab8ee3e7d6f691fbd1","created_at":"2026-08-13T13:17:54.527Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-20d9e041b30f4419","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"bed4f1088836c32eeb77fe84db7eeb49","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:17:54.541Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-6d0ea1ab8ee3e7d6f691fbd1: done: 0.018334 sec","job_status":"done","queue_duration_s":0.483038,"scheduling_latency_s":0.483054,"redis_calls":10,"redis_duration_s":0.001873,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00055,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001323,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013057,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018334,"completed_at":"2026-08-13T13:17:55.042Z","load_balancing_strategy":"primary","db_duration_s":0.001213,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1280gitlab # [ 241.494110] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:17:55.043Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"9d94fe945ffca2263323034a","created_at":"2026-08-13T13:17:54.527Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-20d9e041b30f4419","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"bed4f1088836c32eeb77fe84db7eeb49","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:17:54.541Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-9d94fe945ffca2263323034a: start","job_status":"start","queue_duration_s":0.502473,"scheduling_latency_s":0.502489}1281gitlab # [ 241.506692] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:17:55.053Z","message":"No existing merge request to be cleaned up."}1282gitlab # [ 241.508409] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:17:55.062Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"9d94fe945ffca2263323034a","created_at":"2026-08-13T13:17:54.527Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-20d9e041b30f4419","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"bed4f1088836c32eeb77fe84db7eeb49","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:17:54.541Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-9d94fe945ffca2263323034a: done: 0.018856 sec","job_status":"done","queue_duration_s":0.502473,"scheduling_latency_s":0.502489,"redis_calls":10,"redis_duration_s":0.001325,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000557,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000768,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012525,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018856,"completed_at":"2026-08-13T13:17:55.062Z","load_balancing_strategy":"primary","db_duration_s":0.001218,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1283gitlab # [ 241.547024] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:17:55.063Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d07729cc1302b675ea6f6cba","created_at":"2026-08-13T13:17:54.766Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-ebf60021aaaa4132","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5c6a384cbdc68ee21b57a33631860259","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:17:54.962Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d07729cc1302b675ea6f6cba: start","job_status":"start","queue_duration_s":0.101454,"scheduling_latency_s":0.101469}1284gitlab # [ 241.559774] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:17:55.085Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d07729cc1302b675ea6f6cba","created_at":"2026-08-13T13:17:54.766Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-ebf60021aaaa4132","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5c6a384cbdc68ee21b57a33631860259","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:17:54.962Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d07729cc1302b675ea6f6cba: done: 0.021556 sec","job_status":"done","queue_duration_s":0.101454,"scheduling_latency_s":0.101469,"redis_calls":16,"redis_duration_s":0.001991,"redis_read_bytes":14,"redis_write_bytes":1544,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000287,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000572,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":439,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001132,"redis_shared_state_read_bytes":9,"redis_shared_state_write_bytes":798,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014106,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00024578,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.021556,"completed_at":"2026-08-13T13:17:55.085Z","load_balancing_strategy":"primary","db_duration_s":0.000314,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1285gitlab # [ 241.601486] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:17:55.086Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f8a565d8824cdce09f6091cf","created_at":"2026-08-13T13:17:54.766Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-ebf60021aaaa4132","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5c6a384cbdc68ee21b57a33631860259","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:17:54.962Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f8a565d8824cdce09f6091cf: start","job_status":"start","queue_duration_s":0.124155,"scheduling_latency_s":0.124171}1286gitlab # [ 241.614022] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:17:55.101Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f8a565d8824cdce09f6091cf","created_at":"2026-08-13T13:17:54.766Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-ebf60021aaaa4132","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5c6a384cbdc68ee21b57a33631860259","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:17:54.962Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f8a565d8824cdce09f6091cf: done: 0.014913 sec","job_status":"done","queue_duration_s":0.124155,"scheduling_latency_s":0.124171,"redis_calls":13,"redis_duration_s":0.0014810000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000517,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000964,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010579,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014913,"completed_at":"2026-08-13T13:17:55.101Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1287gitlab # [ 241.653596] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:17:55.102Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"02ab5272c22ceac81562ac6c","created_at":"2026-08-13T13:17:54.766Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-ebf60021aaaa4132","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5c6a384cbdc68ee21b57a33631860259","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:17:54.962Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-02ab5272c22ceac81562ac6c: start","job_status":"start","queue_duration_s":0.140143,"scheduling_latency_s":0.14016}1288gitlab # [ 241.666094] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:17:55.116Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"02ab5272c22ceac81562ac6c","created_at":"2026-08-13T13:17:54.766Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-ebf60021aaaa4132","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5c6a384cbdc68ee21b57a33631860259","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:17:54.962Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-02ab5272c22ceac81562ac6c: done: 0.014671 sec","job_status":"done","queue_duration_s":0.140143,"scheduling_latency_s":0.14016,"redis_calls":13,"redis_duration_s":0.001465,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000548,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000917,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010431,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014671,"completed_at":"2026-08-13T13:17:55.116Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1289gitlab # [ 241.706346] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:17:55.117Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c87dfe536eb336c29c2a062f","created_at":"2026-08-13T13:17:54.766Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-ebf60021aaaa4132","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5c6a384cbdc68ee21b57a33631860259","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:17:54.962Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c87dfe536eb336c29c2a062f: start","job_status":"start","queue_duration_s":0.15588,"scheduling_latency_s":0.155896}1290gitlab # [ 241.718961] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:17:55.132Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c87dfe536eb336c29c2a062f","created_at":"2026-08-13T13:17:54.766Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-ebf60021aaaa4132","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5c6a384cbdc68ee21b57a33631860259","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:17:54.962Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c87dfe536eb336c29c2a062f: done: 0.014515 sec","job_status":"done","queue_duration_s":0.15588,"scheduling_latency_s":0.155896,"redis_calls":13,"redis_duration_s":0.001444,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000507,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000937,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009564,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014515,"completed_at":"2026-08-13T13:17:55.132Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1291gitlab # [ 241.758316] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:17:55.134Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c609452c9125bf177dc6410c","created_at":"2026-08-13T13:17:54.766Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-ebf60021aaaa4132","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5c6a384cbdc68ee21b57a33631860259","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:17:54.962Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c609452c9125bf177dc6410c: start","job_status":"start","queue_duration_s":0.172514,"scheduling_latency_s":0.17253}1292gitlab # [ 241.770972] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:17:55.151Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c609452c9125bf177dc6410c","created_at":"2026-08-13T13:17:54.766Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-ebf60021aaaa4132","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5c6a384cbdc68ee21b57a33631860259","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:17:54.962Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c609452c9125bf177dc6410c: done: 0.016803 sec","job_status":"done","queue_duration_s":0.172514,"scheduling_latency_s":0.17253,"redis_calls":13,"redis_duration_s":0.001515,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000508,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001007,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010994,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016803,"completed_at":"2026-08-13T13:17:55.151Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1293gitlab # [ 241.810255] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:17:55.152Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fabf0cc944657674514a7ebd","created_at":"2026-08-13T13:17:54.766Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-ebf60021aaaa4132","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5c6a384cbdc68ee21b57a33631860259","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:17:54.962Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fabf0cc944657674514a7ebd: start","job_status":"start","queue_duration_s":0.190338,"scheduling_latency_s":0.190353}1294gitlab # [ 241.822929] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:17:55.166Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fabf0cc944657674514a7ebd","created_at":"2026-08-13T13:17:54.766Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-ebf60021aaaa4132","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5c6a384cbdc68ee21b57a33631860259","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:17:54.962Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fabf0cc944657674514a7ebd: done: 0.014403 sec","job_status":"done","queue_duration_s":0.190338,"scheduling_latency_s":0.190353,"redis_calls":13,"redis_duration_s":0.0014490000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000524,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000925,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01014,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014403,"completed_at":"2026-08-13T13:17:55.166Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1295gitlab # [ 241.862295] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:17:55.167Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"42179c81364331900c9acd6d","created_at":"2026-08-13T13:17:54.766Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-ebf60021aaaa4132","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5c6a384cbdc68ee21b57a33631860259","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:17:54.962Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-42179c81364331900c9acd6d: start","job_status":"start","queue_duration_s":0.205776,"scheduling_latency_s":0.205792}1296gitlab # [ 241.874923] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:17:55.182Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"42179c81364331900c9acd6d","created_at":"2026-08-13T13:17:54.766Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-ebf60021aaaa4132","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5c6a384cbdc68ee21b57a33631860259","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:17:54.962Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-42179c81364331900c9acd6d: done: 0.014659 sec","job_status":"done","queue_duration_s":0.205776,"scheduling_latency_s":0.205792,"redis_calls":13,"redis_duration_s":0.001451,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000516,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000935,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010386,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014659,"completed_at":"2026-08-13T13:17:55.182Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1297gitlab # [ 241.915303] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:17:55.183Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8af94720982f8e07da44c0c8","created_at":"2026-08-13T13:17:54.766Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-ebf60021aaaa4132","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5c6a384cbdc68ee21b57a33631860259","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:17:54.962Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8af94720982f8e07da44c0c8: start","job_status":"start","queue_duration_s":0.221546,"scheduling_latency_s":0.221562}1298gitlab # [ 241.928091] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:17:55.199Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8af94720982f8e07da44c0c8","created_at":"2026-08-13T13:17:54.766Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-ebf60021aaaa4132","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5c6a384cbdc68ee21b57a33631860259","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:17:54.962Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8af94720982f8e07da44c0c8: done: 0.01555 sec","job_status":"done","queue_duration_s":0.221546,"scheduling_latency_s":0.221562,"redis_calls":13,"redis_duration_s":0.001424,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000527,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000897,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009445,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01555,"completed_at":"2026-08-13T13:17:55.199Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1299gitlab # [ 241.967527] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:17:55.200Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f0978e6f56cc0bd7695e50e5","created_at":"2026-08-13T13:17:54.766Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-ebf60021aaaa4132","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5c6a384cbdc68ee21b57a33631860259","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:17:54.962Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f0978e6f56cc0bd7695e50e5: start","job_status":"start","queue_duration_s":0.238147,"scheduling_latency_s":0.238162}1300gitlab # [ 241.980244] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:17:55.216Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f0978e6f56cc0bd7695e50e5","created_at":"2026-08-13T13:17:54.766Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-ebf60021aaaa4132","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5c6a384cbdc68ee21b57a33631860259","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:17:54.962Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f0978e6f56cc0bd7695e50e5: done: 0.016117 sec","job_status":"done","queue_duration_s":0.238147,"scheduling_latency_s":0.238162,"redis_calls":13,"redis_duration_s":0.001418,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00053,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000888,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011791,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016117,"completed_at":"2026-08-13T13:17:55.216Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1301gitlab # [ 242.019683] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:17:55.217Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"728c733108343323157d5653","created_at":"2026-08-13T13:17:54.766Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-ebf60021aaaa4132","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5c6a384cbdc68ee21b57a33631860259","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:17:54.962Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-728c733108343323157d5653: start","job_status":"start","queue_duration_s":0.255336,"scheduling_latency_s":0.255352}1302gitlab # [ 242.032350] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:17:55.233Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"728c733108343323157d5653","created_at":"2026-08-13T13:17:54.766Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-ebf60021aaaa4132","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5c6a384cbdc68ee21b57a33631860259","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:17:54.962Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-728c733108343323157d5653: done: 0.015725 sec","job_status":"done","queue_duration_s":0.255336,"scheduling_latency_s":0.255352,"redis_calls":13,"redis_duration_s":0.001453,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000537,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000916,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011407,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015725,"completed_at":"2026-08-13T13:17:55.233Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1303gitlab # [ 242.071389] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:17:55.234Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7d741fe4de89b7277cf6c7d1","created_at":"2026-08-13T13:17:54.766Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-ebf60021aaaa4132","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5c6a384cbdc68ee21b57a33631860259","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:17:54.962Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7d741fe4de89b7277cf6c7d1: start","job_status":"start","queue_duration_s":0.272145,"scheduling_latency_s":0.272161}1304gitlab # [ 242.083773] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:17:55.250Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7d741fe4de89b7277cf6c7d1","created_at":"2026-08-13T13:17:54.766Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-ebf60021aaaa4132","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5c6a384cbdc68ee21b57a33631860259","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:17:54.962Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7d741fe4de89b7277cf6c7d1: done: 0.01584 sec","job_status":"done","queue_duration_s":0.272145,"scheduling_latency_s":0.272161,"redis_calls":13,"redis_duration_s":0.001465,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000512,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000953,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010281,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01584,"completed_at":"2026-08-13T13:17:55.249Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1305gitlab # [ 242.124588] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:17:55.251Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cddd8698b64c0ac4dcd99178","created_at":"2026-08-13T13:17:54.766Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-ebf60021aaaa4132","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5c6a384cbdc68ee21b57a33631860259","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:17:54.962Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cddd8698b64c0ac4dcd99178: start","job_status":"start","queue_duration_s":0.289737,"scheduling_latency_s":0.289754}1306gitlab # [ 242.136952] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:17:55.266Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cddd8698b64c0ac4dcd99178","created_at":"2026-08-13T13:17:54.766Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-ebf60021aaaa4132","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5c6a384cbdc68ee21b57a33631860259","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:17:54.962Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cddd8698b64c0ac4dcd99178: done: 0.014598 sec","job_status":"done","queue_duration_s":0.289737,"scheduling_latency_s":0.289754,"redis_calls":13,"redis_duration_s":0.001448,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000538,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00091,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010232,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014598,"completed_at":"2026-08-13T13:17:55.266Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1307gitlab # [ 242.176167] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:17:55.267Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"400f00323e6c3a20b830dc52","created_at":"2026-08-13T13:17:54.766Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-ebf60021aaaa4132","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5c6a384cbdc68ee21b57a33631860259","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:17:54.962Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-400f00323e6c3a20b830dc52: start","job_status":"start","queue_duration_s":0.305417,"scheduling_latency_s":0.305432}1308gitlab # [ 242.188525] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:17:55.281Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"400f00323e6c3a20b830dc52","created_at":"2026-08-13T13:17:54.766Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-ebf60021aaaa4132","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5c6a384cbdc68ee21b57a33631860259","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:17:54.962Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-400f00323e6c3a20b830dc52: done: 0.014464 sec","job_status":"done","queue_duration_s":0.305417,"scheduling_latency_s":0.305432,"redis_calls":13,"redis_duration_s":0.0014199999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000503,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000917,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010259,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014464,"completed_at":"2026-08-13T13:17:55.281Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1309gitlab # [ 242.227767] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:17:55.283Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"52aa7b2a967dcaa71271f409","created_at":"2026-08-13T13:17:54.766Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-ebf60021aaaa4132","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5c6a384cbdc68ee21b57a33631860259","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:17:54.962Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-52aa7b2a967dcaa71271f409: start","job_status":"start","queue_duration_s":0.320962,"scheduling_latency_s":0.320977}1310gitlab # [ 242.240620] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:17:55.297Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"52aa7b2a967dcaa71271f409","created_at":"2026-08-13T13:17:54.766Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-ebf60021aaaa4132","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5c6a384cbdc68ee21b57a33631860259","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:17:54.962Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-52aa7b2a967dcaa71271f409: done: 0.014267 sec","job_status":"done","queue_duration_s":0.320962,"scheduling_latency_s":0.320977,"redis_calls":13,"redis_duration_s":0.001438,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000525,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000913,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009387,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014267,"completed_at":"2026-08-13T13:17:55.297Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1311gitlab # [ 242.279949] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:17:55.299Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2f0eaf868b1351f2f6669ce1","created_at":"2026-08-13T13:17:54.766Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-ebf60021aaaa4132","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5c6a384cbdc68ee21b57a33631860259","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:17:54.962Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2f0eaf868b1351f2f6669ce1: start","job_status":"start","queue_duration_s":0.337092,"scheduling_latency_s":0.337109}1312gitlab # [ 242.292753] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:17:55.313Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2f0eaf868b1351f2f6669ce1","created_at":"2026-08-13T13:17:54.766Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-ebf60021aaaa4132","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5c6a384cbdc68ee21b57a33631860259","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:17:54.962Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2f0eaf868b1351f2f6669ce1: done: 0.014665 sec","job_status":"done","queue_duration_s":0.337092,"scheduling_latency_s":0.337109,"redis_calls":13,"redis_duration_s":0.001469,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000546,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000923,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010367,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014665,"completed_at":"2026-08-13T13:17:55.313Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1313gitlab # [ 242.333203] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:17:55.314Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ccc242b54da2a5f3c9fad56f","created_at":"2026-08-13T13:17:54.766Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-ebf60021aaaa4132","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5c6a384cbdc68ee21b57a33631860259","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:17:54.962Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ccc242b54da2a5f3c9fad56f: start","job_status":"start","queue_duration_s":0.352869,"scheduling_latency_s":0.352885}1314gitlab # [ 242.345525] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:17:55.329Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ccc242b54da2a5f3c9fad56f","created_at":"2026-08-13T13:17:54.766Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-ebf60021aaaa4132","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5c6a384cbdc68ee21b57a33631860259","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:17:54.962Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ccc242b54da2a5f3c9fad56f: done: 0.01437 sec","job_status":"done","queue_duration_s":0.352869,"scheduling_latency_s":0.352885,"redis_calls":13,"redis_duration_s":0.0019649999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000497,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001468,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010176,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01437,"completed_at":"2026-08-13T13:17:55.329Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1315gitlab # [ 242.385028] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:17:55.330Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5e1dc19dac41f2ce39b0b410","created_at":"2026-08-13T13:17:54.766Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-ebf60021aaaa4132","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5c6a384cbdc68ee21b57a33631860259","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:17:54.962Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5e1dc19dac41f2ce39b0b410: start","job_status":"start","queue_duration_s":0.368328,"scheduling_latency_s":0.368344}1316gitlab # [ 242.397594] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:17:55.344Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5e1dc19dac41f2ce39b0b410","created_at":"2026-08-13T13:17:54.766Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-ebf60021aaaa4132","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5c6a384cbdc68ee21b57a33631860259","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:17:54.962Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5e1dc19dac41f2ce39b0b410: done: 0.014453 sec","job_status":"done","queue_duration_s":0.368328,"scheduling_latency_s":0.368344,"redis_calls":13,"redis_duration_s":0.0015890000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000678,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000911,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01011,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014453,"completed_at":"2026-08-13T13:17:55.344Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1317gitlab # [ 242.437058] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:17:55.345Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"00893c81c39a3ea0ffa352fa","created_at":"2026-08-13T13:17:54.766Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-ebf60021aaaa4132","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5c6a384cbdc68ee21b57a33631860259","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:17:54.962Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-00893c81c39a3ea0ffa352fa: start","job_status":"start","queue_duration_s":0.383828,"scheduling_latency_s":0.383843}1318gitlab # [ 242.449513] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:17:55.360Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"00893c81c39a3ea0ffa352fa","created_at":"2026-08-13T13:17:54.766Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-ebf60021aaaa4132","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5c6a384cbdc68ee21b57a33631860259","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:17:54.962Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-00893c81c39a3ea0ffa352fa: done: 0.015109 sec","job_status":"done","queue_duration_s":0.383828,"scheduling_latency_s":0.383843,"redis_calls":13,"redis_duration_s":0.001451,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000515,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000936,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009597,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015109,"completed_at":"2026-08-13T13:17:55.360Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1319gitlab # [ 242.488886] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:17:55.362Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"873ac738690e5942e77c0aef","created_at":"2026-08-13T13:17:54.766Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-ebf60021aaaa4132","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5c6a384cbdc68ee21b57a33631860259","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:17:54.962Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-873ac738690e5942e77c0aef: start","job_status":"start","queue_duration_s":0.399994,"scheduling_latency_s":0.400009}1320gitlab # [ 242.502401] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:17:55.376Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"873ac738690e5942e77c0aef","created_at":"2026-08-13T13:17:54.766Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-ebf60021aaaa4132","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5c6a384cbdc68ee21b57a33631860259","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:17:54.962Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-873ac738690e5942e77c0aef: done: 0.014155 sec","job_status":"done","queue_duration_s":0.399994,"scheduling_latency_s":0.400009,"redis_calls":13,"redis_duration_s":0.0014320000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000539,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000893,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009955,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014155,"completed_at":"2026-08-13T13:17:55.376Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1321gitlab # [ 242.542218] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:17:55.377Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a01a6149eed76b2472804032","created_at":"2026-08-13T13:17:54.766Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-ebf60021aaaa4132","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5c6a384cbdc68ee21b57a33631860259","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:17:54.962Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a01a6149eed76b2472804032: start","job_status":"start","queue_duration_s":0.415209,"scheduling_latency_s":0.415223}1322gitlab # [ 242.554540] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:17:55.391Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a01a6149eed76b2472804032","created_at":"2026-08-13T13:17:54.766Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-ebf60021aaaa4132","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5c6a384cbdc68ee21b57a33631860259","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:17:54.962Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a01a6149eed76b2472804032: done: 0.014164 sec","job_status":"done","queue_duration_s":0.415209,"scheduling_latency_s":0.415223,"redis_calls":13,"redis_duration_s":0.0013800000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000495,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000885,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009949,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014164,"completed_at":"2026-08-13T13:17:55.391Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1323gitlab # [ 242.594104] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:17:55.392Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0758619be952ec73dee6200a","created_at":"2026-08-13T13:17:54.766Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-ebf60021aaaa4132","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5c6a384cbdc68ee21b57a33631860259","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:17:54.962Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0758619be952ec73dee6200a: start","job_status":"start","queue_duration_s":0.430441,"scheduling_latency_s":0.430456}1324gitlab # [ 242.607152] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:17:55.406Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0758619be952ec73dee6200a","created_at":"2026-08-13T13:17:54.766Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-ebf60021aaaa4132","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5c6a384cbdc68ee21b57a33631860259","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:17:54.962Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0758619be952ec73dee6200a: done: 0.013833 sec","job_status":"done","queue_duration_s":0.430441,"scheduling_latency_s":0.430456,"redis_calls":13,"redis_duration_s":0.001387,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000502,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000885,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009354,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013833,"completed_at":"2026-08-13T13:17:55.406Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1325gitlab # [ 242.646965] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:17:55.407Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fa77a7766201180f07039ab6","created_at":"2026-08-13T13:17:54.766Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-ebf60021aaaa4132","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5c6a384cbdc68ee21b57a33631860259","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:17:54.962Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fa77a7766201180f07039ab6: start","job_status":"start","queue_duration_s":0.445572,"scheduling_latency_s":0.445588}1326gitlab # [ 242.659623] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:17:55.421Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fa77a7766201180f07039ab6","created_at":"2026-08-13T13:17:54.766Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-ebf60021aaaa4132","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5c6a384cbdc68ee21b57a33631860259","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:17:54.962Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fa77a7766201180f07039ab6: done: 0.014094 sec","job_status":"done","queue_duration_s":0.445572,"scheduling_latency_s":0.445588,"redis_calls":13,"redis_duration_s":0.001512,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000523,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000989,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009734,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014094,"completed_at":"2026-08-13T13:17:55.421Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1327gitlab # [ 242.698953] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:17:55.422Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fb6c57635267f80126e17d43","created_at":"2026-08-13T13:17:54.766Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-ebf60021aaaa4132","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5c6a384cbdc68ee21b57a33631860259","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:17:54.962Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fb6c57635267f80126e17d43: start","job_status":"start","queue_duration_s":0.460775,"scheduling_latency_s":0.460791}1328gitlab # [ 242.712592] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:17:55.436Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fb6c57635267f80126e17d43","created_at":"2026-08-13T13:17:54.766Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-ebf60021aaaa4132","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5c6a384cbdc68ee21b57a33631860259","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:17:54.962Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fb6c57635267f80126e17d43: done: 0.013879 sec","job_status":"done","queue_duration_s":0.460775,"scheduling_latency_s":0.460791,"redis_calls":13,"redis_duration_s":0.001386,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00049,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000896,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009741,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013879,"completed_at":"2026-08-13T13:17:55.436Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1329gitlab # [ 242.751751] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:17:55.437Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"af110e23f84bd1957588e555","created_at":"2026-08-13T13:17:54.766Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-ebf60021aaaa4132","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5c6a384cbdc68ee21b57a33631860259","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:17:54.962Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-af110e23f84bd1957588e555: start","job_status":"start","queue_duration_s":0.475697,"scheduling_latency_s":0.475711}1330gitlab # [ 242.764760] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:17:55.452Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"af110e23f84bd1957588e555","created_at":"2026-08-13T13:17:54.766Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-ebf60021aaaa4132","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5c6a384cbdc68ee21b57a33631860259","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:17:54.962Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-af110e23f84bd1957588e555: done: 0.015054 sec","job_status":"done","queue_duration_s":0.475697,"scheduling_latency_s":0.475711,"redis_calls":13,"redis_duration_s":0.002225,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001268,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000957,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010088,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015054,"completed_at":"2026-08-13T13:17:55.452Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1331gitlab # [ 242.804176] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:17:55.454Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d2cc73d365b6aad32583549c","created_at":"2026-08-13T13:17:54.766Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-ebf60021aaaa4132","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5c6a384cbdc68ee21b57a33631860259","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:17:54.962Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d2cc73d365b6aad32583549c: start","job_status":"start","queue_duration_s":0.492151,"scheduling_latency_s":0.492167}1332gitlab # [ 242.816380] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:17:55.468Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d2cc73d365b6aad32583549c","created_at":"2026-08-13T13:17:54.766Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-ebf60021aaaa4132","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5c6a384cbdc68ee21b57a33631860259","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:17:54.962Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d2cc73d365b6aad32583549c: done: 0.014195 sec","job_status":"done","queue_duration_s":0.492151,"scheduling_latency_s":0.492167,"redis_calls":13,"redis_duration_s":0.001433,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000513,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00092,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009867,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014195,"completed_at":"2026-08-13T13:17:55.468Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1333gitlab # [ 242.855356] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:17:55.469Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bf9c0d85bcd058d8efa947b6","created_at":"2026-08-13T13:17:54.766Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-ebf60021aaaa4132","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5c6a384cbdc68ee21b57a33631860259","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:17:54.962Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bf9c0d85bcd058d8efa947b6: start","job_status":"start","queue_duration_s":0.507361,"scheduling_latency_s":0.507375}1334gitlab # [ 242.867815] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:17:55.483Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bf9c0d85bcd058d8efa947b6","created_at":"2026-08-13T13:17:54.766Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-ebf60021aaaa4132","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5c6a384cbdc68ee21b57a33631860259","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:17:54.962Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bf9c0d85bcd058d8efa947b6: done: 0.014027 sec","job_status":"done","queue_duration_s":0.507361,"scheduling_latency_s":0.507375,"redis_calls":13,"redis_duration_s":0.001447,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000527,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00092,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009774,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014027,"completed_at":"2026-08-13T13:17:55.483Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1335gitlab # [ 242.907175] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:17:55.484Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"20cbfcccbfd958b8942eb6e2","created_at":"2026-08-13T13:17:54.766Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-ebf60021aaaa4132","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5c6a384cbdc68ee21b57a33631860259","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:17:54.962Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-20cbfcccbfd958b8942eb6e2: start","job_status":"start","queue_duration_s":0.522445,"scheduling_latency_s":0.522462}1336gitlab # [ 242.920643] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:17:55.498Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"20cbfcccbfd958b8942eb6e2","created_at":"2026-08-13T13:17:54.766Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-ebf60021aaaa4132","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5c6a384cbdc68ee21b57a33631860259","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:17:54.962Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-20cbfcccbfd958b8942eb6e2: done: 0.014045 sec","job_status":"done","queue_duration_s":0.522445,"scheduling_latency_s":0.522462,"redis_calls":13,"redis_duration_s":0.0014160000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000506,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00091,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009787,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014045,"completed_at":"2026-08-13T13:17:55.498Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1337gitlab # [ 242.959934] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:17:55.499Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"39410f97f7351f0a5b6f5deb","created_at":"2026-08-13T13:17:54.766Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-ebf60021aaaa4132","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5c6a384cbdc68ee21b57a33631860259","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:17:54.962Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-39410f97f7351f0a5b6f5deb: start","job_status":"start","queue_duration_s":0.537651,"scheduling_latency_s":0.537666}1338gitlab # [ 242.972581] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:17:55.513Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"39410f97f7351f0a5b6f5deb","created_at":"2026-08-13T13:17:54.766Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-ebf60021aaaa4132","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5c6a384cbdc68ee21b57a33631860259","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:17:54.962Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-39410f97f7351f0a5b6f5deb: done: 0.013969 sec","job_status":"done","queue_duration_s":0.537651,"scheduling_latency_s":0.537666,"redis_calls":13,"redis_duration_s":0.0013779999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000496,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000882,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009412,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013969,"completed_at":"2026-08-13T13:17:55.513Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1339gitlab # [ 243.011653] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:17:55.515Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8dc42077efc5c5fa0c802723","created_at":"2026-08-13T13:17:54.766Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-ebf60021aaaa4132","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5c6a384cbdc68ee21b57a33631860259","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:17:54.962Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8dc42077efc5c5fa0c802723: start","job_status":"start","queue_duration_s":0.552991,"scheduling_latency_s":0.553008}1340gitlab # [ 243.024846] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:17:55.529Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8dc42077efc5c5fa0c802723","created_at":"2026-08-13T13:17:54.766Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-ebf60021aaaa4132","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5c6a384cbdc68ee21b57a33631860259","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:17:54.962Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8dc42077efc5c5fa0c802723: done: 0.014181 sec","job_status":"done","queue_duration_s":0.552991,"scheduling_latency_s":0.553008,"redis_calls":13,"redis_duration_s":0.001457,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000517,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00094,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009958,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014181,"completed_at":"2026-08-13T13:17:55.529Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1341gitlab # [ 243.063818] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:17:55.530Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bd5986c7cab243d5a453a8ee","created_at":"2026-08-13T13:17:54.766Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-ebf60021aaaa4132","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5c6a384cbdc68ee21b57a33631860259","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:17:54.962Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bd5986c7cab243d5a453a8ee: start","job_status":"start","queue_duration_s":0.568259,"scheduling_latency_s":0.568275}1342gitlab # [ 243.076436] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:17:55.545Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bd5986c7cab243d5a453a8ee","created_at":"2026-08-13T13:17:54.766Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-ebf60021aaaa4132","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5c6a384cbdc68ee21b57a33631860259","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:17:54.962Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bd5986c7cab243d5a453a8ee: done: 0.014775 sec","job_status":"done","queue_duration_s":0.568259,"scheduling_latency_s":0.568275,"redis_calls":13,"redis_duration_s":0.0014629999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000528,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000935,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010186,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014775,"completed_at":"2026-08-13T13:17:55.545Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1343gitlab # [ 243.116532] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:17:55.546Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"23d18dc3024dd4967bbb0849","created_at":"2026-08-13T13:17:54.766Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-ebf60021aaaa4132","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5c6a384cbdc68ee21b57a33631860259","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:17:54.962Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-23d18dc3024dd4967bbb0849: start","job_status":"start","queue_duration_s":0.584136,"scheduling_latency_s":0.58415}1344gitlab # [ 243.128855] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:17:55.559Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"23d18dc3024dd4967bbb0849","created_at":"2026-08-13T13:17:54.766Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-ebf60021aaaa4132","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5c6a384cbdc68ee21b57a33631860259","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:17:54.962Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-23d18dc3024dd4967bbb0849: done: 0.013689 sec","job_status":"done","queue_duration_s":0.584136,"scheduling_latency_s":0.58415,"redis_calls":13,"redis_duration_s":0.0014,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000517,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000883,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009497,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013689,"completed_at":"2026-08-13T13:17:55.559Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1345gitlab # [ 243.167814] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:17:55.560Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e924f2faf9ad59ad0d06ecb2","created_at":"2026-08-13T13:17:54.766Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-ebf60021aaaa4132","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5c6a384cbdc68ee21b57a33631860259","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:17:54.962Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e924f2faf9ad59ad0d06ecb2: start","job_status":"start","queue_duration_s":0.598902,"scheduling_latency_s":0.598918}1346gitlab # [ 243.180441] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:17:55.574Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e924f2faf9ad59ad0d06ecb2","created_at":"2026-08-13T13:17:54.766Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-ebf60021aaaa4132","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5c6a384cbdc68ee21b57a33631860259","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:17:54.962Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e924f2faf9ad59ad0d06ecb2: done: 0.013905 sec","job_status":"done","queue_duration_s":0.598902,"scheduling_latency_s":0.598918,"redis_calls":13,"redis_duration_s":0.0014039999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000526,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000878,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00945,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013905,"completed_at":"2026-08-13T13:17:55.574Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1347gitlab # [ 243.219507] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:17:55.576Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"208d598606ec0870d001a731","created_at":"2026-08-13T13:17:54.766Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-ebf60021aaaa4132","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5c6a384cbdc68ee21b57a33631860259","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:17:54.962Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-208d598606ec0870d001a731: start","job_status":"start","queue_duration_s":0.614163,"scheduling_latency_s":0.614179}1348gitlab # [ 243.232129] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:17:55.590Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"208d598606ec0870d001a731","created_at":"2026-08-13T13:17:54.766Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-ebf60021aaaa4132","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5c6a384cbdc68ee21b57a33631860259","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:17:54.962Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-208d598606ec0870d001a731: done: 0.014344 sec","job_status":"done","queue_duration_s":0.614163,"scheduling_latency_s":0.614179,"redis_calls":13,"redis_duration_s":0.001474,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000534,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00094,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01002,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014344,"completed_at":"2026-08-13T13:17:55.590Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1349gitlab # [ 243.271125] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:17:55.591Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8ac57b6cd28ee1211a58e189","created_at":"2026-08-13T13:17:54.766Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-ebf60021aaaa4132","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5c6a384cbdc68ee21b57a33631860259","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:17:54.962Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8ac57b6cd28ee1211a58e189: start","job_status":"start","queue_duration_s":0.629615,"scheduling_latency_s":0.62963}1350gitlab # [ 243.283748] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:17:55.605Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8ac57b6cd28ee1211a58e189","created_at":"2026-08-13T13:17:54.766Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-ebf60021aaaa4132","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5c6a384cbdc68ee21b57a33631860259","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:17:54.962Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8ac57b6cd28ee1211a58e189: done: 0.014087 sec","job_status":"done","queue_duration_s":0.629615,"scheduling_latency_s":0.62963,"redis_calls":13,"redis_duration_s":0.001412,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.0005,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000912,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009868,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014087,"completed_at":"2026-08-13T13:17:55.605Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1351gitlab # [ 243.324069] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:17:55.606Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5a52838e651dec100c294c58","created_at":"2026-08-13T13:17:54.766Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-ebf60021aaaa4132","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5c6a384cbdc68ee21b57a33631860259","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:17:54.962Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5a52838e651dec100c294c58: start","job_status":"start","queue_duration_s":0.644798,"scheduling_latency_s":0.644813}1352gitlab # [ 243.336447] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:17:55.621Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5a52838e651dec100c294c58","created_at":"2026-08-13T13:17:54.766Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-ebf60021aaaa4132","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5c6a384cbdc68ee21b57a33631860259","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:17:54.962Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5a52838e651dec100c294c58: done: 0.014273 sec","job_status":"done","queue_duration_s":0.644798,"scheduling_latency_s":0.644813,"redis_calls":13,"redis_duration_s":0.001516,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000594,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000922,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009989,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014273,"completed_at":"2026-08-13T13:17:55.621Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1353gitlab # [ 243.375818] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:17:55.622Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bcdeebb7089671a8851db4b7","created_at":"2026-08-13T13:17:54.766Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-ebf60021aaaa4132","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5c6a384cbdc68ee21b57a33631860259","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:17:54.962Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bcdeebb7089671a8851db4b7: start","job_status":"start","queue_duration_s":0.660627,"scheduling_latency_s":0.660644}1354gitlab # [ 243.388879] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:17:55.636Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bcdeebb7089671a8851db4b7","created_at":"2026-08-13T13:17:54.766Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-ebf60021aaaa4132","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5c6a384cbdc68ee21b57a33631860259","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:17:54.962Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bcdeebb7089671a8851db4b7: done: 0.01429 sec","job_status":"done","queue_duration_s":0.660627,"scheduling_latency_s":0.660644,"redis_calls":13,"redis_duration_s":0.00147,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000511,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000959,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010022,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01429,"completed_at":"2026-08-13T13:17:55.636Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1355gitlab # [ 243.428324] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:17:55.638Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6bcc2bdbea76bec7435eaab5","created_at":"2026-08-13T13:17:54.766Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-ebf60021aaaa4132","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5c6a384cbdc68ee21b57a33631860259","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:17:54.962Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6bcc2bdbea76bec7435eaab5: start","job_status":"start","queue_duration_s":0.676033,"scheduling_latency_s":0.676048}1356gitlab # [ 243.440645] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:17:55.652Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6bcc2bdbea76bec7435eaab5","created_at":"2026-08-13T13:17:54.766Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-ebf60021aaaa4132","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5c6a384cbdc68ee21b57a33631860259","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:17:54.962Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6bcc2bdbea76bec7435eaab5: done: 0.014583 sec","job_status":"done","queue_duration_s":0.676033,"scheduling_latency_s":0.676048,"redis_calls":13,"redis_duration_s":0.001436,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000532,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000904,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010089,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014583,"completed_at":"2026-08-13T13:17:55.652Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1357gitlab # [ 243.479817] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:17:55.653Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d101509d24c3253614796906","created_at":"2026-08-13T13:17:54.766Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-ebf60021aaaa4132","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5c6a384cbdc68ee21b57a33631860259","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:17:54.962Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d101509d24c3253614796906: start","job_status":"start","queue_duration_s":0.691721,"scheduling_latency_s":0.691736}1358gitlab # [ 243.492228] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:17:55.667Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d101509d24c3253614796906","created_at":"2026-08-13T13:17:54.766Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-ebf60021aaaa4132","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5c6a384cbdc68ee21b57a33631860259","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:17:54.962Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d101509d24c3253614796906: done: 0.013862 sec","job_status":"done","queue_duration_s":0.691721,"scheduling_latency_s":0.691736,"redis_calls":13,"redis_duration_s":0.0014060000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000505,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000901,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009625,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013862,"completed_at":"2026-08-13T13:17:55.667Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1359gitlab # [ 243.532514] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:17:55.668Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a8b752395cdd4cb294ef1e47","created_at":"2026-08-13T13:17:54.766Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-ebf60021aaaa4132","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5c6a384cbdc68ee21b57a33631860259","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:17:54.962Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a8b752395cdd4cb294ef1e47: start","job_status":"start","queue_duration_s":0.706671,"scheduling_latency_s":0.706686}1360gitlab # [ 243.544913] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:17:55.682Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a8b752395cdd4cb294ef1e47","created_at":"2026-08-13T13:17:54.766Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-ebf60021aaaa4132","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5c6a384cbdc68ee21b57a33631860259","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:17:54.962Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a8b752395cdd4cb294ef1e47: done: 0.014148 sec","job_status":"done","queue_duration_s":0.706671,"scheduling_latency_s":0.706686,"redis_calls":13,"redis_duration_s":0.001402,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000506,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000896,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009441,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014148,"completed_at":"2026-08-13T13:17:55.682Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1361gitlab # [ 243.584045] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:17:55.684Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"20c4f3130b46f0fb02a5930d","created_at":"2026-08-13T13:17:54.766Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-ebf60021aaaa4132","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5c6a384cbdc68ee21b57a33631860259","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:17:54.962Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-20c4f3130b46f0fb02a5930d: start","job_status":"start","queue_duration_s":0.721981,"scheduling_latency_s":0.721996}1362gitlab # [ 243.596340] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:17:55.698Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"20c4f3130b46f0fb02a5930d","created_at":"2026-08-13T13:17:54.766Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-ebf60021aaaa4132","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5c6a384cbdc68ee21b57a33631860259","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:17:54.962Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-20c4f3130b46f0fb02a5930d: done: 0.014146 sec","job_status":"done","queue_duration_s":0.721981,"scheduling_latency_s":0.721996,"redis_calls":13,"redis_duration_s":0.001436,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00053,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000906,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00982,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014146,"completed_at":"2026-08-13T13:17:55.698Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1363gitlab # [ 243.635668] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:17:55.699Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a66038c2b50fc7f09b34104c","created_at":"2026-08-13T13:17:54.766Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-ebf60021aaaa4132","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5c6a384cbdc68ee21b57a33631860259","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:17:54.962Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a66038c2b50fc7f09b34104c: start","job_status":"start","queue_duration_s":0.737245,"scheduling_latency_s":0.737261}1364gitlab # [ 243.648377] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:17:55.713Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a66038c2b50fc7f09b34104c","created_at":"2026-08-13T13:17:54.766Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-ebf60021aaaa4132","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5c6a384cbdc68ee21b57a33631860259","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:17:54.962Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a66038c2b50fc7f09b34104c: done: 0.014078 sec","job_status":"done","queue_duration_s":0.737245,"scheduling_latency_s":0.737261,"redis_calls":13,"redis_duration_s":0.001577,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000698,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000879,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00978,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014078,"completed_at":"2026-08-13T13:17:55.713Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1365gitlab # [ 243.687466] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:17:55.714Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"74f4ed0e2230a2dd9dec68c3","created_at":"2026-08-13T13:17:54.766Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-ebf60021aaaa4132","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5c6a384cbdc68ee21b57a33631860259","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:17:54.962Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-74f4ed0e2230a2dd9dec68c3: start","job_status":"start","queue_duration_s":0.752408,"scheduling_latency_s":0.752424}1366gitlab # [ 243.699843] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:17:55.729Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"74f4ed0e2230a2dd9dec68c3","created_at":"2026-08-13T13:17:54.766Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-ebf60021aaaa4132","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5c6a384cbdc68ee21b57a33631860259","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:17:54.962Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-74f4ed0e2230a2dd9dec68c3: done: 0.014743 sec","job_status":"done","queue_duration_s":0.752408,"scheduling_latency_s":0.752424,"redis_calls":13,"redis_duration_s":0.001415,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000508,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000907,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010169,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014743,"completed_at":"2026-08-13T13:17:55.729Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1367gitlab # [ 243.740548] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:17:55.730Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b851002d0ef1c6cd0dc3d9e1","created_at":"2026-08-13T13:17:54.766Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-ebf60021aaaa4132","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5c6a384cbdc68ee21b57a33631860259","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:17:54.962Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b851002d0ef1c6cd0dc3d9e1: start","job_status":"start","queue_duration_s":0.768313,"scheduling_latency_s":0.768331}1368gitlab # [ 243.752590] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:17:55.745Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b851002d0ef1c6cd0dc3d9e1","created_at":"2026-08-13T13:17:54.766Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-ebf60021aaaa4132","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5c6a384cbdc68ee21b57a33631860259","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:17:54.962Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b851002d0ef1c6cd0dc3d9e1: done: 0.014943 sec","job_status":"done","queue_duration_s":0.768313,"scheduling_latency_s":0.768331,"redis_calls":13,"redis_duration_s":0.001509,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000538,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000971,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01038,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014943,"completed_at":"2026-08-13T13:17:55.745Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1369gitlab # [ 243.792389] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:17:55.746Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9533431061e6aeda49e147b5","created_at":"2026-08-13T13:17:54.766Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-ebf60021aaaa4132","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5c6a384cbdc68ee21b57a33631860259","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:17:54.962Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9533431061e6aeda49e147b5: start","job_status":"start","queue_duration_s":0.784815,"scheduling_latency_s":0.784832}1370gitlab # [ 243.804960] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:17:55.762Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9533431061e6aeda49e147b5","created_at":"2026-08-13T13:17:54.766Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-ebf60021aaaa4132","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5c6a384cbdc68ee21b57a33631860259","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:17:54.962Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9533431061e6aeda49e147b5: done: 0.015379 sec","job_status":"done","queue_duration_s":0.784815,"scheduling_latency_s":0.784832,"redis_calls":13,"redis_duration_s":0.0017790000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000555,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001224,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010797,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015379,"completed_at":"2026-08-13T13:17:55.762Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1371gitlab # [ 243.844607] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:17:55.763Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9e053a61e9660c202ed4d7c0","created_at":"2026-08-13T13:17:54.766Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-ebf60021aaaa4132","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5c6a384cbdc68ee21b57a33631860259","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:17:54.962Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9e053a61e9660c202ed4d7c0: start","job_status":"start","queue_duration_s":0.801562,"scheduling_latency_s":0.801581}1372gitlab # [ 243.857036] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:17:55.778Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9e053a61e9660c202ed4d7c0","created_at":"2026-08-13T13:17:54.766Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-ebf60021aaaa4132","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5c6a384cbdc68ee21b57a33631860259","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:17:54.962Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9e053a61e9660c202ed4d7c0: done: 0.014529 sec","job_status":"done","queue_duration_s":0.801562,"scheduling_latency_s":0.801581,"redis_calls":13,"redis_duration_s":0.001586,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000575,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001011,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010064,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014529,"completed_at":"2026-08-13T13:17:55.778Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1373gitlab # [ 243.896442] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:17:55.779Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f39cbffa9e99be110103e5b7","created_at":"2026-08-13T13:17:54.766Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-ebf60021aaaa4132","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5c6a384cbdc68ee21b57a33631860259","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:17:54.962Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f39cbffa9e99be110103e5b7: start","job_status":"start","queue_duration_s":0.817205,"scheduling_latency_s":0.817221}1374gitlab # [ 243.908854] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:17:55.793Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f39cbffa9e99be110103e5b7","created_at":"2026-08-13T13:17:54.766Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-ebf60021aaaa4132","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5c6a384cbdc68ee21b57a33631860259","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:17:54.962Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f39cbffa9e99be110103e5b7: done: 0.013959 sec","job_status":"done","queue_duration_s":0.817205,"scheduling_latency_s":0.817221,"redis_calls":13,"redis_duration_s":0.0013939999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000502,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000892,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00949,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013959,"completed_at":"2026-08-13T13:17:55.793Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1375gitlab # [ 243.949237] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:17:55.794Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"db4c8654d5af92bbc7eea8a2","created_at":"2026-08-13T13:17:54.766Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-ebf60021aaaa4132","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5c6a384cbdc68ee21b57a33631860259","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:17:54.962Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-db4c8654d5af92bbc7eea8a2: start","job_status":"start","queue_duration_s":0.832516,"scheduling_latency_s":0.832549}1376gitlab # [ 243.961546] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:17:55.809Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"db4c8654d5af92bbc7eea8a2","created_at":"2026-08-13T13:17:54.766Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-ebf60021aaaa4132","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5c6a384cbdc68ee21b57a33631860259","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:17:54.962Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-db4c8654d5af92bbc7eea8a2: done: 0.014602 sec","job_status":"done","queue_duration_s":0.832516,"scheduling_latency_s":0.832549,"redis_calls":13,"redis_duration_s":0.001406,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000511,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000895,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009838,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014602,"completed_at":"2026-08-13T13:17:55.809Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1377gitlab # [ 244.000818] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:17:55.810Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8784e228665600900984cead","created_at":"2026-08-13T13:17:54.766Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-ebf60021aaaa4132","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5c6a384cbdc68ee21b57a33631860259","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:17:54.962Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8784e228665600900984cead: start","job_status":"start","queue_duration_s":0.848215,"scheduling_latency_s":0.848232}1378gitlab # [ 244.012998] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:17:55.826Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8784e228665600900984cead","created_at":"2026-08-13T13:17:54.766Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-ebf60021aaaa4132","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5c6a384cbdc68ee21b57a33631860259","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:17:54.962Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8784e228665600900984cead: done: 0.015427 sec","job_status":"done","queue_duration_s":0.848215,"scheduling_latency_s":0.848232,"redis_calls":13,"redis_duration_s":0.001482,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000544,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000938,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010706,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015427,"completed_at":"2026-08-13T13:17:55.826Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1379gitlab # [ 244.052076] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:17:55.827Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f4ba87d84719ba23aab5d80c","created_at":"2026-08-13T13:17:54.766Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-ebf60021aaaa4132","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5c6a384cbdc68ee21b57a33631860259","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:17:54.962Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f4ba87d84719ba23aab5d80c: start","job_status":"start","queue_duration_s":0.865162,"scheduling_latency_s":0.865177}1380gitlab # [ 244.064235] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:17:56.055Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f4ba87d84719ba23aab5d80c","created_at":"2026-08-13T13:17:54.766Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-ebf60021aaaa4132","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5c6a384cbdc68ee21b57a33631860259","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:17:54.962Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f4ba87d84719ba23aab5d80c: done: 0.228322 sec","job_status":"done","queue_duration_s":0.865162,"scheduling_latency_s":0.865177,"redis_calls":13,"redis_duration_s":0.189668,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001137,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.188531,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024907,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.228322,"completed_at":"2026-08-13T13:17:56.055Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1381gitlab # [ 244.103124] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:17:56.058Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6135431f10ae80c27251eb17","created_at":"2026-08-13T13:17:54.766Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-ebf60021aaaa4132","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5c6a384cbdc68ee21b57a33631860259","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:17:54.962Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6135431f10ae80c27251eb17: start","job_status":"start","queue_duration_s":1.096527,"scheduling_latency_s":1.096624}1382gitlab # [ 244.115333] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:17:56.093Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6135431f10ae80c27251eb17","created_at":"2026-08-13T13:17:54.766Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-ebf60021aaaa4132","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5c6a384cbdc68ee21b57a33631860259","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:17:54.962Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6135431f10ae80c27251eb17: done: 0.035235 sec","job_status":"done","queue_duration_s":1.096527,"scheduling_latency_s":1.096624,"redis_calls":13,"redis_duration_s":0.003546,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001294,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002252,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024289,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.035235,"completed_at":"2026-08-13T13:17:56.093Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1383gitlab # [ 247.359379] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:18:01.183Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"169aab6ae08b60d8c2c4deb2","created_at":"2026-08-13T13:18:01.163Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-20120ecbeb694008","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fcb192210230313aff7139ae86cc1bd0","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-13T13:18:01.180Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-169aab6ae08b60d8c2c4deb2: start","job_status":"start","queue_duration_s":0.003342,"scheduling_latency_s":0.003408}1384gitlab # [ 247.643767] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:18:01.467Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"169aab6ae08b60d8c2c4deb2","created_at":"2026-08-13T13:18:01.163Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-20120ecbeb694008","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fcb192210230313aff7139ae86cc1bd0","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-13T13:18:01.180Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-169aab6ae08b60d8c2c4deb2: done: 0.283112 sec","job_status":"done","queue_duration_s":0.003342,"scheduling_latency_s":0.003408,"redis_calls":7,"redis_duration_s":0.044424,"redis_read_bytes":5,"redis_write_bytes":681,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.024453,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":473,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.019971,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":208,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.107,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.107,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.056801,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.283112,"completed_at":"2026-08-13T13:18:01.466Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.107003,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1385gitlab # [ 247.729056] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:18:01.499Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"3f8c83f5b09b21a03416a599","created_at":"2026-08-13T13:18:01.215Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-20120ecbeb694008","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"228680302e3fc481bdfaeccf9310f954","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-13T13:18:01.231Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-3f8c83f5b09b21a03416a599: start","job_status":"start","queue_duration_s":0.267917,"scheduling_latency_s":0.267979}1386gitlab # [ 250.939143] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:18:04.763Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"3f8c83f5b09b21a03416a599","created_at":"2026-08-13T13:18:01.215Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-20120ecbeb694008","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"228680302e3fc481bdfaeccf9310f954","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-13T13:18:01.231Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-3f8c83f5b09b21a03416a599: done: 3.263362 sec","job_status":"done","queue_duration_s":0.267917,"scheduling_latency_s":0.267979,"redis_calls":562,"redis_duration_s":1.874092,"redis_read_bytes":560,"redis_write_bytes":48760,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.023789,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":470,"redis_shared_state_calls":557,"redis_shared_state_duration_s":1.850303,"redis_shared_state_read_bytes":556,"redis_shared_state_write_bytes":48290,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":1.389713,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":3.263362,"completed_at":"2026-08-13T13:18:04.762Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1387gitlab # [ 251.033584] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:18:04.767Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"406782a55fdfa85eb616a77f","created_at":"2026-08-13T13:18:01.335Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-20120ecbeb694008","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f8655290f2dea448178cddef9ef42f78","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-08-13T13:18:01.421Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-406782a55fdfa85eb616a77f: start","job_status":"start","queue_duration_s":3.345845,"scheduling_latency_s":3.345878}1388gitlab # [ 251.033758] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:18:04.797Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"406782a55fdfa85eb616a77f","created_at":"2026-08-13T13:18:01.335Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-20120ecbeb694008","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f8655290f2dea448178cddef9ef42f78","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-08-13T13:18:01.421Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-406782a55fdfa85eb616a77f: done: 0.030089 sec","job_status":"done","queue_duration_s":3.345845,"scheduling_latency_s":3.345878,"redis_calls":12,"redis_duration_s":0.003265,"redis_read_bytes":11,"redis_write_bytes":1562,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00056,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001412,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":634,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001293,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":591,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016355,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00065866,"exclusive_lock_hold_duration_s":0.0077547,"duration_s":0.030089,"completed_at":"2026-08-13T13:18:04.797Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004985,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1389gitlab # [ 251.745709] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:18:04.799Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"0539d937a21ecf797e8c1bef","created_at":"2026-08-13T13:18:01.448Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-20120ecbeb694008","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1cb0d7d9685de02566be81ef1c0c82b2","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-13T13:18:01.482Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-0539d937a21ecf797e8c1bef: start","job_status":"start","queue_duration_s":3.316837,"scheduling_latency_s":3.316855}1390gitlab # [ 251.745834] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:18:05.048Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"0539d937a21ecf797e8c1bef","created_at":"2026-08-13T13:18:01.448Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-20120ecbeb694008","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1cb0d7d9685de02566be81ef1c0c82b2","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-13T13:18:01.482Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-0539d937a21ecf797e8c1bef: done: 0.24941 sec","job_status":"done","queue_duration_s":3.316837,"scheduling_latency_s":3.316855,"redis_calls":11,"redis_duration_s":0.003046,"redis_read_bytes":9,"redis_write_bytes":1262,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000511,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":275,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001279,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":476,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001256,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":511,"db_count":130,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":130,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.051,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":130,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":84,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.051,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.182689,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00056618,"exclusive_lock_hold_duration_s":0.2296948,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"main","turbo_mode":false},"duration_s":0.24941,"completed_at":"2026-08-13T13:18:05.048Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.076869,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1391gitlab # [ 252.462353] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:18:05.050Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"f74a6220fe3f933094922778","created_at":"2026-08-13T13:18:01.523Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-20120ecbeb694008","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c100c08a29597d2246765b255a6f9643","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-13T13:18:01.545Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-f74a6220fe3f933094922778: start","job_status":"start","queue_duration_s":3.505338,"scheduling_latency_s":3.505357}1392gitlab # [ 252.462512] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:18:05.093Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"f74a6220fe3f933094922778","created_at":"2026-08-13T13:18:01.523Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-20120ecbeb694008","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c100c08a29597d2246765b255a6f9643","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-13T13:18:01.545Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-f74a6220fe3f933094922778: done: 0.043223 sec","job_status":"done","queue_duration_s":3.505338,"scheduling_latency_s":3.505357,"redis_calls":9,"redis_duration_s":0.002445,"redis_read_bytes":7,"redis_write_bytes":1162,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001257,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":551,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001188,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":611,"db_count":6,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.017,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.017,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019236,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00057054,"exclusive_lock_hold_duration_s":0.02781696,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.043223,"completed_at":"2026-08-13T13:18:05.093Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.019264,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1393gitlab # [ 253.184457] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:18:05.095Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"7492141e9b1ba68e8d621fcc","created_at":"2026-08-13T13:18:01.605Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-20120ecbeb694008","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"105c69008813f0c5370c8a82f376cf32","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-13T13:18:01.615Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-7492141e9b1ba68e8d621fcc: start","job_status":"start","queue_duration_s":3.479551,"scheduling_latency_s":3.479816}1394gitlab # [ 253.832992] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:18:05.118Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"7492141e9b1ba68e8d621fcc","created_at":"2026-08-13T13:18:01.605Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-20120ecbeb694008","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"105c69008813f0c5370c8a82f376cf32","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-13T13:18:01.615Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-7492141e9b1ba68e8d621fcc: done: 0.022972 sec","job_status":"done","queue_duration_s":3.479551,"scheduling_latency_s":3.479816,"redis_calls":7,"redis_duration_s":0.001824,"redis_read_bytes":5,"redis_write_bytes":711,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001324,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":491,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.0005,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":220,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011503,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.022972,"completed_at":"2026-08-13T13:18:05.118Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005998,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1395gitlab # [ 254.532742] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:18:05.120Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"3251dcfd221c109dd0e0af71","created_at":"2026-08-13T13:18:01.704Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-20120ecbeb694008","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"42e423ee51938d63cac802e43691118d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-13T13:18:01.718Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-3251dcfd221c109dd0e0af71: start","job_status":"start","queue_duration_s":3.401094,"scheduling_latency_s":3.401111}1396gitlab # [ 254.576791] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:18:05.133Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"3251dcfd221c109dd0e0af71","created_at":"2026-08-13T13:18:01.704Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-20120ecbeb694008","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"42e423ee51938d63cac802e43691118d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-13T13:18:01.718Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-3251dcfd221c109dd0e0af71: done: 0.013975 sec","job_status":"done","queue_duration_s":3.401094,"scheduling_latency_s":3.401111,"redis_calls":7,"redis_duration_s":0.001696,"redis_read_bytes":5,"redis_write_bytes":776,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001225,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000471,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":246,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00862,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013975,"completed_at":"2026-08-13T13:18:05.133Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1397gitlab # [ 254.648520] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:18:05.135Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"7bff7066d4502a7937552c0e","created_at":"2026-08-13T13:18:01.938Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-20120ecbeb694008","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5a94c19437300c648b8f681b5b375dcf","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-13T13:18:01.990Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-7bff7066d4502a7937552c0e: start","job_status":"start","queue_duration_s":3.145352,"scheduling_latency_s":3.145368}1398gitlab # [ 254.669761] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:18:05.156Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"7bff7066d4502a7937552c0e","created_at":"2026-08-13T13:18:01.938Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-20120ecbeb694008","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5a94c19437300c648b8f681b5b375dcf","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-13T13:18:01.990Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-7bff7066d4502a7937552c0e: done: 0.021236 sec","job_status":"done","queue_duration_s":3.145352,"scheduling_latency_s":3.145368,"redis_calls":10,"redis_duration_s":0.002489,"redis_read_bytes":8,"redis_write_bytes":1239,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00143,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":636,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001059,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":603,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013458,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00480256,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.021236,"completed_at":"2026-08-13T13:18:05.156Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002431,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1399gitlab # [ 254.721891] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:18:05.158Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"b5bf3b0c38892006ba9e5ed5","created_at":"2026-08-13T13:18:02.064Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-20120ecbeb694008","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f62c2ffb2feccd9d71e5cfd11a7cc1b1","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-13T13:18:02.161Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-b5bf3b0c38892006ba9e5ed5: start","job_status":"start","queue_duration_s":2.996881,"scheduling_latency_s":2.996896}1400gitlab # [ 254.735845] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:18:05.181Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"b5bf3b0c38892006ba9e5ed5","created_at":"2026-08-13T13:18:02.064Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-20120ecbeb694008","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f62c2ffb2feccd9d71e5cfd11a7cc1b1","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-13T13:18:02.161Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-b5bf3b0c38892006ba9e5ed5: done: 0.023391 sec","job_status":"done","queue_duration_s":2.996881,"scheduling_latency_s":2.996896,"redis_calls":9,"redis_duration_s":0.007509999999999999,"redis_read_bytes":7,"redis_write_bytes":1072,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.005259,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002251,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":560,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011538,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00063804,"exclusive_lock_hold_duration_s":0.00324564,"duration_s":0.023391,"completed_at":"2026-08-13T13:18:05.181Z","load_balancing_strategy":"primary","db_duration_s":0.000942,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1401gitlab # [ 254.776748] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:18:05.183Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"746a79450793b41c47a85747","created_at":"2026-08-13T13:18:02.309Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-20120ecbeb694008","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"caeb001e98ae88a52717554a5f6d8c55","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-13T13:18:02.345Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-746a79450793b41c47a85747: start","job_status":"start","queue_duration_s":2.837401,"scheduling_latency_s":2.837416}1402gitlab # [ 254.791139] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:18:05.200Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"746a79450793b41c47a85747","created_at":"2026-08-13T13:18:02.309Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-20120ecbeb694008","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"caeb001e98ae88a52717554a5f6d8c55","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-13T13:18:02.345Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-746a79450793b41c47a85747: done: 0.017811 sec","job_status":"done","queue_duration_s":2.837401,"scheduling_latency_s":2.837416,"redis_calls":9,"redis_duration_s":0.003018,"redis_read_bytes":7,"redis_write_bytes":1087,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00184,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001178,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":566,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010217,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00054588,"exclusive_lock_hold_duration_s":0.00232232,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.017811,"completed_at":"2026-08-13T13:18:05.200Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000749,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1403gitlab # [ 254.835832] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:18:05.202Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"1a0ce8cc6f8b605f10015f22","created_at":"2026-08-13T13:18:02.423Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-20120ecbeb694008","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"04c64c43b8d868c95fd4ef3f822b20cb","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-13T13:18:02.467Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-1a0ce8cc6f8b605f10015f22: start","job_status":"start","queue_duration_s":2.734884,"scheduling_latency_s":2.7349}1404gitlab # [ 254.878835] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:18:05.210Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0}1405gitlab # [ 254.887931] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:18:05.216Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"1a0ce8cc6f8b605f10015f22","created_at":"2026-08-13T13:18:02.423Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-20120ecbeb694008","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"04c64c43b8d868c95fd4ef3f822b20cb","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-13T13:18:02.467Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-1a0ce8cc6f8b605f10015f22: done: 0.013805 sec","job_status":"done","queue_duration_s":2.734884,"scheduling_latency_s":2.7349,"redis_calls":7,"redis_duration_s":0.0017460000000000002,"redis_read_bytes":5,"redis_write_bytes":766,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00125,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":524,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000496,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":242,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008644,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013805,"completed_at":"2026-08-13T13:18:05.216Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1406gitlab # [ 254.949647] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:18:05.217Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"027ca9863c3300ba8d506c67","created_at":"2026-08-13T13:18:02.619Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-20120ecbeb694008","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ec284f61e42ff833c3edab8008aec236","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-13T13:18:02.653Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-027ca9863c3300ba8d506c67: start","job_status":"start","queue_duration_s":2.564103,"scheduling_latency_s":2.564117}1407gitlab # [ 254.963863] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:18:05.225Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0}1408gitlab # [ 254.967890] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:18:05.230Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"027ca9863c3300ba8d506c67","created_at":"2026-08-13T13:18:02.619Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-20120ecbeb694008","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ec284f61e42ff833c3edab8008aec236","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-13T13:18:02.653Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-027ca9863c3300ba8d506c67: done: 0.012879 sec","job_status":"done","queue_duration_s":2.564103,"scheduling_latency_s":2.564117,"redis_calls":7,"redis_duration_s":0.001728,"redis_read_bytes":5,"redis_write_bytes":801,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001237,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":545,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000491,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":256,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007678,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.012879,"completed_at":"2026-08-13T13:18:05.230Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1409gitlab # [ 255.041549] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:18:05.232Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"dec4108913ea04c4087087eb","created_at":"2026-08-13T13:18:02.772Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-20120ecbeb694008","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"eff6c786b354a0ab10b03cedac5aacb1","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-13T13:18:02.814Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-dec4108913ea04c4087087eb: start","job_status":"start","queue_duration_s":2.417359,"scheduling_latency_s":2.417373}1410gitlab # [ 255.071873] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:18:05.276Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"dec4108913ea04c4087087eb","created_at":"2026-08-13T13:18:02.772Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-20120ecbeb694008","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"eff6c786b354a0ab10b03cedac5aacb1","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-13T13:18:02.814Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-dec4108913ea04c4087087eb: done: 0.044123 sec","job_status":"done","queue_duration_s":2.417359,"scheduling_latency_s":2.417373,"redis_calls":9,"redis_duration_s":0.002534,"redis_read_bytes":7,"redis_write_bytes":1169,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001345,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001189,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":615,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.02,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.02,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017519,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00066992,"exclusive_lock_hold_duration_s":0.02016914,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.044123,"completed_at":"2026-08-13T13:18:05.276Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.021522,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1411gitlab # [ 255.137124] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:18:05.278Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ObjectStorage::DeleteStaleDirectUploadsWorker","jid":"10a4c341ed45529f8ce29c0c","created_at":"2026-08-13T13:18:02.900Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-20120ecbeb694008","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d7a85af8b4a8febee55c86748a1cd054","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:da92be7816ff691bea6b0627c50cb73b98e4b5009a988cab37d277c0df9aa326","size_limiter":"validated","enqueued_at":"2026-08-13T13:18:02.990Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"ObjectStorage::DeleteStaleDirectUploadsWorker JID-10a4c341ed45529f8ce29c0c: start","job_status":"start","queue_duration_s":2.287662,"scheduling_latency_s":2.28768}1412gitlab # [ 255.153585] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:18:05.298Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ObjectStorage::DeleteStaleDirectUploadsWorker","jid":"10a4c341ed45529f8ce29c0c","created_at":"2026-08-13T13:18:02.900Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-20120ecbeb694008","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d7a85af8b4a8febee55c86748a1cd054","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:da92be7816ff691bea6b0627c50cb73b98e4b5009a988cab37d277c0df9aa326","size_limiter":"validated","enqueued_at":"2026-08-13T13:18:02.990Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"ObjectStorage::DeleteStaleDirectUploadsWorker JID-10a4c341ed45529f8ce29c0c: done: 0.020456 sec","job_status":"done","queue_duration_s":2.287662,"scheduling_latency_s":2.28768,"redis_calls":12,"redis_duration_s":0.002941,"redis_read_bytes":11,"redis_write_bytes":1247,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00048,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":333,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001371,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":618,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00109,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":296,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011639,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00034818,"extra.object_storage_delete_stale_direct_uploads_worker.total_pending_entries":0,"extra.object_storage_delete_stale_direct_uploads_worker.total_deleted_stale_entries":0,"extra.object_storage_delete_stale_direct_uploads_worker.execution_timeout":false,"duration_s":0.020456,"completed_at":"2026-08-13T13:18:05.298Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000603,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1413gitlab # [ 255.198898] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:18:05.299Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"2d20a557980da3afc19261a4","created_at":"2026-08-13T13:18:03.061Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-20120ecbeb694008","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"85ba5bb7b55f7f8a4aaea72cb4071444","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-13T13:18:03.093Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-2d20a557980da3afc19261a4: start","job_status":"start","queue_duration_s":2.206294,"scheduling_latency_s":2.206309}1414gitlab # [ 255.213501] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:18:05.307Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0}1415gitlab # [ 255.217152] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:18:05.313Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"2d20a557980da3afc19261a4","created_at":"2026-08-13T13:18:03.061Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-20120ecbeb694008","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"85ba5bb7b55f7f8a4aaea72cb4071444","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-13T13:18:03.093Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-2d20a557980da3afc19261a4: done: 0.013579 sec","job_status":"done","queue_duration_s":2.206294,"scheduling_latency_s":2.206309,"redis_calls":7,"redis_duration_s":0.002033,"redis_read_bytes":5,"redis_write_bytes":826,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001527,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000506,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008412,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013579,"completed_at":"2026-08-13T13:18:05.313Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1416gitlab # [ 255.258008] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:18:05.314Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"916de94e33e7ec7975151bdb","created_at":"2026-08-13T13:18:03.307Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-20120ecbeb694008","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2f1be439ca0b8a18dea90e2ffeb88c67","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-13T13:18:03.331Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-916de94e33e7ec7975151bdb: start","job_status":"start","queue_duration_s":1.983628,"scheduling_latency_s":1.983643}1417gitlab # [ 255.273842] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:18:05.322Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0}1418gitlab # [ 255.277104] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:18:05.328Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"916de94e33e7ec7975151bdb","created_at":"2026-08-13T13:18:03.307Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-20120ecbeb694008","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2f1be439ca0b8a18dea90e2ffeb88c67","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-13T13:18:03.331Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-916de94e33e7ec7975151bdb: done: 0.013262 sec","job_status":"done","queue_duration_s":1.983628,"scheduling_latency_s":1.983643,"redis_calls":7,"redis_duration_s":0.001755,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001258,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000497,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008062,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013262,"completed_at":"2026-08-13T13:18:05.328Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1419gitlab # [ 255.317494] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:18:05.329Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"803d766e52c501e7e9591f48","created_at":"2026-08-13T13:18:03.444Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-20120ecbeb694008","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8b313711547652402f7e0a92d24f2c46","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-08-13T13:18:03.486Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-803d766e52c501e7e9591f48: start","job_status":"start","queue_duration_s":1.842795,"scheduling_latency_s":1.84281}1420gitlab # [ 255.331069] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:18:05.357Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"803d766e52c501e7e9591f48","created_at":"2026-08-13T13:18:03.444Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-20120ecbeb694008","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8b313711547652402f7e0a92d24f2c46","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-08-13T13:18:03.486Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-803d766e52c501e7e9591f48: done: 0.028122 sec","job_status":"done","queue_duration_s":1.842795,"scheduling_latency_s":1.84281,"redis_calls":14,"redis_duration_s":0.002969,"redis_read_bytes":16,"redis_write_bytes":4022,"redis_queues_calls":2,"redis_queues_duration_s":0.000311,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3011,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.001932,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":727,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000726,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":284,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020649,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.028122,"completed_at":"2026-08-13T13:18:05.357Z","load_balancing_strategy":"primary","db_duration_s":0.00096,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1421gitlab # [ 255.371648] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:18:05.359Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"513778d4ef871cccb4d25c35","created_at":"2026-08-13T13:18:03.561Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-20120ecbeb694008","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"25358bd827fab3c0513ac43b67fed2e5","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-13T13:18:03.593Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-513778d4ef871cccb4d25c35: start","job_status":"start","queue_duration_s":1.765283,"scheduling_latency_s":1.7653}1422gitlab # [ 255.384823] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:18:05.380Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"513778d4ef871cccb4d25c35","created_at":"2026-08-13T13:18:03.561Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-20120ecbeb694008","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"25358bd827fab3c0513ac43b67fed2e5","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-13T13:18:03.593Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-513778d4ef871cccb4d25c35: done: 0.021083 sec","job_status":"done","queue_duration_s":1.765283,"scheduling_latency_s":1.7653,"redis_calls":7,"redis_duration_s":0.000995,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000722,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000273,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014949,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.021083,"completed_at":"2026-08-13T13:18:05.380Z","load_balancing_strategy":"primary","db_duration_s":0.001638,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1423gitlab # [ 255.424345] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:18:05.381Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"d150df669f3f70b79dbc1eea","created_at":"2026-08-13T13:18:03.666Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-20120ecbeb694008","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b9a2f3bddbfdf49451ee68ac6b397947","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-08-13T13:18:03.726Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-d150df669f3f70b79dbc1eea: start","job_status":"start","queue_duration_s":1.654927,"scheduling_latency_s":1.654943}1424gitlab # [ 255.438838] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:18:05.411Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"d150df669f3f70b79dbc1eea","created_at":"2026-08-13T13:18:03.666Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-20120ecbeb694008","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b9a2f3bddbfdf49451ee68ac6b397947","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-08-13T13:18:03.726Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-d150df669f3f70b79dbc1eea: done: 0.030036 sec","job_status":"done","queue_duration_s":1.654927,"scheduling_latency_s":1.654943,"redis_calls":10,"redis_duration_s":0.002214,"redis_read_bytes":9,"redis_write_bytes":1225,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000478,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001297,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":634,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000439,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":250,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017176,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00045772,"duration_s":0.030036,"completed_at":"2026-08-13T13:18:05.411Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005709,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1425gitlab # [ 255.482437] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:18:05.412Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"3eba67cd132f247e9e260a3c","created_at":"2026-08-13T13:18:03.769Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-20120ecbeb694008","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a86bc7d3f58baaaae2da212cf6e9d9fc","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-08-13T13:18:03.828Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-3eba67cd132f247e9e260a3c: start","job_status":"start","queue_duration_s":1.584187,"scheduling_latency_s":1.584202}1426gitlab # [ 255.495517] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:18:05.445Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"3eba67cd132f247e9e260a3c","created_at":"2026-08-13T13:18:03.769Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-20120ecbeb694008","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a86bc7d3f58baaaae2da212cf6e9d9fc","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-08-13T13:18:03.828Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-3eba67cd132f247e9e260a3c: done: 0.03274 sec","job_status":"done","queue_duration_s":1.584187,"scheduling_latency_s":1.584202,"redis_calls":12,"redis_duration_s":0.003046,"redis_read_bytes":10,"redis_write_bytes":1174,"redis_cache_calls":2,"redis_cache_duration_s":0.000648,"redis_cache_read_bytes":1,"redis_cache_write_bytes":93,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000531,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001372,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":562,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000495,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":214,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024654,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00034276,"duration_s":0.03274,"completed_at":"2026-08-13T13:18:05.445Z","load_balancing_strategy":"primary","db_duration_s":0.000582,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1427gitlab # [ 255.538014] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:18:05.446Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"29b43940e41c6d37c53eb132","created_at":"2026-08-13T13:18:03.920Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-20120ecbeb694008","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5d243d25c61313cd12b575b15d1b6f0c","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-13T13:18:03.954Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-29b43940e41c6d37c53eb132: start","job_status":"start","queue_duration_s":1.492922,"scheduling_latency_s":1.492937}1428gitlab # [ 255.552431] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:18:05.454Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0}1429gitlab # [ 255.555996] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:18:05.459Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"29b43940e41c6d37c53eb132","created_at":"2026-08-13T13:18:03.920Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-20120ecbeb694008","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5d243d25c61313cd12b575b15d1b6f0c","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-13T13:18:03.954Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-29b43940e41c6d37c53eb132: done: 0.012741 sec","job_status":"done","queue_duration_s":1.492922,"scheduling_latency_s":1.492937,"redis_calls":7,"redis_duration_s":0.001607,"redis_read_bytes":5,"redis_write_bytes":821,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001158,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":557,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000449,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":264,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007697,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.012741,"completed_at":"2026-08-13T13:18:05.459Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1430gitlab # [ 255.596634] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:18:05.461Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"dd070b9351b93e371166223f","created_at":"2026-08-13T13:18:04.064Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-20120ecbeb694008","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"916eba4d791adb09c1470474a2fe51eb","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-13T13:18:04.103Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-dd070b9351b93e371166223f: start","job_status":"start","queue_duration_s":1.357199,"scheduling_latency_s":1.357213}1431gitlab # [ 255.611009] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:18:05.490Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"dd070b9351b93e371166223f","created_at":"2026-08-13T13:18:04.064Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-20120ecbeb694008","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"916eba4d791adb09c1470474a2fe51eb","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-13T13:18:04.103Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-dd070b9351b93e371166223f: done: 0.029163 sec","job_status":"done","queue_duration_s":1.357199,"scheduling_latency_s":1.357213,"redis_calls":7,"redis_duration_s":0.003815,"redis_read_bytes":5,"redis_write_bytes":831,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.003006,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":563,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000809,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":268,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021147,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.029163,"completed_at":"2026-08-13T13:18:05.490Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1432gitlab # [ 255.652546] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:18:05.493Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"5a1e46f08c69b04d69702feb","created_at":"2026-08-13T13:18:04.183Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-20120ecbeb694008","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d41d5e919f6784df3c933fbf7ceaa979","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-13T13:18:04.227Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-5a1e46f08c69b04d69702feb: start","job_status":"start","queue_duration_s":1.265964,"scheduling_latency_s":1.266002}1433gitlab # [ 255.667042] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:18:05.513Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0}1434gitlab # [ 255.670527] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:18:05.525Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"5a1e46f08c69b04d69702feb","created_at":"2026-08-13T13:18:04.183Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-20120ecbeb694008","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d41d5e919f6784df3c933fbf7ceaa979","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-13T13:18:04.227Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-5a1e46f08c69b04d69702feb: done: 0.031734 sec","job_status":"done","queue_duration_s":1.265964,"scheduling_latency_s":1.266002,"redis_calls":7,"redis_duration_s":0.00254,"redis_read_bytes":5,"redis_write_bytes":806,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001822,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":548,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000718,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":258,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020536,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.031734,"completed_at":"2026-08-13T13:18:05.524Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1435gitlab # [ 255.709732] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:18:05.527Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"5a83220eedc706db5d94b015","created_at":"2026-08-13T13:18:04.313Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-20120ecbeb694008","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"50f08356ef976654f80ef41c82a3bcf6","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-13T13:18:04.371Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-5a83220eedc706db5d94b015: start","job_status":"start","queue_duration_s":1.156143,"scheduling_latency_s":1.156175}1436gitlab # [ 255.723551] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:18:05.559Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"5a83220eedc706db5d94b015","created_at":"2026-08-13T13:18:04.313Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-20120ecbeb694008","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"50f08356ef976654f80ef41c82a3bcf6","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-13T13:18:04.371Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-5a83220eedc706db5d94b015: done: 0.031915 sec","job_status":"done","queue_duration_s":1.156143,"scheduling_latency_s":1.156175,"redis_calls":7,"redis_duration_s":0.001948,"redis_read_bytes":5,"redis_write_bytes":826,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001424,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000524,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018003,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.031915,"completed_at":"2026-08-13T13:18:05.559Z","load_balancing_strategy":"primary","db_duration_s":0.004978,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1437gitlab # [ 255.764825] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:18:05.561Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"c50e7916cd5a8fc052a50878","created_at":"2026-08-13T13:18:04.429Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-20120ecbeb694008","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6d6d8d87d7495052136a2b123e83b6de","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-13T13:18:04.459Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-c50e7916cd5a8fc052a50878: start","job_status":"start","queue_duration_s":1.102121,"scheduling_latency_s":1.102149}1438gitlab # [ 255.779110] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:18:05.681Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"c50e7916cd5a8fc052a50878","created_at":"2026-08-13T13:18:04.429Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-20120ecbeb694008","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6d6d8d87d7495052136a2b123e83b6de","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-13T13:18:04.459Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-c50e7916cd5a8fc052a50878: done: 0.120261 sec","job_status":"done","queue_duration_s":1.102121,"scheduling_latency_s":1.102149,"redis_calls":60,"redis_duration_s":0.0162,"redis_read_bytes":108,"redis_write_bytes":41109,"redis_queues_calls":2,"redis_queues_duration_s":0.000808,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37485,"redis_queues_metadata_calls":55,"redis_queues_metadata_duration_s":0.014557,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3324,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000835,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":300,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.105142,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.120261,"completed_at":"2026-08-13T13:18:05.681Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1439gitlab # [ 255.821872] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:18:05.683Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"7f093bbe11ca503564a1e096","created_at":"2026-08-13T13:18:05.341Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-4592ccbf038f4939","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"8b313711547652402f7e0a92d24f2c46","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:18:05.351Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-7f093bbe11ca503564a1e096: start","job_status":"start","queue_duration_s":0.331508,"scheduling_latency_s":0.331527}1440gitlab # [ 255.834578] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:18:05.695Z","message":"No existing merge request to be cleaned up."}1441gitlab # [ 255.836657] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:18:05.704Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"7f093bbe11ca503564a1e096","created_at":"2026-08-13T13:18:05.341Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-4592ccbf038f4939","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"8b313711547652402f7e0a92d24f2c46","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:18:05.351Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-7f093bbe11ca503564a1e096: done: 0.021101 sec","job_status":"done","queue_duration_s":0.331508,"scheduling_latency_s":0.331527,"redis_calls":10,"redis_duration_s":0.0023959999999999997,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000978,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001418,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013451,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.021101,"completed_at":"2026-08-13T13:18:05.704Z","load_balancing_strategy":"primary","db_duration_s":0.002876,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1442gitlab # [ 255.877435] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:18:05.705Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"6b95101c7f2c12bfca2028b1","created_at":"2026-08-13T13:18:05.341Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-4592ccbf038f4939","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"8b313711547652402f7e0a92d24f2c46","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:18:05.351Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-6b95101c7f2c12bfca2028b1: start","job_status":"start","queue_duration_s":0.354009,"scheduling_latency_s":0.354026}1443gitlab # [ 255.889976] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:18:05.717Z","message":"No existing merge request to be cleaned up."}1444gitlab # [ 255.891590] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:18:05.726Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"6b95101c7f2c12bfca2028b1","created_at":"2026-08-13T13:18:05.341Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-4592ccbf038f4939","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"8b313711547652402f7e0a92d24f2c46","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:18:05.351Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-6b95101c7f2c12bfca2028b1: done: 0.020234 sec","job_status":"done","queue_duration_s":0.354009,"scheduling_latency_s":0.354026,"redis_calls":10,"redis_duration_s":0.002537,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001039,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001498,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013076,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020234,"completed_at":"2026-08-13T13:18:05.726Z","load_balancing_strategy":"primary","db_duration_s":0.002508,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1445gitlab # [ 255.931308] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:18:05.727Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"477d245a7435925f73dec0af","created_at":"2026-08-13T13:18:05.341Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-4592ccbf038f4939","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"8b313711547652402f7e0a92d24f2c46","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:18:05.351Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-477d245a7435925f73dec0af: start","job_status":"start","queue_duration_s":0.375637,"scheduling_latency_s":0.375652}1446gitlab # [ 255.943923] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:18:05.738Z","message":"No existing merge request to be cleaned up."}1447gitlab # [ 255.945721] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:18:05.747Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"477d245a7435925f73dec0af","created_at":"2026-08-13T13:18:05.341Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-4592ccbf038f4939","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"8b313711547652402f7e0a92d24f2c46","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:18:05.351Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-477d245a7435925f73dec0af: done: 0.019932 sec","job_status":"done","queue_duration_s":0.375637,"scheduling_latency_s":0.375652,"redis_calls":10,"redis_duration_s":0.002802,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000992,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.00181,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012704,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019932,"completed_at":"2026-08-13T13:18:05.747Z","load_balancing_strategy":"primary","db_duration_s":0.002443,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1448gitlab # [ 255.985584] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:18:05.748Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"e74bd7b949dc22d32ecafd01","created_at":"2026-08-13T13:18:05.341Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-4592ccbf038f4939","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"8b313711547652402f7e0a92d24f2c46","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:18:05.351Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-e74bd7b949dc22d32ecafd01: start","job_status":"start","queue_duration_s":0.39699,"scheduling_latency_s":0.397005}1449gitlab # [ 255.998196] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:18:05.760Z","message":"No existing merge request to be cleaned up."}1450gitlab # [ 255.999980] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:18:05.768Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"e74bd7b949dc22d32ecafd01","created_at":"2026-08-13T13:18:05.341Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-4592ccbf038f4939","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"8b313711547652402f7e0a92d24f2c46","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:18:05.351Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-e74bd7b949dc22d32ecafd01: done: 0.019422 sec","job_status":"done","queue_duration_s":0.39699,"scheduling_latency_s":0.397005,"redis_calls":10,"redis_duration_s":0.002431,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000973,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001458,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012408,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019422,"completed_at":"2026-08-13T13:18:05.768Z","load_balancing_strategy":"primary","db_duration_s":0.002218,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1451gitlab # [ 256.039510] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:18:05.769Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"698edd6b44adda4cbda9595d","created_at":"2026-08-13T13:18:05.576Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-9546c2bb33424911","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6d6d8d87d7495052136a2b123e83b6de","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:18:05.674Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-698edd6b44adda4cbda9595d: start","job_status":"start","queue_duration_s":0.095519,"scheduling_latency_s":0.095536}1452gitlab # [ 256.052370] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:18:05.784Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"698edd6b44adda4cbda9595d","created_at":"2026-08-13T13:18:05.576Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-9546c2bb33424911","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6d6d8d87d7495052136a2b123e83b6de","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:18:05.674Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-698edd6b44adda4cbda9595d: done: 0.015114 sec","job_status":"done","queue_duration_s":0.095519,"scheduling_latency_s":0.095536,"redis_calls":13,"redis_duration_s":0.002746,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000921,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001825,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009316,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015114,"completed_at":"2026-08-13T13:18:05.784Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1453gitlab # [ 256.093336] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:18:05.786Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9ab057c116650e4c65b3c349","created_at":"2026-08-13T13:18:05.576Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-9546c2bb33424911","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6d6d8d87d7495052136a2b123e83b6de","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:18:05.674Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9ab057c116650e4c65b3c349: start","job_status":"start","queue_duration_s":0.112019,"scheduling_latency_s":0.112036}1454gitlab # [ 256.105999] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:18:05.801Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9ab057c116650e4c65b3c349","created_at":"2026-08-13T13:18:05.576Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-9546c2bb33424911","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6d6d8d87d7495052136a2b123e83b6de","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:18:05.674Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9ab057c116650e4c65b3c349: done: 0.015218 sec","job_status":"done","queue_duration_s":0.112019,"scheduling_latency_s":0.112036,"redis_calls":13,"redis_duration_s":0.0029230000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000943,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00198,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009367,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015218,"completed_at":"2026-08-13T13:18:05.801Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1455gitlab # [ 256.146175] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:18:05.802Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5d1daba98cd4498954fac92b","created_at":"2026-08-13T13:18:05.576Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-9546c2bb33424911","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6d6d8d87d7495052136a2b123e83b6de","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:18:05.674Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5d1daba98cd4498954fac92b: start","job_status":"start","queue_duration_s":0.128549,"scheduling_latency_s":0.128564}1456gitlab # [ 256.159034] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:18:05.817Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5d1daba98cd4498954fac92b","created_at":"2026-08-13T13:18:05.576Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-9546c2bb33424911","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6d6d8d87d7495052136a2b123e83b6de","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:18:05.674Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5d1daba98cd4498954fac92b: done: 0.014786 sec","job_status":"done","queue_duration_s":0.128549,"scheduling_latency_s":0.128564,"redis_calls":13,"redis_duration_s":0.002502,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000899,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001603,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009365,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014786,"completed_at":"2026-08-13T13:18:05.817Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1457gitlab # [ 256.199378] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:18:05.818Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6d4d65c4d623ead2382bd391","created_at":"2026-08-13T13:18:05.576Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-9546c2bb33424911","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6d6d8d87d7495052136a2b123e83b6de","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:18:05.674Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6d4d65c4d623ead2382bd391: start","job_status":"start","queue_duration_s":0.144678,"scheduling_latency_s":0.144694}1458gitlab # [ 256.212239] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:18:05.833Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6d4d65c4d623ead2382bd391","created_at":"2026-08-13T13:18:05.576Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-9546c2bb33424911","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6d6d8d87d7495052136a2b123e83b6de","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:18:05.674Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6d4d65c4d623ead2382bd391: done: 0.01496 sec","job_status":"done","queue_duration_s":0.144678,"scheduling_latency_s":0.144694,"redis_calls":13,"redis_duration_s":0.002696,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000949,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001747,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009423,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01496,"completed_at":"2026-08-13T13:18:05.833Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1459gitlab # [ 256.252550] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:18:05.835Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bd1b3f8eaa9feb752d07b9b7","created_at":"2026-08-13T13:18:05.576Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-9546c2bb33424911","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6d6d8d87d7495052136a2b123e83b6de","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:18:05.674Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bd1b3f8eaa9feb752d07b9b7: start","job_status":"start","queue_duration_s":0.161127,"scheduling_latency_s":0.161142}1460gitlab # [ 256.265466] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:18:05.850Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bd1b3f8eaa9feb752d07b9b7","created_at":"2026-08-13T13:18:05.576Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-9546c2bb33424911","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6d6d8d87d7495052136a2b123e83b6de","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:18:05.674Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bd1b3f8eaa9feb752d07b9b7: done: 0.014824 sec","job_status":"done","queue_duration_s":0.161127,"scheduling_latency_s":0.161142,"redis_calls":13,"redis_duration_s":0.00267,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000904,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001766,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009224,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014824,"completed_at":"2026-08-13T13:18:05.850Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1461gitlab # [ 256.306669] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:18:05.851Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8f71cc8ac49753d5f71856c2","created_at":"2026-08-13T13:18:05.576Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-9546c2bb33424911","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6d6d8d87d7495052136a2b123e83b6de","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:18:05.674Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8f71cc8ac49753d5f71856c2: start","job_status":"start","queue_duration_s":0.177221,"scheduling_latency_s":0.177237}1462gitlab # [ 256.319027] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:18:05.866Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8f71cc8ac49753d5f71856c2","created_at":"2026-08-13T13:18:05.576Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-9546c2bb33424911","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6d6d8d87d7495052136a2b123e83b6de","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:18:05.674Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8f71cc8ac49753d5f71856c2: done: 0.014963 sec","job_status":"done","queue_duration_s":0.177221,"scheduling_latency_s":0.177237,"redis_calls":13,"redis_duration_s":0.002848,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000986,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001862,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009292,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014963,"completed_at":"2026-08-13T13:18:05.866Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1463gitlab # [ 256.358573] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:18:05.867Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3c53b96b3155adf25ec2e3b1","created_at":"2026-08-13T13:18:05.576Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-9546c2bb33424911","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6d6d8d87d7495052136a2b123e83b6de","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:18:05.674Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3c53b96b3155adf25ec2e3b1: start","job_status":"start","queue_duration_s":0.193483,"scheduling_latency_s":0.1935}1464gitlab # [ 256.371210] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:18:05.883Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3c53b96b3155adf25ec2e3b1","created_at":"2026-08-13T13:18:05.576Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-9546c2bb33424911","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6d6d8d87d7495052136a2b123e83b6de","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:18:05.674Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3c53b96b3155adf25ec2e3b1: done: 0.015497 sec","job_status":"done","queue_duration_s":0.193483,"scheduling_latency_s":0.1935,"redis_calls":13,"redis_duration_s":0.003072,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000943,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002129,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009515,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015497,"completed_at":"2026-08-13T13:18:05.883Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1465gitlab # [ 256.410603] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:18:05.884Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"55c5052c9b836dcd6d731f14","created_at":"2026-08-13T13:18:05.576Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-9546c2bb33424911","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6d6d8d87d7495052136a2b123e83b6de","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:18:05.674Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-55c5052c9b836dcd6d731f14: start","job_status":"start","queue_duration_s":0.210306,"scheduling_latency_s":0.21032}1466gitlab # [ 256.423065] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:18:05.899Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"55c5052c9b836dcd6d731f14","created_at":"2026-08-13T13:18:05.576Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-9546c2bb33424911","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6d6d8d87d7495052136a2b123e83b6de","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:18:05.674Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-55c5052c9b836dcd6d731f14: done: 0.014794 sec","job_status":"done","queue_duration_s":0.210306,"scheduling_latency_s":0.21032,"redis_calls":13,"redis_duration_s":0.002655,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000904,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001751,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00923,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014794,"completed_at":"2026-08-13T13:18:05.899Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1467gitlab # [ 256.462846] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:18:05.900Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7c951d7917a32fa2544117fd","created_at":"2026-08-13T13:18:05.576Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-9546c2bb33424911","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6d6d8d87d7495052136a2b123e83b6de","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:18:05.674Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7c951d7917a32fa2544117fd: start","job_status":"start","queue_duration_s":0.226482,"scheduling_latency_s":0.226497}1468gitlab # [ 256.475112] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:18:05.915Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7c951d7917a32fa2544117fd","created_at":"2026-08-13T13:18:05.576Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-9546c2bb33424911","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6d6d8d87d7495052136a2b123e83b6de","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:18:05.674Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7c951d7917a32fa2544117fd: done: 0.015034 sec","job_status":"done","queue_duration_s":0.226482,"scheduling_latency_s":0.226497,"redis_calls":13,"redis_duration_s":0.002774,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00095,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001824,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009358,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015034,"completed_at":"2026-08-13T13:18:05.915Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1469gitlab # [ 256.515937] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:18:05.917Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"11c8505edc93659075718af5","created_at":"2026-08-13T13:18:05.576Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-9546c2bb33424911","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6d6d8d87d7495052136a2b123e83b6de","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:18:05.674Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-11c8505edc93659075718af5: start","job_status":"start","queue_duration_s":0.242947,"scheduling_latency_s":0.242963}1470gitlab # [ 256.528443] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:18:05.931Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"11c8505edc93659075718af5","created_at":"2026-08-13T13:18:05.576Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-9546c2bb33424911","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6d6d8d87d7495052136a2b123e83b6de","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:18:05.674Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-11c8505edc93659075718af5: done: 0.014721 sec","job_status":"done","queue_duration_s":0.242947,"scheduling_latency_s":0.242963,"redis_calls":13,"redis_duration_s":0.002673,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000942,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001731,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009115,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014721,"completed_at":"2026-08-13T13:18:05.931Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1471gitlab # [ 256.567410] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:18:05.933Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6beb6d25fc3477b3f2e8217a","created_at":"2026-08-13T13:18:05.576Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-9546c2bb33424911","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6d6d8d87d7495052136a2b123e83b6de","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:18:05.674Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6beb6d25fc3477b3f2e8217a: start","job_status":"start","queue_duration_s":0.259034,"scheduling_latency_s":0.259049}1472gitlab # [ 256.579749] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:18:05.947Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6beb6d25fc3477b3f2e8217a","created_at":"2026-08-13T13:18:05.576Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-9546c2bb33424911","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6d6d8d87d7495052136a2b123e83b6de","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:18:05.674Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6beb6d25fc3477b3f2e8217a: done: 0.014838 sec","job_status":"done","queue_duration_s":0.259034,"scheduling_latency_s":0.259049,"redis_calls":13,"redis_duration_s":0.002581,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000945,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001636,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009373,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014838,"completed_at":"2026-08-13T13:18:05.947Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1473gitlab # [ 256.619213] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:18:05.949Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"57f98a15706975e7c460810f","created_at":"2026-08-13T13:18:05.576Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-9546c2bb33424911","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6d6d8d87d7495052136a2b123e83b6de","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:18:05.674Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-57f98a15706975e7c460810f: start","job_status":"start","queue_duration_s":0.275277,"scheduling_latency_s":0.275293}1474gitlab # [ 256.631875] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:18:05.964Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"57f98a15706975e7c460810f","created_at":"2026-08-13T13:18:05.576Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-9546c2bb33424911","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6d6d8d87d7495052136a2b123e83b6de","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:18:05.674Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-57f98a15706975e7c460810f: done: 0.014929 sec","job_status":"done","queue_duration_s":0.275277,"scheduling_latency_s":0.275293,"redis_calls":13,"redis_duration_s":0.002728,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000946,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001782,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009265,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014929,"completed_at":"2026-08-13T13:18:05.964Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1475gitlab # [ 256.671636] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:18:05.965Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f572dbd7afef2c5451d655e7","created_at":"2026-08-13T13:18:05.576Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-9546c2bb33424911","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6d6d8d87d7495052136a2b123e83b6de","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:18:05.674Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f572dbd7afef2c5451d655e7: start","job_status":"start","queue_duration_s":0.291566,"scheduling_latency_s":0.291581}1476gitlab # [ 256.684192] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:18:05.980Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f572dbd7afef2c5451d655e7","created_at":"2026-08-13T13:18:05.576Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-9546c2bb33424911","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6d6d8d87d7495052136a2b123e83b6de","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:18:05.674Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f572dbd7afef2c5451d655e7: done: 0.015022 sec","job_status":"done","queue_duration_s":0.291566,"scheduling_latency_s":0.291581,"redis_calls":13,"redis_duration_s":0.002817,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000918,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001899,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009343,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015022,"completed_at":"2026-08-13T13:18:05.980Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1477gitlab # [ 256.724485] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:18:05.982Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"78fb0a8588e054a3fefb83ce","created_at":"2026-08-13T13:18:05.576Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-9546c2bb33424911","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6d6d8d87d7495052136a2b123e83b6de","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:18:05.674Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-78fb0a8588e054a3fefb83ce: start","job_status":"start","queue_duration_s":0.30806,"scheduling_latency_s":0.308075}1478gitlab # [ 256.737169] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:18:05.997Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"78fb0a8588e054a3fefb83ce","created_at":"2026-08-13T13:18:05.576Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-9546c2bb33424911","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6d6d8d87d7495052136a2b123e83b6de","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:18:05.674Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-78fb0a8588e054a3fefb83ce: done: 0.014965 sec","job_status":"done","queue_duration_s":0.30806,"scheduling_latency_s":0.308075,"redis_calls":13,"redis_duration_s":0.002733,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000932,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001801,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00936,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014965,"completed_at":"2026-08-13T13:18:05.997Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1479gitlab # [ 256.775830] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:18:05.998Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0a909d14fd15822e4f167dde","created_at":"2026-08-13T13:18:05.576Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-9546c2bb33424911","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6d6d8d87d7495052136a2b123e83b6de","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:18:05.674Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0a909d14fd15822e4f167dde: start","job_status":"start","queue_duration_s":0.324303,"scheduling_latency_s":0.324319}1480gitlab # [ 256.788360] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:18:06.013Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0a909d14fd15822e4f167dde","created_at":"2026-08-13T13:18:05.576Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-9546c2bb33424911","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6d6d8d87d7495052136a2b123e83b6de","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:18:05.674Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0a909d14fd15822e4f167dde: done: 0.01492 sec","job_status":"done","queue_duration_s":0.324303,"scheduling_latency_s":0.324319,"redis_calls":13,"redis_duration_s":0.002581,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000907,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001674,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009455,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01492,"completed_at":"2026-08-13T13:18:06.013Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1481gitlab # [ 256.826833] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:18:06.014Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"229c92a484e82c316d65f59e","created_at":"2026-08-13T13:18:05.576Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-9546c2bb33424911","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6d6d8d87d7495052136a2b123e83b6de","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:18:05.674Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-229c92a484e82c316d65f59e: start","job_status":"start","queue_duration_s":0.340565,"scheduling_latency_s":0.340581}1482gitlab # [ 256.839638] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:18:06.029Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"229c92a484e82c316d65f59e","created_at":"2026-08-13T13:18:05.576Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-9546c2bb33424911","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6d6d8d87d7495052136a2b123e83b6de","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:18:05.674Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-229c92a484e82c316d65f59e: done: 0.01508 sec","job_status":"done","queue_duration_s":0.340565,"scheduling_latency_s":0.340581,"redis_calls":13,"redis_duration_s":0.00272,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000951,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001769,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009555,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01508,"completed_at":"2026-08-13T13:18:06.029Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1483gitlab # [ 256.878622] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:18:06.031Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b493327e49ffc6af0c634f32","created_at":"2026-08-13T13:18:05.576Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-9546c2bb33424911","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6d6d8d87d7495052136a2b123e83b6de","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:18:05.674Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b493327e49ffc6af0c634f32: start","job_status":"start","queue_duration_s":0.357094,"scheduling_latency_s":0.357109}1484gitlab # [ 256.892170] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:18:06.045Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b493327e49ffc6af0c634f32","created_at":"2026-08-13T13:18:05.576Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-9546c2bb33424911","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6d6d8d87d7495052136a2b123e83b6de","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:18:05.674Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b493327e49ffc6af0c634f32: done: 0.01452 sec","job_status":"done","queue_duration_s":0.357094,"scheduling_latency_s":0.357109,"redis_calls":13,"redis_duration_s":0.0025399999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000907,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001633,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009113,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01452,"completed_at":"2026-08-13T13:18:06.045Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1485gitlab # [ 256.931008] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:18:06.048Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b9fbf38c0bb8ce7618884747","created_at":"2026-08-13T13:18:05.576Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-9546c2bb33424911","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6d6d8d87d7495052136a2b123e83b6de","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:18:05.674Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b9fbf38c0bb8ce7618884747: start","job_status":"start","queue_duration_s":0.37445,"scheduling_latency_s":0.374467}1486gitlab # [ 256.943293] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:18:06.063Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b9fbf38c0bb8ce7618884747","created_at":"2026-08-13T13:18:05.576Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-9546c2bb33424911","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6d6d8d87d7495052136a2b123e83b6de","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:18:05.674Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b9fbf38c0bb8ce7618884747: done: 0.015181 sec","job_status":"done","queue_duration_s":0.37445,"scheduling_latency_s":0.374467,"redis_calls":13,"redis_duration_s":0.0026,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000948,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001652,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009484,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015181,"completed_at":"2026-08-13T13:18:06.063Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1487gitlab # [ 256.982110] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:18:06.065Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bd11eb516a40201f3ee09bf8","created_at":"2026-08-13T13:18:05.576Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-9546c2bb33424911","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6d6d8d87d7495052136a2b123e83b6de","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:18:05.674Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bd11eb516a40201f3ee09bf8: start","job_status":"start","queue_duration_s":0.391027,"scheduling_latency_s":0.391043}1488gitlab # [ 256.994479] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:18:06.080Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bd11eb516a40201f3ee09bf8","created_at":"2026-08-13T13:18:05.576Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-9546c2bb33424911","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6d6d8d87d7495052136a2b123e83b6de","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:18:05.674Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bd11eb516a40201f3ee09bf8: done: 0.014874 sec","job_status":"done","queue_duration_s":0.391027,"scheduling_latency_s":0.391043,"redis_calls":13,"redis_duration_s":0.002699,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000925,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001774,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009238,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014874,"completed_at":"2026-08-13T13:18:06.079Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1489gitlab # [ 257.033076] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:18:06.081Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"23b3ae53f79900b863af90dd","created_at":"2026-08-13T13:18:05.576Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-9546c2bb33424911","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6d6d8d87d7495052136a2b123e83b6de","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:18:05.674Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-23b3ae53f79900b863af90dd: start","job_status":"start","queue_duration_s":0.407279,"scheduling_latency_s":0.407295}1490gitlab # [ 257.045169] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:18:06.096Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"23b3ae53f79900b863af90dd","created_at":"2026-08-13T13:18:05.576Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-9546c2bb33424911","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6d6d8d87d7495052136a2b123e83b6de","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:18:05.674Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-23b3ae53f79900b863af90dd: done: 0.014614 sec","job_status":"done","queue_duration_s":0.407279,"scheduling_latency_s":0.407295,"redis_calls":13,"redis_duration_s":0.002523,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000934,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001589,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009187,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014614,"completed_at":"2026-08-13T13:18:06.095Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1491gitlab # [ 257.083895] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:18:06.097Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"685fa53ca1add2a1969c52e9","created_at":"2026-08-13T13:18:05.576Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-9546c2bb33424911","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6d6d8d87d7495052136a2b123e83b6de","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:18:05.674Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-685fa53ca1add2a1969c52e9: start","job_status":"start","queue_duration_s":0.423342,"scheduling_latency_s":0.423357}1492gitlab # [ 257.097581] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:18:06.112Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"685fa53ca1add2a1969c52e9","created_at":"2026-08-13T13:18:05.576Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-9546c2bb33424911","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6d6d8d87d7495052136a2b123e83b6de","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:18:05.674Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-685fa53ca1add2a1969c52e9: done: 0.015389 sec","job_status":"done","queue_duration_s":0.423342,"scheduling_latency_s":0.423357,"redis_calls":13,"redis_duration_s":0.003097,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001038,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002059,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009542,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015389,"completed_at":"2026-08-13T13:18:06.112Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1493gitlab # [ 257.136884] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:18:06.114Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7c1778934557746daa9ec696","created_at":"2026-08-13T13:18:05.576Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-9546c2bb33424911","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6d6d8d87d7495052136a2b123e83b6de","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:18:05.674Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7c1778934557746daa9ec696: start","job_status":"start","queue_duration_s":0.440141,"scheduling_latency_s":0.440157}1494gitlab # [ 257.149234] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:18:06.129Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7c1778934557746daa9ec696","created_at":"2026-08-13T13:18:05.576Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-9546c2bb33424911","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6d6d8d87d7495052136a2b123e83b6de","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:18:05.674Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7c1778934557746daa9ec696: done: 0.0149 sec","job_status":"done","queue_duration_s":0.440141,"scheduling_latency_s":0.440157,"redis_calls":13,"redis_duration_s":0.002824,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000921,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001903,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009201,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.0149,"completed_at":"2026-08-13T13:18:06.129Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1495gitlab # [ 257.188249] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:18:06.130Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"26a79339f6d13309e13b9582","created_at":"2026-08-13T13:18:05.576Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-9546c2bb33424911","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6d6d8d87d7495052136a2b123e83b6de","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:18:05.674Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-26a79339f6d13309e13b9582: start","job_status":"start","queue_duration_s":0.456359,"scheduling_latency_s":0.456375}1496gitlab # [ 257.200569] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:18:06.146Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"26a79339f6d13309e13b9582","created_at":"2026-08-13T13:18:05.576Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-9546c2bb33424911","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6d6d8d87d7495052136a2b123e83b6de","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:18:05.674Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-26a79339f6d13309e13b9582: done: 0.015677 sec","job_status":"done","queue_duration_s":0.456359,"scheduling_latency_s":0.456375,"redis_calls":13,"redis_duration_s":0.003317,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000931,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002386,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009557,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015677,"completed_at":"2026-08-13T13:18:06.146Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1497gitlab # [ 257.239450] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:18:06.147Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2c0450861bfab28095ff0807","created_at":"2026-08-13T13:18:05.576Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-9546c2bb33424911","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6d6d8d87d7495052136a2b123e83b6de","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:18:05.674Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2c0450861bfab28095ff0807: start","job_status":"start","queue_duration_s":0.473301,"scheduling_latency_s":0.473317}1498gitlab # [ 257.252079] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:18:06.162Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2c0450861bfab28095ff0807","created_at":"2026-08-13T13:18:05.576Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-9546c2bb33424911","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6d6d8d87d7495052136a2b123e83b6de","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:18:05.674Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2c0450861bfab28095ff0807: done: 0.014666 sec","job_status":"done","queue_duration_s":0.473301,"scheduling_latency_s":0.473317,"redis_calls":13,"redis_duration_s":0.002581,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000907,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001674,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009176,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014666,"completed_at":"2026-08-13T13:18:06.162Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1499gitlab # [ 257.291278] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:18:06.163Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"650c60b76b5dedbfa89e81b3","created_at":"2026-08-13T13:18:05.576Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-9546c2bb33424911","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6d6d8d87d7495052136a2b123e83b6de","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:18:05.674Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-650c60b76b5dedbfa89e81b3: start","job_status":"start","queue_duration_s":0.489267,"scheduling_latency_s":0.489282}1500gitlab # [ 257.304901] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:18:06.178Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"650c60b76b5dedbfa89e81b3","created_at":"2026-08-13T13:18:05.576Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-9546c2bb33424911","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6d6d8d87d7495052136a2b123e83b6de","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:18:05.674Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-650c60b76b5dedbfa89e81b3: done: 0.015183 sec","job_status":"done","queue_duration_s":0.489267,"scheduling_latency_s":0.489282,"redis_calls":13,"redis_duration_s":0.002829,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000911,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001918,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009465,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015183,"completed_at":"2026-08-13T13:18:06.178Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1501gitlab # [ 257.344095] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:18:06.180Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"28d6774cf347f8907810a782","created_at":"2026-08-13T13:18:05.576Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-9546c2bb33424911","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6d6d8d87d7495052136a2b123e83b6de","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:18:05.674Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-28d6774cf347f8907810a782: start","job_status":"start","queue_duration_s":0.505917,"scheduling_latency_s":0.505933}1502gitlab # [ 257.356067] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:18:06.194Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"28d6774cf347f8907810a782","created_at":"2026-08-13T13:18:05.576Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-9546c2bb33424911","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6d6d8d87d7495052136a2b123e83b6de","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:18:05.674Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-28d6774cf347f8907810a782: done: 0.014833 sec","job_status":"done","queue_duration_s":0.505917,"scheduling_latency_s":0.505933,"redis_calls":13,"redis_duration_s":0.002757,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000933,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001824,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009117,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014833,"completed_at":"2026-08-13T13:18:06.194Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1503gitlab # [ 257.395661] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:18:06.195Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1f6da3ef36abe9d6f17e67fe","created_at":"2026-08-13T13:18:05.576Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-9546c2bb33424911","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6d6d8d87d7495052136a2b123e83b6de","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:18:05.674Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1f6da3ef36abe9d6f17e67fe: start","job_status":"start","queue_duration_s":0.521848,"scheduling_latency_s":0.521865}1504gitlab # [ 257.408373] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:18:06.209Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1f6da3ef36abe9d6f17e67fe","created_at":"2026-08-13T13:18:05.576Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-9546c2bb33424911","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6d6d8d87d7495052136a2b123e83b6de","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:18:05.674Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1f6da3ef36abe9d6f17e67fe: done: 0.013941 sec","job_status":"done","queue_duration_s":0.521848,"scheduling_latency_s":0.521865,"redis_calls":13,"redis_duration_s":0.001449,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000527,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000922,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009596,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013941,"completed_at":"2026-08-13T13:18:06.209Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1505gitlab # [ 257.447213] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:18:06.211Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5471c8c3dcf830c4c4156dd0","created_at":"2026-08-13T13:18:05.576Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-9546c2bb33424911","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6d6d8d87d7495052136a2b123e83b6de","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:18:05.674Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5471c8c3dcf830c4c4156dd0: start","job_status":"start","queue_duration_s":0.536958,"scheduling_latency_s":0.536975}1506gitlab # [ 257.459896] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:18:06.225Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5471c8c3dcf830c4c4156dd0","created_at":"2026-08-13T13:18:05.576Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-9546c2bb33424911","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6d6d8d87d7495052136a2b123e83b6de","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:18:05.674Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5471c8c3dcf830c4c4156dd0: done: 0.014063 sec","job_status":"done","queue_duration_s":0.536958,"scheduling_latency_s":0.536975,"redis_calls":13,"redis_duration_s":0.001506,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00055,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000956,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009727,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014063,"completed_at":"2026-08-13T13:18:06.225Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1507gitlab # [ 257.499559] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:18:06.226Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"208031ee4a6a550762b5b058","created_at":"2026-08-13T13:18:05.576Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-9546c2bb33424911","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6d6d8d87d7495052136a2b123e83b6de","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:18:05.674Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-208031ee4a6a550762b5b058: start","job_status":"start","queue_duration_s":0.552186,"scheduling_latency_s":0.552203}1508gitlab # [ 257.513698] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:18:06.241Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"208031ee4a6a550762b5b058","created_at":"2026-08-13T13:18:05.576Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-9546c2bb33424911","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6d6d8d87d7495052136a2b123e83b6de","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:18:05.674Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-208031ee4a6a550762b5b058: done: 0.01484 sec","job_status":"done","queue_duration_s":0.552186,"scheduling_latency_s":0.552203,"redis_calls":13,"redis_duration_s":0.001503,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000538,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000965,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009901,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01484,"completed_at":"2026-08-13T13:18:06.241Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1509gitlab # [ 257.552459] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:18:06.242Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b171a6ed9e11d1f7b23daf56","created_at":"2026-08-13T13:18:05.576Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-9546c2bb33424911","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6d6d8d87d7495052136a2b123e83b6de","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:18:05.674Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b171a6ed9e11d1f7b23daf56: start","job_status":"start","queue_duration_s":0.568193,"scheduling_latency_s":0.56821}1510gitlab # [ 257.564802] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:18:06.257Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b171a6ed9e11d1f7b23daf56","created_at":"2026-08-13T13:18:05.576Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-9546c2bb33424911","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6d6d8d87d7495052136a2b123e83b6de","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:18:05.674Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b171a6ed9e11d1f7b23daf56: done: 0.014754 sec","job_status":"done","queue_duration_s":0.568193,"scheduling_latency_s":0.56821,"redis_calls":13,"redis_duration_s":0.001475,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000539,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000936,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010041,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014754,"completed_at":"2026-08-13T13:18:06.256Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1511gitlab # [ 257.604057] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:18:06.258Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6e6a71895a0276f1308b2795","created_at":"2026-08-13T13:18:05.576Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-9546c2bb33424911","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6d6d8d87d7495052136a2b123e83b6de","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:18:05.674Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6e6a71895a0276f1308b2795: start","job_status":"start","queue_duration_s":0.584052,"scheduling_latency_s":0.58407}1512gitlab # [ 257.616268] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:18:06.272Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6e6a71895a0276f1308b2795","created_at":"2026-08-13T13:18:05.576Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-9546c2bb33424911","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6d6d8d87d7495052136a2b123e83b6de","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:18:05.674Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6e6a71895a0276f1308b2795: done: 0.014656 sec","job_status":"done","queue_duration_s":0.584052,"scheduling_latency_s":0.58407,"redis_calls":13,"redis_duration_s":0.0015179999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000525,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000993,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010098,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014656,"completed_at":"2026-08-13T13:18:06.272Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1513gitlab # [ 257.655372] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:18:06.274Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ea8217466d411f896205be34","created_at":"2026-08-13T13:18:05.576Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-9546c2bb33424911","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6d6d8d87d7495052136a2b123e83b6de","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:18:05.674Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ea8217466d411f896205be34: start","job_status":"start","queue_duration_s":0.599995,"scheduling_latency_s":0.600012}1514gitlab # [ 257.667913] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:18:06.289Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ea8217466d411f896205be34","created_at":"2026-08-13T13:18:05.576Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-9546c2bb33424911","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6d6d8d87d7495052136a2b123e83b6de","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:18:05.674Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ea8217466d411f896205be34: done: 0.015112 sec","job_status":"done","queue_duration_s":0.599995,"scheduling_latency_s":0.600012,"redis_calls":13,"redis_duration_s":0.001631,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00061,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001021,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010517,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015112,"completed_at":"2026-08-13T13:18:06.289Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1515gitlab # [ 257.708746] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:18:06.290Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"42ea897979e8ee61ef8e4fab","created_at":"2026-08-13T13:18:05.576Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-9546c2bb33424911","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6d6d8d87d7495052136a2b123e83b6de","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:18:05.674Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-42ea897979e8ee61ef8e4fab: start","job_status":"start","queue_duration_s":0.616671,"scheduling_latency_s":0.616689}1516gitlab # [ 257.721419] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:18:06.305Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"42ea897979e8ee61ef8e4fab","created_at":"2026-08-13T13:18:05.576Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-9546c2bb33424911","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6d6d8d87d7495052136a2b123e83b6de","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:18:05.674Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-42ea897979e8ee61ef8e4fab: done: 0.015194 sec","job_status":"done","queue_duration_s":0.616671,"scheduling_latency_s":0.616689,"redis_calls":13,"redis_duration_s":0.002558,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00082,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001738,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009766,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015194,"completed_at":"2026-08-13T13:18:06.305Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1517gitlab # [ 257.760520] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:18:06.307Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7add76bc280cca6b3b0e5a19","created_at":"2026-08-13T13:18:05.576Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-9546c2bb33424911","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6d6d8d87d7495052136a2b123e83b6de","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:18:05.674Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7add76bc280cca6b3b0e5a19: start","job_status":"start","queue_duration_s":0.633344,"scheduling_latency_s":0.63336}1518gitlab # [ 257.772669] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:18:06.323Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7add76bc280cca6b3b0e5a19","created_at":"2026-08-13T13:18:05.576Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-9546c2bb33424911","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6d6d8d87d7495052136a2b123e83b6de","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:18:05.674Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7add76bc280cca6b3b0e5a19: done: 0.015681 sec","job_status":"done","queue_duration_s":0.633344,"scheduling_latency_s":0.63336,"redis_calls":13,"redis_duration_s":0.0027949999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000925,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00187,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009941,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015681,"completed_at":"2026-08-13T13:18:06.323Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1519gitlab # [ 257.812639] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:18:06.324Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"760e8cb77f7454eae74d2bde","created_at":"2026-08-13T13:18:05.576Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-9546c2bb33424911","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6d6d8d87d7495052136a2b123e83b6de","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:18:05.674Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-760e8cb77f7454eae74d2bde: start","job_status":"start","queue_duration_s":0.65065,"scheduling_latency_s":0.650666}1520gitlab # [ 257.851216] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:18:06.340Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"760e8cb77f7454eae74d2bde","created_at":"2026-08-13T13:18:05.576Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-9546c2bb33424911","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6d6d8d87d7495052136a2b123e83b6de","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:18:05.674Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-760e8cb77f7454eae74d2bde: done: 0.015617 sec","job_status":"done","queue_duration_s":0.65065,"scheduling_latency_s":0.650666,"redis_calls":13,"redis_duration_s":0.0028060000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000961,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001845,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009988,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015617,"completed_at":"2026-08-13T13:18:06.340Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1521gitlab # [ 257.935657] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:18:06.341Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0482497277a4f3e33fd47f86","created_at":"2026-08-13T13:18:05.576Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-9546c2bb33424911","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6d6d8d87d7495052136a2b123e83b6de","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:18:05.674Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0482497277a4f3e33fd47f86: start","job_status":"start","queue_duration_s":0.667837,"scheduling_latency_s":0.667854}1522gitlab # [ 257.954622] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:18:06.357Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0482497277a4f3e33fd47f86","created_at":"2026-08-13T13:18:05.576Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-9546c2bb33424911","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6d6d8d87d7495052136a2b123e83b6de","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:18:05.674Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0482497277a4f3e33fd47f86: done: 0.015176 sec","job_status":"done","queue_duration_s":0.667837,"scheduling_latency_s":0.667854,"redis_calls":13,"redis_duration_s":0.002613,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000937,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001676,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009615,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015176,"completed_at":"2026-08-13T13:18:06.357Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1523gitlab # [ 257.999068] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:18:06.358Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d48376c48a2d652effe45173","created_at":"2026-08-13T13:18:05.576Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-9546c2bb33424911","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6d6d8d87d7495052136a2b123e83b6de","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:18:05.674Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d48376c48a2d652effe45173: start","job_status":"start","queue_duration_s":0.684447,"scheduling_latency_s":0.684463}1524gitlab # [ 258.011850] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:18:06.374Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d48376c48a2d652effe45173","created_at":"2026-08-13T13:18:05.576Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-9546c2bb33424911","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6d6d8d87d7495052136a2b123e83b6de","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:18:05.674Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d48376c48a2d652effe45173: done: 0.015499 sec","job_status":"done","queue_duration_s":0.684447,"scheduling_latency_s":0.684463,"redis_calls":13,"redis_duration_s":0.002693,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.0009,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001793,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009701,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015499,"completed_at":"2026-08-13T13:18:06.374Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1525gitlab # [ 258.051925] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:18:06.375Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"62361ddeadfd6b73456cc279","created_at":"2026-08-13T13:18:05.576Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-9546c2bb33424911","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6d6d8d87d7495052136a2b123e83b6de","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:18:05.674Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-62361ddeadfd6b73456cc279: start","job_status":"start","queue_duration_s":0.701312,"scheduling_latency_s":0.701327}1526gitlab # [ 258.064841] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:18:06.391Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"62361ddeadfd6b73456cc279","created_at":"2026-08-13T13:18:05.576Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-9546c2bb33424911","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6d6d8d87d7495052136a2b123e83b6de","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:18:05.674Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-62361ddeadfd6b73456cc279: done: 0.01588 sec","job_status":"done","queue_duration_s":0.701312,"scheduling_latency_s":0.701327,"redis_calls":13,"redis_duration_s":0.002849,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000975,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001874,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009742,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01588,"completed_at":"2026-08-13T13:18:06.391Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1527gitlab # [ 258.105945] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:18:06.392Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e0e9ea8bf04edd9c5a424795","created_at":"2026-08-13T13:18:05.576Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-9546c2bb33424911","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6d6d8d87d7495052136a2b123e83b6de","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:18:05.674Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e0e9ea8bf04edd9c5a424795: start","job_status":"start","queue_duration_s":0.718378,"scheduling_latency_s":0.718396}1528gitlab # [ 258.143594] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:18:06.408Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e0e9ea8bf04edd9c5a424795","created_at":"2026-08-13T13:18:05.576Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-9546c2bb33424911","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6d6d8d87d7495052136a2b123e83b6de","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:18:05.674Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e0e9ea8bf04edd9c5a424795: done: 0.016314 sec","job_status":"done","queue_duration_s":0.718378,"scheduling_latency_s":0.718396,"redis_calls":13,"redis_duration_s":0.001918,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000657,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001261,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011268,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016314,"completed_at":"2026-08-13T13:18:06.408Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1529gitlab # [ 258.222878] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:18:06.409Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9956787016e78ab0f284bfbd","created_at":"2026-08-13T13:18:05.576Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-9546c2bb33424911","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6d6d8d87d7495052136a2b123e83b6de","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:18:05.674Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9956787016e78ab0f284bfbd: start","job_status":"start","queue_duration_s":0.735826,"scheduling_latency_s":0.735843}1530gitlab # [ 258.238082] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:18:06.425Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9956787016e78ab0f284bfbd","created_at":"2026-08-13T13:18:05.576Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-9546c2bb33424911","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6d6d8d87d7495052136a2b123e83b6de","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:18:05.674Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9956787016e78ab0f284bfbd: done: 0.015187 sec","job_status":"done","queue_duration_s":0.735826,"scheduling_latency_s":0.735843,"redis_calls":13,"redis_duration_s":0.001532,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000576,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000956,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010211,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015187,"completed_at":"2026-08-13T13:18:06.425Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1531gitlab # [ 258.278852] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:18:06.426Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8d6bbd97c8c3dda4a30b3ce9","created_at":"2026-08-13T13:18:05.576Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-9546c2bb33424911","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6d6d8d87d7495052136a2b123e83b6de","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:18:05.674Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8d6bbd97c8c3dda4a30b3ce9: start","job_status":"start","queue_duration_s":0.752214,"scheduling_latency_s":0.752231}1532gitlab # [ 258.291578] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:18:06.456Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8d6bbd97c8c3dda4a30b3ce9","created_at":"2026-08-13T13:18:05.576Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-9546c2bb33424911","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6d6d8d87d7495052136a2b123e83b6de","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:18:05.674Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8d6bbd97c8c3dda4a30b3ce9: done: 0.030592 sec","job_status":"done","queue_duration_s":0.752214,"scheduling_latency_s":0.752231,"redis_calls":13,"redis_duration_s":0.004605,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002247,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002358,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022742,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.030592,"completed_at":"2026-08-13T13:18:06.456Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1533gitlab # [ 258.331509] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:18:06.459Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e974b39bd3f9ace928f0b7b3","created_at":"2026-08-13T13:18:05.576Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-9546c2bb33424911","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6d6d8d87d7495052136a2b123e83b6de","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:18:05.674Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e974b39bd3f9ace928f0b7b3: start","job_status":"start","queue_duration_s":0.785363,"scheduling_latency_s":0.785398}1534gitlab # [ 258.344183] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:18:06.485Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e974b39bd3f9ace928f0b7b3","created_at":"2026-08-13T13:18:05.576Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-9546c2bb33424911","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6d6d8d87d7495052136a2b123e83b6de","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:18:05.674Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e974b39bd3f9ace928f0b7b3: done: 0.026356 sec","job_status":"done","queue_duration_s":0.785363,"scheduling_latency_s":0.785398,"redis_calls":13,"redis_duration_s":0.002901,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001008,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001893,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017889,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.026356,"completed_at":"2026-08-13T13:18:06.485Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1535gitlab # [ 258.385047] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:18:06.487Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"469be7613e29892b9298b22e","created_at":"2026-08-13T13:18:05.576Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-9546c2bb33424911","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6d6d8d87d7495052136a2b123e83b6de","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:18:05.674Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-469be7613e29892b9298b22e: start","job_status":"start","queue_duration_s":0.813695,"scheduling_latency_s":0.813721}1536gitlab # [ 258.397492] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:18:06.510Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"469be7613e29892b9298b22e","created_at":"2026-08-13T13:18:05.576Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-9546c2bb33424911","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6d6d8d87d7495052136a2b123e83b6de","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:18:05.674Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-469be7613e29892b9298b22e: done: 0.023126 sec","job_status":"done","queue_duration_s":0.813695,"scheduling_latency_s":0.813721,"redis_calls":13,"redis_duration_s":0.002857,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000925,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001932,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015672,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.023126,"completed_at":"2026-08-13T13:18:06.510Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1537gitlab # [ 258.436969] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:18:06.512Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c2021d1397ce6f61f58a7b0a","created_at":"2026-08-13T13:18:05.576Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-9546c2bb33424911","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6d6d8d87d7495052136a2b123e83b6de","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:18:05.674Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c2021d1397ce6f61f58a7b0a: start","job_status":"start","queue_duration_s":0.838675,"scheduling_latency_s":0.838698}1538gitlab # [ 258.449430] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:18:06.535Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c2021d1397ce6f61f58a7b0a","created_at":"2026-08-13T13:18:05.576Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-9546c2bb33424911","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6d6d8d87d7495052136a2b123e83b6de","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:18:05.674Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c2021d1397ce6f61f58a7b0a: done: 0.022369 sec","job_status":"done","queue_duration_s":0.838675,"scheduling_latency_s":0.838698,"redis_calls":13,"redis_duration_s":0.003359,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001133,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002226,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014614,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.022369,"completed_at":"2026-08-13T13:18:06.535Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1539gitlab # [ 258.488563] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:18:06.537Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ff4ceacc5609f5b404b40d94","created_at":"2026-08-13T13:18:05.576Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-9546c2bb33424911","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6d6d8d87d7495052136a2b123e83b6de","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:18:05.674Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ff4ceacc5609f5b404b40d94: start","job_status":"start","queue_duration_s":0.862895,"scheduling_latency_s":0.862916}1540gitlab # [ 258.501015] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:18:06.630Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ff4ceacc5609f5b404b40d94","created_at":"2026-08-13T13:18:05.576Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-9546c2bb33424911","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6d6d8d87d7495052136a2b123e83b6de","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:18:05.674Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ff4ceacc5609f5b404b40d94: done: 0.093165 sec","job_status":"done","queue_duration_s":0.862895,"scheduling_latency_s":0.862916,"redis_calls":13,"redis_duration_s":0.003083,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001025,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002058,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012536,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.093165,"completed_at":"2026-08-13T13:18:06.630Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1541gitlab # [ 258.540385] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:18:06.631Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"448e4a93aaa3a5044d6b6050","created_at":"2026-08-13T13:18:05.576Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-9546c2bb33424911","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6d6d8d87d7495052136a2b123e83b6de","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:18:05.674Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-448e4a93aaa3a5044d6b6050: start","job_status":"start","queue_duration_s":0.957749,"scheduling_latency_s":0.957767}1542gitlab # [ 258.553823] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:18:06.650Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"448e4a93aaa3a5044d6b6050","created_at":"2026-08-13T13:18:05.576Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-9546c2bb33424911","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6d6d8d87d7495052136a2b123e83b6de","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:18:05.674Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-448e4a93aaa3a5044d6b6050: done: 0.01852 sec","job_status":"done","queue_duration_s":0.957749,"scheduling_latency_s":0.957767,"redis_calls":13,"redis_duration_s":0.0034000000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001069,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002331,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011817,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01852,"completed_at":"2026-08-13T13:18:06.650Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1543gitlab # [ 258.593064] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:18:06.651Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"11479f756ff882f64b83b63d","created_at":"2026-08-13T13:18:05.576Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-9546c2bb33424911","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6d6d8d87d7495052136a2b123e83b6de","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:18:05.674Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-11479f756ff882f64b83b63d: start","job_status":"start","queue_duration_s":0.977825,"scheduling_latency_s":0.977841}1544gitlab # [ 258.605486] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:18:06.667Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"11479f756ff882f64b83b63d","created_at":"2026-08-13T13:18:05.576Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-9546c2bb33424911","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6d6d8d87d7495052136a2b123e83b6de","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:18:05.674Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-11479f756ff882f64b83b63d: done: 0.015128 sec","job_status":"done","queue_duration_s":0.977825,"scheduling_latency_s":0.977841,"redis_calls":13,"redis_duration_s":0.002812,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000916,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001896,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009249,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015128,"completed_at":"2026-08-13T13:18:06.667Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1545gitlab # [ 258.644725] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:18:06.668Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6589860a1c5ff445a678961e","created_at":"2026-08-13T13:18:05.576Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-9546c2bb33424911","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6d6d8d87d7495052136a2b123e83b6de","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:18:05.674Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6589860a1c5ff445a678961e: start","job_status":"start","queue_duration_s":0.994272,"scheduling_latency_s":0.994287}1546gitlab # [ 258.657112] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:18:06.684Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6589860a1c5ff445a678961e","created_at":"2026-08-13T13:18:05.576Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-9546c2bb33424911","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6d6d8d87d7495052136a2b123e83b6de","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:18:05.674Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6589860a1c5ff445a678961e: done: 0.015697 sec","job_status":"done","queue_duration_s":0.994272,"scheduling_latency_s":0.994287,"redis_calls":13,"redis_duration_s":0.002712,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000927,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001785,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010133,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015697,"completed_at":"2026-08-13T13:18:06.684Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1547gitlab # [ 258.696728] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:18:06.685Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d01a9ac7764d3d367539c85b","created_at":"2026-08-13T13:18:05.576Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-9546c2bb33424911","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6d6d8d87d7495052136a2b123e83b6de","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:18:05.674Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d01a9ac7764d3d367539c85b: start","job_status":"start","queue_duration_s":1.011306,"scheduling_latency_s":1.01132}1548gitlab # [ 258.709191] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:18:06.704Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d01a9ac7764d3d367539c85b","created_at":"2026-08-13T13:18:05.576Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-9546c2bb33424911","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6d6d8d87d7495052136a2b123e83b6de","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:18:05.674Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d01a9ac7764d3d367539c85b: done: 0.018654 sec","job_status":"done","queue_duration_s":1.011306,"scheduling_latency_s":1.01132,"redis_calls":13,"redis_duration_s":0.0027879999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000936,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001852,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009137,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018654,"completed_at":"2026-08-13T13:18:06.704Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1549gitlab # [ 258.748982] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:18:06.706Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"272b7364e23f2c7b1b8ec5a7","created_at":"2026-08-13T13:18:05.576Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-9546c2bb33424911","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6d6d8d87d7495052136a2b123e83b6de","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:18:05.674Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-272b7364e23f2c7b1b8ec5a7: start","job_status":"start","queue_duration_s":1.032415,"scheduling_latency_s":1.032431}1550gitlab # [ 258.762640] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:18:06.722Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"272b7364e23f2c7b1b8ec5a7","created_at":"2026-08-13T13:18:05.576Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-9546c2bb33424911","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6d6d8d87d7495052136a2b123e83b6de","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:18:05.674Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-272b7364e23f2c7b1b8ec5a7: done: 0.015855 sec","job_status":"done","queue_duration_s":1.032415,"scheduling_latency_s":1.032431,"redis_calls":13,"redis_duration_s":0.00266,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000948,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001712,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010324,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015855,"completed_at":"2026-08-13T13:18:06.722Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1551gitlab # [ 274.938381] setup-gitlab-start[2982]: W, [2026-08-13T13:18:28.763633 #2982] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1552gitlab # [ 310.204148] redis[783]: 10 changes in 300 seconds. Saving...1553gitlab # [ 310.209808] redis[783]: Background saving started by pid 33091554gitlab # [ 310.214171] redis[3309]: BGSAVE done, 453 keys saved, 0 keys skipped, 117579 bytes written.1555gitlab # [ 310.218745] redis[3309]: DB saved on disk1556gitlab # [ 310.221036] redis[3309]: Fork CoW for RDB: current 0 MB, peak 0 MB, average 0 MB1557gitlab # [ 310.305271] redis[783]: Background saving terminated with success1558gitlab # [ 310.929571] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:19:04.752Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"faf018cbcf90c77cf73d3600","created_at":"2026-08-13T13:19:04.669Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-20120ecbeb694008","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d1ac22b94572c937baad571332147a8c","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-13T13:19:04.748Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-faf018cbcf90c77cf73d3600: start","job_status":"start","queue_duration_s":0.003677,"scheduling_latency_s":0.003741}1559gitlab # [ 311.186263] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:19:05.011Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"faf018cbcf90c77cf73d3600","created_at":"2026-08-13T13:19:04.669Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-20120ecbeb694008","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d1ac22b94572c937baad571332147a8c","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-13T13:19:04.748Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-faf018cbcf90c77cf73d3600: done: 0.25903 sec","job_status":"done","queue_duration_s":0.003677,"scheduling_latency_s":0.003741,"redis_calls":16,"redis_duration_s":0.020751,"redis_read_bytes":1033,"redis_write_bytes":1217,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.004973,"redis_feature_flag_read_bytes":1024,"redis_feature_flag_write_bytes":532,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.010611,"redis_queues_metadata_read_bytes":8,"redis_queues_metadata_write_bytes":477,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.005167,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":208,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.108,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.108,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.051174,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.25903,"completed_at":"2026-08-13T13:19:05.011Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.124865,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1560gitlab # [ 311.281218] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:19:05.022Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"49973bed39ec3b737d8f3e04","created_at":"2026-08-13T13:19:04.782Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-20120ecbeb694008","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d09c0dc3d0c77d6896fa540b9854f9f4","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-13T13:19:04.809Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-49973bed39ec3b737d8f3e04: start","job_status":"start","queue_duration_s":0.213516,"scheduling_latency_s":0.213569}1561gitlab # [ 311.782415] postgres[858]: [858] LOG: checkpoint starting: time1562gitlab # [ 312.291286] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:19:06.115Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"49973bed39ec3b737d8f3e04","created_at":"2026-08-13T13:19:04.782Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-20120ecbeb694008","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d09c0dc3d0c77d6896fa540b9854f9f4","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-13T13:19:04.809Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-49973bed39ec3b737d8f3e04: done: 1.093247 sec","job_status":"done","queue_duration_s":0.213516,"scheduling_latency_s":0.213569,"redis_calls":563,"redis_duration_s":0.5709609999999999,"redis_read_bytes":688,"redis_write_bytes":48843,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.001723,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":83,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.015789,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":470,"redis_shared_state_calls":557,"redis_shared_state_duration_s":0.553449,"redis_shared_state_read_bytes":556,"redis_shared_state_write_bytes":48290,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.596542,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":1.093247,"completed_at":"2026-08-13T13:19:06.115Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1563gitlab # [ 312.384917] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:19:06.119Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"e6c5dd12691a8618183cdc2e","created_at":"2026-08-13T13:19:04.897Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-20120ecbeb694008","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"cc8e2e8bfbf72cda2954722f8c8af530","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-13T13:19:04.903Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-e6c5dd12691a8618183cdc2e: start","job_status":"start","queue_duration_s":1.215957,"scheduling_latency_s":1.216018}1564gitlab # [ 312.703899] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:19:06.529Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"e6c5dd12691a8618183cdc2e","created_at":"2026-08-13T13:19:04.897Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-20120ecbeb694008","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"cc8e2e8bfbf72cda2954722f8c8af530","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-13T13:19:04.903Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-e6c5dd12691a8618183cdc2e: done: 0.409728 sec","job_status":"done","queue_duration_s":1.215957,"scheduling_latency_s":1.216018,"redis_calls":11,"redis_duration_s":0.0044480000000000006,"redis_read_bytes":263,"redis_write_bytes":1138,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000572,"redis_feature_flag_read_bytes":256,"redis_feature_flag_write_bytes":151,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001923,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":476,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001953,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":511,"db_count":129,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":129,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.066,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":129,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":84,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.066,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.303531,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00152802,"exclusive_lock_hold_duration_s":0.37309316,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"ci","turbo_mode":false},"duration_s":0.409728,"completed_at":"2026-08-13T13:19:06.528Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.129369,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1565gitlab # [ 312.749844] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:19:06.532Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"aa0ce9ed997afe33f8f7d904","created_at":"2026-08-13T13:19:04.909Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-20120ecbeb694008","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0c1dcde04288dcb62addcc390a7aece6","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-13T13:19:04.914Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-aa0ce9ed997afe33f8f7d904: start","job_status":"start","queue_duration_s":1.617905,"scheduling_latency_s":1.61795}1566gitlab # [ 312.774857] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:19:06.600Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"aa0ce9ed997afe33f8f7d904","created_at":"2026-08-13T13:19:04.909Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-20120ecbeb694008","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0c1dcde04288dcb62addcc390a7aece6","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-13T13:19:04.914Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-aa0ce9ed997afe33f8f7d904: done: 0.067889 sec","job_status":"done","queue_duration_s":1.617905,"scheduling_latency_s":1.61795,"redis_calls":10,"redis_duration_s":0.003511,"redis_read_bytes":135,"redis_write_bytes":1267,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000252,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":105,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001718,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":551,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001541,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":611,"db_count":6,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.014,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.014,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.038239,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.0009914,"exclusive_lock_hold_duration_s":0.0358907,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.067889,"completed_at":"2026-08-13T13:19:06.600Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.01988,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1567gitlab # [ 312.819760] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:19:06.603Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"7b0e6061a77924332d8a6b49","created_at":"2026-08-13T13:19:04.927Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-20120ecbeb694008","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"eb9112c454133bebbea155fe1bfbb26e","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-13T13:19:04.933Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-7b0e6061a77924332d8a6b49: start","job_status":"start","queue_duration_s":1.670197,"scheduling_latency_s":1.670236}1568gitlab # [ 312.833968] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:19:06.652Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"7b0e6061a77924332d8a6b49","created_at":"2026-08-13T13:19:04.927Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-20120ecbeb694008","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"eb9112c454133bebbea155fe1bfbb26e","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-13T13:19:04.933Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-7b0e6061a77924332d8a6b49: done: 0.048745 sec","job_status":"done","queue_duration_s":1.670197,"scheduling_latency_s":1.670236,"redis_calls":11,"redis_duration_s":0.003662,"redis_read_bytes":517,"redis_write_bytes":1011,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001362,"redis_feature_flag_read_bytes":512,"redis_feature_flag_write_bytes":300,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001696,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":491,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000604,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":220,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.015,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.015,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024139,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.048745,"completed_at":"2026-08-13T13:19:06.652Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.015419,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1569gitlab # [ 312.876279] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:19:06.654Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"9533f924e8f00170d9619b7d","created_at":"2026-08-13T13:19:04.949Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-20120ecbeb694008","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"675458ab94ebaf49293ff47db7a0f0ce","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-13T13:19:04.964Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-9533f924e8f00170d9619b7d: start","job_status":"start","queue_duration_s":1.690865,"scheduling_latency_s":1.690899}1570gitlab # [ 312.891184] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:19:06.678Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"9533f924e8f00170d9619b7d","created_at":"2026-08-13T13:19:04.949Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-20120ecbeb694008","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"675458ab94ebaf49293ff47db7a0f0ce","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-13T13:19:04.964Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-9533f924e8f00170d9619b7d: done: 0.023249 sec","job_status":"done","queue_duration_s":1.690865,"scheduling_latency_s":1.690899,"redis_calls":10,"redis_duration_s":0.002051,"redis_read_bytes":389,"redis_write_bytes":1014,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000527,"redis_feature_flag_read_bytes":384,"redis_feature_flag_write_bytes":238,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001106,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000418,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":246,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015562,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.023249,"completed_at":"2026-08-13T13:19:06.678Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1571gitlab # [ 312.932915] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:19:06.679Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"a63179d9803355bacae7e58a","created_at":"2026-08-13T13:19:05.003Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-20120ecbeb694008","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"226172431b800c9cd2f95d59d2b51487","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-13T13:19:05.028Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-a63179d9803355bacae7e58a: start","job_status":"start","queue_duration_s":1.651613,"scheduling_latency_s":1.651636}1572gitlab # [ 312.947637] gitaly[895]: time="2026-08-13T13:19:06.717Z" level=info msg="burden monitor stats" pid=8951573gitlab # [ 312.948986] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:19:06.709Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"a63179d9803355bacae7e58a","created_at":"2026-08-13T13:19:05.003Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-20120ecbeb694008","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"226172431b800c9cd2f95d59d2b51487","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-13T13:19:05.028Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-a63179d9803355bacae7e58a: done: 0.030102 sec","job_status":"done","queue_duration_s":1.651613,"scheduling_latency_s":1.651636,"redis_calls":11,"redis_duration_s":0.002056,"redis_read_bytes":136,"redis_write_bytes":1339,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000149,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":100,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001104,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":636,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000803,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":603,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019212,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00920386,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.030102,"completed_at":"2026-08-13T13:19:06.709Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005341,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1574gitlab # [ 312.992615] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:19:06.712Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"ec0b793d23989fa5de3c91dd","created_at":"2026-08-13T13:19:05.064Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-20120ecbeb694008","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"da318ce3a631f8a78ca34694dd764dda","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-13T13:19:05.086Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-ec0b793d23989fa5de3c91dd: start","job_status":"start","queue_duration_s":1.625722,"scheduling_latency_s":1.625744}1575gitlab # [ 313.006087] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:19:06.736Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"ec0b793d23989fa5de3c91dd","created_at":"2026-08-13T13:19:05.064Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-20120ecbeb694008","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"da318ce3a631f8a78ca34694dd764dda","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-13T13:19:05.086Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-ec0b793d23989fa5de3c91dd: done: 0.024518 sec","job_status":"done","queue_duration_s":1.625722,"scheduling_latency_s":1.625744,"redis_calls":10,"redis_duration_s":0.0029649999999999998,"redis_read_bytes":135,"redis_write_bytes":1167,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000189,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":95,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001424,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001352,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":560,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015341,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00089172,"exclusive_lock_hold_duration_s":0.00552242,"duration_s":0.024518,"completed_at":"2026-08-13T13:19:06.736Z","load_balancing_strategy":"primary","db_duration_s":0.002338,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1576gitlab # [ 313.047605] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:19:06.738Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"c65f9f58bdc0d0d3ce7dff60","created_at":"2026-08-13T13:19:05.113Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-20120ecbeb694008","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fed89527502353db44a224e3a7b63158","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-13T13:19:05.128Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-c65f9f58bdc0d0d3ce7dff60: start","job_status":"start","queue_duration_s":1.609905,"scheduling_latency_s":1.609926}1577gitlab # [ 313.062857] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:19:06.759Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"c65f9f58bdc0d0d3ce7dff60","created_at":"2026-08-13T13:19:05.113Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-20120ecbeb694008","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fed89527502353db44a224e3a7b63158","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-13T13:19:05.128Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-c65f9f58bdc0d0d3ce7dff60: done: 0.021651 sec","job_status":"done","queue_duration_s":1.609905,"scheduling_latency_s":1.609926,"redis_calls":10,"redis_duration_s":0.00174,"redis_read_bytes":135,"redis_write_bytes":1184,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000146,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":97,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000836,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000758,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":566,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013922,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.0006532,"exclusive_lock_hold_duration_s":0.0045773,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.021651,"completed_at":"2026-08-13T13:19:06.759Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001922,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1578gitlab # [ 313.105818] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:19:06.761Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"24fb2bb385e8b162e0d8a674","created_at":"2026-08-13T13:19:05.210Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-20120ecbeb694008","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"39c8f4ee887349b90bbf7731351deae4","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-13T13:19:05.225Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-24fb2bb385e8b162e0d8a674: start","job_status":"start","queue_duration_s":1.536028,"scheduling_latency_s":1.536047}1579gitlab # [ 313.120046] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:19:06.770Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0}1580gitlab # [ 313.123417] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:19:06.776Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"24fb2bb385e8b162e0d8a674","created_at":"2026-08-13T13:19:05.210Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-20120ecbeb694008","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"39c8f4ee887349b90bbf7731351deae4","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-13T13:19:05.225Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-24fb2bb385e8b162e0d8a674: done: 0.015146 sec","job_status":"done","queue_duration_s":1.536028,"scheduling_latency_s":1.536047,"redis_calls":8,"redis_duration_s":0.001297,"redis_read_bytes":133,"redis_write_bytes":867,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000138,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":101,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000809,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":524,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00035,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":242,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010084,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015146,"completed_at":"2026-08-13T13:19:06.776Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1581gitlab # [ 313.165341] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:19:06.777Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"6a63e31d9c90231413556e90","created_at":"2026-08-13T13:19:05.267Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-20120ecbeb694008","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"207a026cc1fa8f7529ea3efa109339d3","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-13T13:19:05.279Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-6a63e31d9c90231413556e90: start","job_status":"start","queue_duration_s":1.498258,"scheduling_latency_s":1.498275}1582gitlab # [ 313.178695] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:19:06.786Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0}1583gitlab # [ 313.182443] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:19:06.791Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"6a63e31d9c90231413556e90","created_at":"2026-08-13T13:19:05.267Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-20120ecbeb694008","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"207a026cc1fa8f7529ea3efa109339d3","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-13T13:19:05.279Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-6a63e31d9c90231413556e90: done: 0.01357 sec","job_status":"done","queue_duration_s":1.498258,"scheduling_latency_s":1.498275,"redis_calls":8,"redis_duration_s":0.001096,"redis_read_bytes":133,"redis_write_bytes":908,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000128,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":107,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000698,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":545,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00027,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":256,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008919,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01357,"completed_at":"2026-08-13T13:19:06.791Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1584gitlab # [ 313.222864] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:19:06.792Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"772680aab02498ef56632ece","created_at":"2026-08-13T13:19:05.312Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-20120ecbeb694008","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e313351e26c65e95b14d8d6b915e56f9","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-13T13:19:05.325Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-772680aab02498ef56632ece: start","job_status":"start","queue_duration_s":1.467382,"scheduling_latency_s":1.467398}1585gitlab # [ 313.237568] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:19:06.842Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"772680aab02498ef56632ece","created_at":"2026-08-13T13:19:05.312Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-20120ecbeb694008","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e313351e26c65e95b14d8d6b915e56f9","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-13T13:19:05.325Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-772680aab02498ef56632ece: done: 0.050404 sec","job_status":"done","queue_duration_s":1.467382,"scheduling_latency_s":1.467398,"redis_calls":10,"redis_duration_s":0.0015220000000000001,"redis_read_bytes":135,"redis_write_bytes":1275,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000115,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":106,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000711,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000696,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":615,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.024,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.024,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021761,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00059512,"exclusive_lock_hold_duration_s":0.02648628,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.050404,"completed_at":"2026-08-13T13:19:06.842Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.025356,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1586gitlab # [ 313.282902] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:19:06.844Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"5dda41012a32c72d4b0c6855","created_at":"2026-08-13T13:19:05.349Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-20120ecbeb694008","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ffd29d11c352447fea2c10e937eb21f0","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-13T13:19:05.362Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-5dda41012a32c72d4b0c6855: start","job_status":"start","queue_duration_s":1.481376,"scheduling_latency_s":1.481394}1587gitlab # [ 313.297888] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:19:06.853Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0}1588gitlab # [ 313.301309] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:19:06.858Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"5dda41012a32c72d4b0c6855","created_at":"2026-08-13T13:19:05.349Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-20120ecbeb694008","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ffd29d11c352447fea2c10e937eb21f0","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-13T13:19:05.362Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-5dda41012a32c72d4b0c6855: done: 0.014438 sec","job_status":"done","queue_duration_s":1.481376,"scheduling_latency_s":1.481394,"redis_calls":8,"redis_duration_s":0.00122,"redis_read_bytes":133,"redis_write_bytes":937,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.00013,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":111,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000779,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000311,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009349,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.014438,"completed_at":"2026-08-13T13:19:06.858Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1589gitlab # [ 313.343271] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:19:06.859Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"13e9bbbc4720330c3c21c3d0","created_at":"2026-08-13T13:19:05.438Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-20120ecbeb694008","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"82f33e4b1d4bad3e9bff9836432ea9a3","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-13T13:19:05.449Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-13e9bbbc4720330c3c21c3d0: start","job_status":"start","queue_duration_s":1.41054,"scheduling_latency_s":1.410556}1590gitlab # [ 313.357730] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:19:06.867Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0}1591gitlab # [ 313.360900] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:19:06.872Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"13e9bbbc4720330c3c21c3d0","created_at":"2026-08-13T13:19:05.438Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-20120ecbeb694008","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"82f33e4b1d4bad3e9bff9836432ea9a3","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-13T13:19:05.449Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-13e9bbbc4720330c3c21c3d0: done: 0.012697 sec","job_status":"done","queue_duration_s":1.41054,"scheduling_latency_s":1.410556,"redis_calls":8,"redis_duration_s":0.001041,"redis_read_bytes":133,"redis_write_bytes":873,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000114,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":102,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00066,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000267,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008329,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.012697,"completed_at":"2026-08-13T13:19:06.872Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1592gitlab # [ 313.402323] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:19:06.873Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"1ded99c7aec8a5a98349a218","created_at":"2026-08-13T13:19:05.477Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-20120ecbeb694008","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5d9ac2e83bb0ee53f06f1173a93fc337","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-08-13T13:19:05.487Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-1ded99c7aec8a5a98349a218: start","job_status":"start","queue_duration_s":1.386473,"scheduling_latency_s":1.386489}1593gitlab # [ 313.416179] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:19:06.900Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"1ded99c7aec8a5a98349a218","created_at":"2026-08-13T13:19:05.477Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-20120ecbeb694008","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5d9ac2e83bb0ee53f06f1173a93fc337","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-08-13T13:19:05.487Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-1ded99c7aec8a5a98349a218: done: 0.027004 sec","job_status":"done","queue_duration_s":1.386473,"scheduling_latency_s":1.386489,"redis_calls":16,"redis_duration_s":0.002146,"redis_read_bytes":272,"redis_write_bytes":4229,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000246,"redis_feature_flag_read_bytes":256,"redis_feature_flag_write_bytes":199,"redis_queues_calls":2,"redis_queues_duration_s":0.000234,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3019,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.00124,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":727,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000426,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":284,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020345,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.027004,"completed_at":"2026-08-13T13:19:06.900Z","load_balancing_strategy":"primary","db_duration_s":0.002159,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1594gitlab # [ 313.458378] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:19:06.901Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"76415cc0b3206f4897970ba7","created_at":"2026-08-13T13:19:05.500Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-20120ecbeb694008","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d06a70e981e3695464b6d8eab1494e65","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-13T13:19:05.510Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-76415cc0b3206f4897970ba7: start","job_status":"start","queue_duration_s":1.391182,"scheduling_latency_s":1.391198}1595gitlab # [ 313.471656] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:19:06.927Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"76415cc0b3206f4897970ba7","created_at":"2026-08-13T13:19:05.500Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-20120ecbeb694008","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d06a70e981e3695464b6d8eab1494e65","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-13T13:19:05.510Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-76415cc0b3206f4897970ba7: done: 0.025686 sec","job_status":"done","queue_duration_s":1.391182,"scheduling_latency_s":1.391198,"redis_calls":8,"redis_duration_s":0.00221,"redis_read_bytes":133,"redis_write_bytes":836,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000259,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":95,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00169,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000261,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017901,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.025686,"completed_at":"2026-08-13T13:19:06.927Z","load_balancing_strategy":"primary","db_duration_s":0.002976,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1596gitlab # [ 313.513267] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:19:06.928Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"1660e480cb47fc7e040981d3","created_at":"2026-08-13T13:19:05.535Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-20120ecbeb694008","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a67c93ee33e20a7a2d015b8ad33e47c4","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-13T13:19:05.544Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-1660e480cb47fc7e040981d3: start","job_status":"start","queue_duration_s":1.384311,"scheduling_latency_s":1.384327}1597gitlab # [ 313.528175] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:19:06.936Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0}1598gitlab # [ 313.531914] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:19:06.941Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"1660e480cb47fc7e040981d3","created_at":"2026-08-13T13:19:05.535Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-20120ecbeb694008","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a67c93ee33e20a7a2d015b8ad33e47c4","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-13T13:19:05.544Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-1660e480cb47fc7e040981d3: done: 0.012655 sec","job_status":"done","queue_duration_s":1.384311,"scheduling_latency_s":1.384327,"redis_calls":8,"redis_duration_s":0.00107,"redis_read_bytes":133,"redis_write_bytes":931,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000114,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":110,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000681,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":557,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000275,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":264,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008342,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.012655,"completed_at":"2026-08-13T13:19:06.941Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1599gitlab # [ 313.574417] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:19:06.942Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Projects::ScheduleRefreshBuildArtifactsSizeStatisticsWorker","jid":"043f59e0fc2b1605144dbb80","created_at":"2026-08-13T13:19:05.561Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-20120ecbeb694008","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2cb2f11003d5c667716e9f24e1e644c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:805014656d48c4962f83ad00758ac8cfab4de244cfbd1d771454e66bd9018911","size_limiter":"validated","enqueued_at":"2026-08-13T13:19:05.578Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ScheduleRefreshBuildArtifactsSizeStatisticsWorker JID-043f59e0fc2b1605144dbb80: start","job_status":"start","queue_duration_s":1.364247,"scheduling_latency_s":1.364263}1600gitlab # [ 313.588178] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:19:06.978Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Projects::ScheduleRefreshBuildArtifactsSizeStatisticsWorker","jid":"043f59e0fc2b1605144dbb80","created_at":"2026-08-13T13:19:05.561Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-20120ecbeb694008","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2cb2f11003d5c667716e9f24e1e644c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:805014656d48c4962f83ad00758ac8cfab4de244cfbd1d771454e66bd9018911","size_limiter":"validated","enqueued_at":"2026-08-13T13:19:05.578Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ScheduleRefreshBuildArtifactsSizeStatisticsWorker JID-043f59e0fc2b1605144dbb80: done: 0.035786 sec","job_status":"done","queue_duration_s":1.364247,"scheduling_latency_s":1.364263,"redis_calls":20,"redis_duration_s":0.003005,"redis_read_bytes":19,"redis_write_bytes":3248,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.001505,"redis_feature_flag_read_bytes":8,"redis_feature_flag_write_bytes":1346,"redis_queues_calls":2,"redis_queues_duration_s":0.000239,"redis_queues_read_bytes":2,"redis_queues_write_bytes":818,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.000845,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":734,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000416,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":350,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023634,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00025404,"duration_s":0.035786,"completed_at":"2026-08-13T13:19:06.978Z","load_balancing_strategy":"primary","db_duration_s":0.002639,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1601gitlab # [ 313.631135] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:19:06.979Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"6a0c7272e3549a3076891e27","created_at":"2026-08-13T13:19:05.604Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-20120ecbeb694008","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"627d60bc3bea53489e269501a7a22b55","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-13T13:19:05.612Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-6a0c7272e3549a3076891e27: start","job_status":"start","queue_duration_s":1.367121,"scheduling_latency_s":1.367138}1602gitlab # [ 313.645630] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:19:06.992Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"6a0c7272e3549a3076891e27","created_at":"2026-08-13T13:19:05.604Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-20120ecbeb694008","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"627d60bc3bea53489e269501a7a22b55","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-13T13:19:05.612Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-6a0c7272e3549a3076891e27: done: 0.013146 sec","job_status":"done","queue_duration_s":1.367121,"scheduling_latency_s":1.367138,"redis_calls":8,"redis_duration_s":0.0010769999999999998,"redis_read_bytes":133,"redis_write_bytes":943,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000116,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":112,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000694,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":563,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000267,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":268,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008868,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013146,"completed_at":"2026-08-13T13:19:06.992Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1603gitlab # [ 313.687832] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:19:06.993Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"f139c3e1070f8fd552f94259","created_at":"2026-08-13T13:19:05.634Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-20120ecbeb694008","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"16764129323228e2fa3e2c96eb87516e","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-13T13:19:05.648Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-f139c3e1070f8fd552f94259: start","job_status":"start","queue_duration_s":1.345149,"scheduling_latency_s":1.345166}1604gitlab # [ 313.702411] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:19:07.001Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0}1605gitlab # [ 313.705712] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:19:07.006Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"f139c3e1070f8fd552f94259","created_at":"2026-08-13T13:19:05.634Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-20120ecbeb694008","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"16764129323228e2fa3e2c96eb87516e","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-13T13:19:05.648Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-f139c3e1070f8fd552f94259: done: 0.01315 sec","job_status":"done","queue_duration_s":1.345149,"scheduling_latency_s":1.345166,"redis_calls":8,"redis_duration_s":0.0011229999999999999,"redis_read_bytes":133,"redis_write_bytes":914,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000134,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":108,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000708,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":548,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000281,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":258,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008555,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01315,"completed_at":"2026-08-13T13:19:07.006Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1606gitlab # [ 313.746470] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:19:07.007Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"b201b6e351323e8afcb3e217","created_at":"2026-08-13T13:19:05.691Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-20120ecbeb694008","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"078ffdd6e4c7e4886b468af288dd5b11","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-13T13:19:05.710Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-b201b6e351323e8afcb3e217: start","job_status":"start","queue_duration_s":1.297143,"scheduling_latency_s":1.297159}1607gitlab # [ 313.760441] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:19:07.039Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"b201b6e351323e8afcb3e217","created_at":"2026-08-13T13:19:05.691Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-20120ecbeb694008","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"078ffdd6e4c7e4886b468af288dd5b11","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-13T13:19:05.710Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-b201b6e351323e8afcb3e217: done: 0.031641 sec","job_status":"done","queue_duration_s":1.297143,"scheduling_latency_s":1.297159,"redis_calls":8,"redis_duration_s":0.001363,"redis_read_bytes":133,"redis_write_bytes":936,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000119,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":110,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000985,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000259,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.017,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.017,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009872,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.031641,"completed_at":"2026-08-13T13:19:07.039Z","load_balancing_strategy":"primary","db_duration_s":0.017323,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1608gitlab # [ 313.802418] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:19:07.040Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"5d905b9dd792ef0387c2d63f","created_at":"2026-08-13T13:19:05.733Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-20120ecbeb694008","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b723ee0de0757a4e78f15006c1188928","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-13T13:19:05.747Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-5d905b9dd792ef0387c2d63f: start","job_status":"start","queue_duration_s":1.293547,"scheduling_latency_s":1.293564}1609gitlab # [ 313.815953] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:19:07.136Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"5d905b9dd792ef0387c2d63f","created_at":"2026-08-13T13:19:05.733Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-20120ecbeb694008","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b723ee0de0757a4e78f15006c1188928","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-13T13:19:05.747Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-5d905b9dd792ef0387c2d63f: done: 0.095302 sec","job_status":"done","queue_duration_s":1.293547,"scheduling_latency_s":1.293564,"redis_calls":65,"redis_duration_s":0.014665,"redis_read_bytes":748,"redis_write_bytes":41502,"redis_feature_flag_calls":5,"redis_feature_flag_duration_s":0.000664,"redis_feature_flag_read_bytes":640,"redis_feature_flag_write_bytes":393,"redis_queues_calls":2,"redis_queues_duration_s":0.000825,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37485,"redis_queues_metadata_calls":55,"redis_queues_metadata_duration_s":0.012671,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3324,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000505,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":300,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.082456,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.095302,"completed_at":"2026-08-13T13:19:07.135Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1610gitlab # [ 313.858773] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:19:07.137Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"0eb7b74de6a45e5df93230f7","created_at":"2026-08-13T13:19:06.885Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-2472c0c783994bce","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"5d9ac2e83bb0ee53f06f1173a93fc337","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:19:06.895Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-0eb7b74de6a45e5df93230f7: start","job_status":"start","queue_duration_s":0.241597,"scheduling_latency_s":0.241618}1611gitlab # [ 313.870982] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:19:07.149Z","message":"No existing merge request to be cleaned up."}1612gitlab # [ 313.872663] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:19:07.158Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"0eb7b74de6a45e5df93230f7","created_at":"2026-08-13T13:19:06.885Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-2472c0c783994bce","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"5d9ac2e83bb0ee53f06f1173a93fc337","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:19:06.895Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-0eb7b74de6a45e5df93230f7: done: 0.021615 sec","job_status":"done","queue_duration_s":0.241597,"scheduling_latency_s":0.241618,"redis_calls":11,"redis_duration_s":0.001844,"redis_read_bytes":136,"redis_write_bytes":1104,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000119,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":82,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000909,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000816,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014308,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.021615,"completed_at":"2026-08-13T13:19:07.158Z","load_balancing_strategy":"primary","db_duration_s":0.003028,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1613gitlab # [ 313.913706] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:19:07.160Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"c230177696f5c119a241faf2","created_at":"2026-08-13T13:19:06.885Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-2472c0c783994bce","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"5d9ac2e83bb0ee53f06f1173a93fc337","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:19:06.895Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-c230177696f5c119a241faf2: start","job_status":"start","queue_duration_s":0.26436,"scheduling_latency_s":0.264378}1614gitlab # [ 313.925768] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:19:07.171Z","message":"No existing merge request to be cleaned up."}1615gitlab # [ 313.927410] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:19:07.179Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"c230177696f5c119a241faf2","created_at":"2026-08-13T13:19:06.885Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-2472c0c783994bce","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"5d9ac2e83bb0ee53f06f1173a93fc337","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:19:06.895Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-c230177696f5c119a241faf2: done: 0.019977 sec","job_status":"done","queue_duration_s":0.26436,"scheduling_latency_s":0.264378,"redis_calls":10,"redis_duration_s":0.001415,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000594,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000821,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013086,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019977,"completed_at":"2026-08-13T13:19:07.179Z","load_balancing_strategy":"primary","db_duration_s":0.003178,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1616gitlab # [ 313.966147] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:19:07.181Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"efbac1c6e080c334ff9c02e6","created_at":"2026-08-13T13:19:06.885Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-2472c0c783994bce","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"5d9ac2e83bb0ee53f06f1173a93fc337","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:19:06.895Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-efbac1c6e080c334ff9c02e6: start","job_status":"start","queue_duration_s":0.285458,"scheduling_latency_s":0.285474}1617gitlab # [ 313.978490] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:19:07.194Z","message":"No existing merge request to be cleaned up."}1618gitlab # [ 313.980157] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:19:07.202Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"efbac1c6e080c334ff9c02e6","created_at":"2026-08-13T13:19:06.885Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-2472c0c783994bce","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"5d9ac2e83bb0ee53f06f1173a93fc337","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:19:06.895Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-efbac1c6e080c334ff9c02e6: done: 0.021649 sec","job_status":"done","queue_duration_s":0.285458,"scheduling_latency_s":0.285474,"redis_calls":10,"redis_duration_s":0.003646,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000627,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.003019,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012883,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.021649,"completed_at":"2026-08-13T13:19:07.202Z","load_balancing_strategy":"primary","db_duration_s":0.00313,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1619gitlab # [ 314.018180] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:19:07.203Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"b29d4c029253c93cfe79d2d8","created_at":"2026-08-13T13:19:06.885Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-2472c0c783994bce","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"5d9ac2e83bb0ee53f06f1173a93fc337","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:19:06.895Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-b29d4c029253c93cfe79d2d8: start","job_status":"start","queue_duration_s":0.308192,"scheduling_latency_s":0.308208}1620gitlab # [ 314.030180] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:19:07.216Z","message":"No existing merge request to be cleaned up."}1621gitlab # [ 314.031721] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:19:07.224Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"b29d4c029253c93cfe79d2d8","created_at":"2026-08-13T13:19:06.885Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-2472c0c783994bce","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"5d9ac2e83bb0ee53f06f1173a93fc337","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:19:06.895Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-b29d4c029253c93cfe79d2d8: done: 0.020411 sec","job_status":"done","queue_duration_s":0.308192,"scheduling_latency_s":0.308208,"redis_calls":10,"redis_duration_s":0.001393,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000561,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000832,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012811,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020411,"completed_at":"2026-08-13T13:19:07.224Z","load_balancing_strategy":"primary","db_duration_s":0.004372,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1622gitlab # [ 314.070090] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:19:07.225Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Projects::RefreshBuildArtifactsSizeStatisticsWorker","args":[],"jid":"ea29aff3c4552e6765e8f9ab","created_at":"2026-08-13T13:19:06.960Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-e2f55050037346da","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Projects::ScheduleRefreshBuildArtifactsSizeStatisticsWorker","correlation_id":"2cb2f11003d5c667716e9f24e1e644c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:19:06.971Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::RefreshBuildArtifactsSizeStatisticsWorker JID-ea29aff3c4552e6765e8f9ab: start","job_status":"start","queue_duration_s":0.25413,"scheduling_latency_s":0.254147}1623gitlab # [ 314.082799] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:19:07.304Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Projects::RefreshBuildArtifactsSizeStatisticsWorker","args":[],"jid":"ea29aff3c4552e6765e8f9ab","created_at":"2026-08-13T13:19:06.960Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-e2f55050037346da","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Projects::ScheduleRefreshBuildArtifactsSizeStatisticsWorker","correlation_id":"2cb2f11003d5c667716e9f24e1e644c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:19:06.971Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::RefreshBuildArtifactsSizeStatisticsWorker JID-ea29aff3c4552e6765e8f9ab: done: 0.079372 sec","job_status":"done","queue_duration_s":0.25413,"scheduling_latency_s":0.254147,"redis_calls":13,"redis_duration_s":0.003053,"redis_read_bytes":12,"redis_write_bytes":1665,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00028,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":345,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001146,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":519,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001627,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":801,"db_count":4,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.017,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.017,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.060557,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00053728,"duration_s":0.079372,"completed_at":"2026-08-13T13:19:07.304Z","load_balancing_strategy":"primary","db_duration_s":0.009795,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1624gitlab # [ 314.125122] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:19:07.306Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"849466c2ba366b1d55149b06","created_at":"2026-08-13T13:19:07.051Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-5eb263a62f8b4fc4","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b723ee0de0757a4e78f15006c1188928","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:19:07.128Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-849466c2ba366b1d55149b06: start","job_status":"start","queue_duration_s":0.177887,"scheduling_latency_s":0.177913}1625gitlab # [ 314.137587] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:19:07.328Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"849466c2ba366b1d55149b06","created_at":"2026-08-13T13:19:07.051Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-5eb263a62f8b4fc4","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b723ee0de0757a4e78f15006c1188928","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:19:07.128Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-849466c2ba366b1d55149b06: done: 0.021483 sec","job_status":"done","queue_duration_s":0.177887,"scheduling_latency_s":0.177913,"redis_calls":14,"redis_duration_s":0.002253,"redis_read_bytes":138,"redis_write_bytes":1242,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000166,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":85,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000734,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001353,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014731,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.021483,"completed_at":"2026-08-13T13:19:07.327Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1626gitlab # [ 314.178373] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:19:07.331Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cda1882a0ff1e8f3a63c5d9e","created_at":"2026-08-13T13:19:07.051Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-5eb263a62f8b4fc4","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b723ee0de0757a4e78f15006c1188928","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:19:07.128Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cda1882a0ff1e8f3a63c5d9e: start","job_status":"start","queue_duration_s":0.202404,"scheduling_latency_s":0.202432}1627gitlab # [ 314.190840] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:19:07.350Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cda1882a0ff1e8f3a63c5d9e","created_at":"2026-08-13T13:19:07.051Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-5eb263a62f8b4fc4","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b723ee0de0757a4e78f15006c1188928","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:19:07.128Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cda1882a0ff1e8f3a63c5d9e: done: 0.019779 sec","job_status":"done","queue_duration_s":0.202404,"scheduling_latency_s":0.202432,"redis_calls":13,"redis_duration_s":0.002364,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000751,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001613,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013321,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019779,"completed_at":"2026-08-13T13:19:07.350Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1628gitlab # [ 314.230652] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:19:07.352Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6790dd9ef75726f44c168b90","created_at":"2026-08-13T13:19:07.051Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-5eb263a62f8b4fc4","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b723ee0de0757a4e78f15006c1188928","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:19:07.128Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6790dd9ef75726f44c168b90: start","job_status":"start","queue_duration_s":0.22344,"scheduling_latency_s":0.223459}1629gitlab # [ 314.243050] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:19:07.370Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6790dd9ef75726f44c168b90","created_at":"2026-08-13T13:19:07.051Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-5eb263a62f8b4fc4","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b723ee0de0757a4e78f15006c1188928","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:19:07.128Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6790dd9ef75726f44c168b90: done: 0.01883 sec","job_status":"done","queue_duration_s":0.22344,"scheduling_latency_s":0.223459,"redis_calls":13,"redis_duration_s":0.002112,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00067,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001442,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013185,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01883,"completed_at":"2026-08-13T13:19:07.370Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1630gitlab # [ 314.282470] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:19:07.372Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fae360e7870071d975bae20b","created_at":"2026-08-13T13:19:07.051Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-5eb263a62f8b4fc4","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b723ee0de0757a4e78f15006c1188928","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:19:07.128Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fae360e7870071d975bae20b: start","job_status":"start","queue_duration_s":0.243591,"scheduling_latency_s":0.24361}1631gitlab # [ 314.294819] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:19:07.389Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fae360e7870071d975bae20b","created_at":"2026-08-13T13:19:07.051Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-5eb263a62f8b4fc4","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b723ee0de0757a4e78f15006c1188928","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:19:07.128Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fae360e7870071d975bae20b: done: 0.016906 sec","job_status":"done","queue_duration_s":0.243591,"scheduling_latency_s":0.24361,"redis_calls":13,"redis_duration_s":0.0017299999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000592,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001138,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011842,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016906,"completed_at":"2026-08-13T13:19:07.389Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1632gitlab # [ 314.335955] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:19:07.390Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1a5cd074402773a551c5dcd1","created_at":"2026-08-13T13:19:07.051Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-5eb263a62f8b4fc4","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b723ee0de0757a4e78f15006c1188928","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:19:07.128Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1a5cd074402773a551c5dcd1: start","job_status":"start","queue_duration_s":0.261644,"scheduling_latency_s":0.26166}1633gitlab # [ 314.348710] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:19:07.407Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1a5cd074402773a551c5dcd1","created_at":"2026-08-13T13:19:07.051Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-5eb263a62f8b4fc4","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b723ee0de0757a4e78f15006c1188928","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:19:07.128Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1a5cd074402773a551c5dcd1: done: 0.016713 sec","job_status":"done","queue_duration_s":0.261644,"scheduling_latency_s":0.26166,"redis_calls":13,"redis_duration_s":0.00152,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000568,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000952,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010927,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016713,"completed_at":"2026-08-13T13:19:07.406Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1634gitlab # [ 314.387868] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:19:07.408Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"22c83f0912ed76744ac1eb09","created_at":"2026-08-13T13:19:07.051Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-5eb263a62f8b4fc4","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b723ee0de0757a4e78f15006c1188928","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:19:07.128Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-22c83f0912ed76744ac1eb09: start","job_status":"start","queue_duration_s":0.279508,"scheduling_latency_s":0.279524}1635gitlab # [ 314.400572] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:19:07.423Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"22c83f0912ed76744ac1eb09","created_at":"2026-08-13T13:19:07.051Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-5eb263a62f8b4fc4","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b723ee0de0757a4e78f15006c1188928","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:19:07.128Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-22c83f0912ed76744ac1eb09: done: 0.015562 sec","job_status":"done","queue_duration_s":0.279508,"scheduling_latency_s":0.279524,"redis_calls":13,"redis_duration_s":0.0023150000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000577,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001738,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011073,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015562,"completed_at":"2026-08-13T13:19:07.423Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1636gitlab # [ 314.439780] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:19:07.424Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a0782bbb5bb2cfb9d9f8dc3c","created_at":"2026-08-13T13:19:07.051Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-5eb263a62f8b4fc4","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b723ee0de0757a4e78f15006c1188928","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:19:07.128Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a0782bbb5bb2cfb9d9f8dc3c: start","job_status":"start","queue_duration_s":0.296144,"scheduling_latency_s":0.29616}1637gitlab # [ 314.452435] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:19:07.440Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a0782bbb5bb2cfb9d9f8dc3c","created_at":"2026-08-13T13:19:07.051Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-5eb263a62f8b4fc4","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b723ee0de0757a4e78f15006c1188928","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:19:07.128Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a0782bbb5bb2cfb9d9f8dc3c: done: 0.015423 sec","job_status":"done","queue_duration_s":0.296144,"scheduling_latency_s":0.29616,"redis_calls":13,"redis_duration_s":0.001513,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000546,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000967,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010958,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015423,"completed_at":"2026-08-13T13:19:07.440Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1638gitlab # [ 314.491674] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:19:07.441Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ebb1db9dd8a42cfa4728d8f5","created_at":"2026-08-13T13:19:07.051Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-5eb263a62f8b4fc4","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b723ee0de0757a4e78f15006c1188928","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:19:07.128Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ebb1db9dd8a42cfa4728d8f5: start","job_status":"start","queue_duration_s":0.312752,"scheduling_latency_s":0.312769}1639gitlab # [ 314.504322] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:19:07.460Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ebb1db9dd8a42cfa4728d8f5","created_at":"2026-08-13T13:19:07.051Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-5eb263a62f8b4fc4","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b723ee0de0757a4e78f15006c1188928","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:19:07.128Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ebb1db9dd8a42cfa4728d8f5: done: 0.019127 sec","job_status":"done","queue_duration_s":0.312752,"scheduling_latency_s":0.312769,"redis_calls":13,"redis_duration_s":0.001496,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00054,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000956,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009879,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019127,"completed_at":"2026-08-13T13:19:07.460Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1640gitlab # [ 314.544526] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:19:07.461Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4e3fa277508dd90399b1df72","created_at":"2026-08-13T13:19:07.051Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-5eb263a62f8b4fc4","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b723ee0de0757a4e78f15006c1188928","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:19:07.128Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4e3fa277508dd90399b1df72: start","job_status":"start","queue_duration_s":0.333105,"scheduling_latency_s":0.333122}1641gitlab # [ 314.556914] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:19:07.478Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4e3fa277508dd90399b1df72","created_at":"2026-08-13T13:19:07.051Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-5eb263a62f8b4fc4","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b723ee0de0757a4e78f15006c1188928","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:19:07.128Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4e3fa277508dd90399b1df72: done: 0.017057 sec","job_status":"done","queue_duration_s":0.333105,"scheduling_latency_s":0.333122,"redis_calls":13,"redis_duration_s":0.002958,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001938,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00102,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011199,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017057,"completed_at":"2026-08-13T13:19:07.478Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1642gitlab # [ 314.598854] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:19:07.479Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c1ade125d304380536fe4470","created_at":"2026-08-13T13:19:07.051Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-5eb263a62f8b4fc4","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b723ee0de0757a4e78f15006c1188928","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:19:07.128Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c1ade125d304380536fe4470: start","job_status":"start","queue_duration_s":0.351245,"scheduling_latency_s":0.351261}1643gitlab # [ 314.611388] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:19:07.496Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c1ade125d304380536fe4470","created_at":"2026-08-13T13:19:07.051Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-5eb263a62f8b4fc4","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b723ee0de0757a4e78f15006c1188928","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:19:07.128Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c1ade125d304380536fe4470: done: 0.016967 sec","job_status":"done","queue_duration_s":0.351245,"scheduling_latency_s":0.351261,"redis_calls":13,"redis_duration_s":0.002911,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000797,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002114,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011354,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016967,"completed_at":"2026-08-13T13:19:07.496Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1644gitlab # [ 314.650884] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:19:07.498Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7e43c7dc754cae9424037849","created_at":"2026-08-13T13:19:07.051Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-5eb263a62f8b4fc4","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b723ee0de0757a4e78f15006c1188928","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:19:07.128Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7e43c7dc754cae9424037849: start","job_status":"start","queue_duration_s":0.369658,"scheduling_latency_s":0.369673}1645gitlab # [ 314.663498] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:19:07.514Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7e43c7dc754cae9424037849","created_at":"2026-08-13T13:19:07.051Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-5eb263a62f8b4fc4","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b723ee0de0757a4e78f15006c1188928","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:19:07.128Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7e43c7dc754cae9424037849: done: 0.016647 sec","job_status":"done","queue_duration_s":0.369658,"scheduling_latency_s":0.369673,"redis_calls":13,"redis_duration_s":0.003039,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000996,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002043,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00991,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016647,"completed_at":"2026-08-13T13:19:07.514Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1646gitlab # [ 314.702667] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:19:07.517Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"63583c54cc471f56095afebe","created_at":"2026-08-13T13:19:07.051Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-5eb263a62f8b4fc4","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b723ee0de0757a4e78f15006c1188928","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:19:07.128Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-63583c54cc471f56095afebe: start","job_status":"start","queue_duration_s":0.388513,"scheduling_latency_s":0.388531}1647gitlab # [ 314.715238] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:19:07.532Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"63583c54cc471f56095afebe","created_at":"2026-08-13T13:19:07.051Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-5eb263a62f8b4fc4","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b723ee0de0757a4e78f15006c1188928","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:19:07.128Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-63583c54cc471f56095afebe: done: 0.015476 sec","job_status":"done","queue_duration_s":0.388513,"scheduling_latency_s":0.388531,"redis_calls":13,"redis_duration_s":0.0015170000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000537,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00098,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010944,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015476,"completed_at":"2026-08-13T13:19:07.532Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1648gitlab # [ 314.755899] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:19:07.533Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d9e81ee988bdabd44661227d","created_at":"2026-08-13T13:19:07.051Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-5eb263a62f8b4fc4","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b723ee0de0757a4e78f15006c1188928","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:19:07.128Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d9e81ee988bdabd44661227d: start","job_status":"start","queue_duration_s":0.405103,"scheduling_latency_s":0.405118}1649gitlab # [ 314.768440] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:19:07.550Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d9e81ee988bdabd44661227d","created_at":"2026-08-13T13:19:07.051Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-5eb263a62f8b4fc4","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b723ee0de0757a4e78f15006c1188928","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:19:07.128Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d9e81ee988bdabd44661227d: done: 0.016572 sec","job_status":"done","queue_duration_s":0.405103,"scheduling_latency_s":0.405118,"redis_calls":13,"redis_duration_s":0.0015609999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000535,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001026,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01158,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016572,"completed_at":"2026-08-13T13:19:07.550Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1650gitlab # [ 314.807573] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:19:07.551Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c2bc286c4a009614b27d0b3f","created_at":"2026-08-13T13:19:07.051Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-5eb263a62f8b4fc4","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b723ee0de0757a4e78f15006c1188928","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:19:07.128Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c2bc286c4a009614b27d0b3f: start","job_status":"start","queue_duration_s":0.422782,"scheduling_latency_s":0.422799}1651gitlab # [ 314.820220] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:19:07.570Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c2bc286c4a009614b27d0b3f","created_at":"2026-08-13T13:19:07.051Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-5eb263a62f8b4fc4","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b723ee0de0757a4e78f15006c1188928","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:19:07.128Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c2bc286c4a009614b27d0b3f: done: 0.01885 sec","job_status":"done","queue_duration_s":0.422782,"scheduling_latency_s":0.422799,"redis_calls":13,"redis_duration_s":0.004921,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000996,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003925,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011112,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01885,"completed_at":"2026-08-13T13:19:07.570Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1652gitlab # [ 314.859471] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:19:07.571Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5c5e3d2183a146f5ba8062a2","created_at":"2026-08-13T13:19:07.051Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-5eb263a62f8b4fc4","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b723ee0de0757a4e78f15006c1188928","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:19:07.128Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5c5e3d2183a146f5ba8062a2: start","job_status":"start","queue_duration_s":0.443018,"scheduling_latency_s":0.443034}1653gitlab # [ 314.871855] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:19:07.589Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5c5e3d2183a146f5ba8062a2","created_at":"2026-08-13T13:19:07.051Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-5eb263a62f8b4fc4","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b723ee0de0757a4e78f15006c1188928","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:19:07.128Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5c5e3d2183a146f5ba8062a2: done: 0.017691 sec","job_status":"done","queue_duration_s":0.443018,"scheduling_latency_s":0.443034,"redis_calls":13,"redis_duration_s":0.00267,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001008,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001662,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010802,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017691,"completed_at":"2026-08-13T13:19:07.589Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1654gitlab # [ 314.911151] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:19:07.590Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"05a42793859a3a4ebf02f4d5","created_at":"2026-08-13T13:19:07.051Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-5eb263a62f8b4fc4","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b723ee0de0757a4e78f15006c1188928","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:19:07.128Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-05a42793859a3a4ebf02f4d5: start","job_status":"start","queue_duration_s":0.461877,"scheduling_latency_s":0.461893}1655gitlab # [ 314.923745] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:19:07.606Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"05a42793859a3a4ebf02f4d5","created_at":"2026-08-13T13:19:07.051Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-5eb263a62f8b4fc4","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b723ee0de0757a4e78f15006c1188928","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:19:07.128Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-05a42793859a3a4ebf02f4d5: done: 0.015771 sec","job_status":"done","queue_duration_s":0.461877,"scheduling_latency_s":0.461893,"redis_calls":13,"redis_duration_s":0.001527,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000542,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000985,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011281,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015771,"completed_at":"2026-08-13T13:19:07.606Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1656gitlab # [ 314.964167] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:19:07.607Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ed1fe23fa5de9f1ea80317d5","created_at":"2026-08-13T13:19:07.051Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-5eb263a62f8b4fc4","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b723ee0de0757a4e78f15006c1188928","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:19:07.128Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ed1fe23fa5de9f1ea80317d5: start","job_status":"start","queue_duration_s":0.478831,"scheduling_latency_s":0.47885}1657gitlab # [ 314.976408] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:19:07.623Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ed1fe23fa5de9f1ea80317d5","created_at":"2026-08-13T13:19:07.051Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-5eb263a62f8b4fc4","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b723ee0de0757a4e78f15006c1188928","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:19:07.128Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ed1fe23fa5de9f1ea80317d5: done: 0.015886 sec","job_status":"done","queue_duration_s":0.478831,"scheduling_latency_s":0.47885,"redis_calls":13,"redis_duration_s":0.0016,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000608,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000992,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011352,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015886,"completed_at":"2026-08-13T13:19:07.623Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1658gitlab # [ 315.015303] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:19:07.624Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5a3ff6fc2dc31b4f22a28459","created_at":"2026-08-13T13:19:07.051Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-5eb263a62f8b4fc4","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b723ee0de0757a4e78f15006c1188928","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:19:07.128Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5a3ff6fc2dc31b4f22a28459: start","job_status":"start","queue_duration_s":0.495877,"scheduling_latency_s":0.495893}1659gitlab # [ 315.027850] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:19:07.641Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5a3ff6fc2dc31b4f22a28459","created_at":"2026-08-13T13:19:07.051Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-5eb263a62f8b4fc4","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b723ee0de0757a4e78f15006c1188928","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:19:07.128Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5a3ff6fc2dc31b4f22a28459: done: 0.017452 sec","job_status":"done","queue_duration_s":0.495877,"scheduling_latency_s":0.495893,"redis_calls":13,"redis_duration_s":0.001822,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000694,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001128,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011623,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017452,"completed_at":"2026-08-13T13:19:07.641Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1660gitlab # [ 315.067599] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:19:07.643Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"92321d21cb629eef82b4a34e","created_at":"2026-08-13T13:19:07.051Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-5eb263a62f8b4fc4","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b723ee0de0757a4e78f15006c1188928","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:19:07.128Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-92321d21cb629eef82b4a34e: start","job_status":"start","queue_duration_s":0.514871,"scheduling_latency_s":0.51489}1661gitlab # [ 315.080430] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:19:07.662Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"92321d21cb629eef82b4a34e","created_at":"2026-08-13T13:19:07.051Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-5eb263a62f8b4fc4","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b723ee0de0757a4e78f15006c1188928","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:19:07.128Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-92321d21cb629eef82b4a34e: done: 0.019118 sec","job_status":"done","queue_duration_s":0.514871,"scheduling_latency_s":0.51489,"redis_calls":13,"redis_duration_s":0.002901,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000909,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001992,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013216,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019118,"completed_at":"2026-08-13T13:19:07.662Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1662gitlab # [ 315.119500] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:19:07.663Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"81c1b0989459e49ef320f550","created_at":"2026-08-13T13:19:07.051Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-5eb263a62f8b4fc4","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b723ee0de0757a4e78f15006c1188928","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:19:07.128Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-81c1b0989459e49ef320f550: start","job_status":"start","queue_duration_s":0.535192,"scheduling_latency_s":0.535208}1663gitlab # [ 315.132020] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:19:07.679Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"81c1b0989459e49ef320f550","created_at":"2026-08-13T13:19:07.051Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-5eb263a62f8b4fc4","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b723ee0de0757a4e78f15006c1188928","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:19:07.128Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-81c1b0989459e49ef320f550: done: 0.015744 sec","job_status":"done","queue_duration_s":0.535192,"scheduling_latency_s":0.535208,"redis_calls":13,"redis_duration_s":0.001828,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000647,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001181,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010932,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015744,"completed_at":"2026-08-13T13:19:07.679Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1664gitlab # [ 315.172283] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:19:07.680Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"41e4afb8f22ac50d324104e2","created_at":"2026-08-13T13:19:07.051Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-5eb263a62f8b4fc4","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b723ee0de0757a4e78f15006c1188928","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:19:07.128Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-41e4afb8f22ac50d324104e2: start","job_status":"start","queue_duration_s":0.552083,"scheduling_latency_s":0.5521}1665gitlab # [ 315.184479] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:19:07.696Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"41e4afb8f22ac50d324104e2","created_at":"2026-08-13T13:19:07.051Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-5eb263a62f8b4fc4","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b723ee0de0757a4e78f15006c1188928","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:19:07.128Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-41e4afb8f22ac50d324104e2: done: 0.016074 sec","job_status":"done","queue_duration_s":0.552083,"scheduling_latency_s":0.5521,"redis_calls":13,"redis_duration_s":0.001796,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000626,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00117,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011375,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016074,"completed_at":"2026-08-13T13:19:07.696Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1666gitlab # [ 315.223807] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:19:07.698Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1193bebe4b30e782cbd4f8ac","created_at":"2026-08-13T13:19:07.051Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-5eb263a62f8b4fc4","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b723ee0de0757a4e78f15006c1188928","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:19:07.128Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1193bebe4b30e782cbd4f8ac: start","job_status":"start","queue_duration_s":0.569409,"scheduling_latency_s":0.569426}1667gitlab # [ 315.236513] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:19:07.713Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1193bebe4b30e782cbd4f8ac","created_at":"2026-08-13T13:19:07.051Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-5eb263a62f8b4fc4","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b723ee0de0757a4e78f15006c1188928","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:19:07.128Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1193bebe4b30e782cbd4f8ac: done: 0.015681 sec","job_status":"done","queue_duration_s":0.569409,"scheduling_latency_s":0.569426,"redis_calls":13,"redis_duration_s":0.001764,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000637,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001127,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00978,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015681,"completed_at":"2026-08-13T13:19:07.713Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1668gitlab # [ 315.275617] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:19:07.716Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f006021fa64c2015c82f1b72","created_at":"2026-08-13T13:19:07.051Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-5eb263a62f8b4fc4","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b723ee0de0757a4e78f15006c1188928","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:19:07.128Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f006021fa64c2015c82f1b72: start","job_status":"start","queue_duration_s":0.587362,"scheduling_latency_s":0.587378}1669gitlab # [ 315.288314] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:19:07.732Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f006021fa64c2015c82f1b72","created_at":"2026-08-13T13:19:07.051Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-5eb263a62f8b4fc4","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b723ee0de0757a4e78f15006c1188928","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:19:07.128Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f006021fa64c2015c82f1b72: done: 0.01615 sec","job_status":"done","queue_duration_s":0.587362,"scheduling_latency_s":0.587378,"redis_calls":13,"redis_duration_s":0.0018110000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000688,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001123,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011395,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01615,"completed_at":"2026-08-13T13:19:07.732Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1670gitlab # [ 315.328176] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:19:07.733Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9a80770e39f894138b1c88cf","created_at":"2026-08-13T13:19:07.051Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-5eb263a62f8b4fc4","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b723ee0de0757a4e78f15006c1188928","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:19:07.128Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9a80770e39f894138b1c88cf: start","job_status":"start","queue_duration_s":0.604637,"scheduling_latency_s":0.604654}1671gitlab # [ 315.340961] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:19:07.749Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9a80770e39f894138b1c88cf","created_at":"2026-08-13T13:19:07.051Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-5eb263a62f8b4fc4","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b723ee0de0757a4e78f15006c1188928","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:19:07.128Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9a80770e39f894138b1c88cf: done: 0.016143 sec","job_status":"done","queue_duration_s":0.604637,"scheduling_latency_s":0.604654,"redis_calls":13,"redis_duration_s":0.0015400000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00055,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00099,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011328,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016143,"completed_at":"2026-08-13T13:19:07.749Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1672gitlab # [ 315.381125] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:19:07.750Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"71de93a048bc6015f8fc3c25","created_at":"2026-08-13T13:19:07.051Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-5eb263a62f8b4fc4","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b723ee0de0757a4e78f15006c1188928","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:19:07.128Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-71de93a048bc6015f8fc3c25: start","job_status":"start","queue_duration_s":0.622262,"scheduling_latency_s":0.622277}1673gitlab # [ 315.393539] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:19:07.769Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"71de93a048bc6015f8fc3c25","created_at":"2026-08-13T13:19:07.051Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-5eb263a62f8b4fc4","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b723ee0de0757a4e78f15006c1188928","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:19:07.128Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-71de93a048bc6015f8fc3c25: done: 0.018392 sec","job_status":"done","queue_duration_s":0.622262,"scheduling_latency_s":0.622277,"redis_calls":13,"redis_duration_s":0.002068,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000563,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001505,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009819,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018392,"completed_at":"2026-08-13T13:19:07.769Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1674gitlab # [ 315.432652] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:19:07.770Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"eec96d5c988353a9358eadf0","created_at":"2026-08-13T13:19:07.051Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-5eb263a62f8b4fc4","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b723ee0de0757a4e78f15006c1188928","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:19:07.128Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-eec96d5c988353a9358eadf0: start","job_status":"start","queue_duration_s":0.641806,"scheduling_latency_s":0.641821}1675gitlab # [ 315.445040] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:19:07.786Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"eec96d5c988353a9358eadf0","created_at":"2026-08-13T13:19:07.051Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-5eb263a62f8b4fc4","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b723ee0de0757a4e78f15006c1188928","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:19:07.128Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-eec96d5c988353a9358eadf0: done: 0.016479 sec","job_status":"done","queue_duration_s":0.641806,"scheduling_latency_s":0.641821,"redis_calls":13,"redis_duration_s":0.001574,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000585,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000989,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011911,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016479,"completed_at":"2026-08-13T13:19:07.786Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1676gitlab # [ 315.484482] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:19:07.788Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1b45e08464c69e652b37fe83","created_at":"2026-08-13T13:19:07.051Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-5eb263a62f8b4fc4","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b723ee0de0757a4e78f15006c1188928","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:19:07.128Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1b45e08464c69e652b37fe83: start","job_status":"start","queue_duration_s":0.659414,"scheduling_latency_s":0.659431}1677gitlab # [ 315.496708] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:19:07.804Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1b45e08464c69e652b37fe83","created_at":"2026-08-13T13:19:07.051Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-5eb263a62f8b4fc4","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b723ee0de0757a4e78f15006c1188928","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:19:07.128Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1b45e08464c69e652b37fe83: done: 0.016115 sec","job_status":"done","queue_duration_s":0.659414,"scheduling_latency_s":0.659431,"redis_calls":13,"redis_duration_s":0.001522,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000565,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000957,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011627,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016115,"completed_at":"2026-08-13T13:19:07.804Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1678gitlab # [ 315.536074] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:19:07.805Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"69c54baecd96ec2a28b64a8f","created_at":"2026-08-13T13:19:07.051Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-5eb263a62f8b4fc4","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b723ee0de0757a4e78f15006c1188928","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:19:07.128Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-69c54baecd96ec2a28b64a8f: start","job_status":"start","queue_duration_s":0.676718,"scheduling_latency_s":0.676736}1679gitlab # [ 315.548372] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:19:07.821Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"69c54baecd96ec2a28b64a8f","created_at":"2026-08-13T13:19:07.051Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-5eb263a62f8b4fc4","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b723ee0de0757a4e78f15006c1188928","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:19:07.128Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-69c54baecd96ec2a28b64a8f: done: 0.016343 sec","job_status":"done","queue_duration_s":0.676718,"scheduling_latency_s":0.676736,"redis_calls":13,"redis_duration_s":0.0015019999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000552,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00095,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010126,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016343,"completed_at":"2026-08-13T13:19:07.821Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1680gitlab # [ 315.588633] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:19:07.824Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"56dcf1c6195c0b2cff26664a","created_at":"2026-08-13T13:19:07.051Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-5eb263a62f8b4fc4","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b723ee0de0757a4e78f15006c1188928","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:19:07.128Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-56dcf1c6195c0b2cff26664a: start","job_status":"start","queue_duration_s":0.696124,"scheduling_latency_s":0.696143}1681gitlab # [ 315.600708] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:19:07.840Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"56dcf1c6195c0b2cff26664a","created_at":"2026-08-13T13:19:07.051Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-5eb263a62f8b4fc4","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b723ee0de0757a4e78f15006c1188928","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:19:07.128Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-56dcf1c6195c0b2cff26664a: done: 0.016156 sec","job_status":"done","queue_duration_s":0.696124,"scheduling_latency_s":0.696143,"redis_calls":13,"redis_duration_s":0.0016619999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000705,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000957,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011515,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016156,"completed_at":"2026-08-13T13:19:07.840Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1682gitlab # [ 315.640410] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:19:07.842Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0efdda0907ef8e26bdeab6b6","created_at":"2026-08-13T13:19:07.051Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-5eb263a62f8b4fc4","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b723ee0de0757a4e78f15006c1188928","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:19:07.128Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0efdda0907ef8e26bdeab6b6: start","job_status":"start","queue_duration_s":0.713721,"scheduling_latency_s":0.713737}1683gitlab # [ 315.652703] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:19:07.858Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0efdda0907ef8e26bdeab6b6","created_at":"2026-08-13T13:19:07.051Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-5eb263a62f8b4fc4","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b723ee0de0757a4e78f15006c1188928","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:19:07.128Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0efdda0907ef8e26bdeab6b6: done: 0.016157 sec","job_status":"done","queue_duration_s":0.713721,"scheduling_latency_s":0.713737,"redis_calls":13,"redis_duration_s":0.001657,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000591,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001066,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011255,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016157,"completed_at":"2026-08-13T13:19:07.858Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1684gitlab # [ 315.691716] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:19:07.859Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"83dfa9bf71d565ed30a8e39e","created_at":"2026-08-13T13:19:07.051Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-5eb263a62f8b4fc4","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b723ee0de0757a4e78f15006c1188928","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:19:07.128Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-83dfa9bf71d565ed30a8e39e: start","job_status":"start","queue_duration_s":0.731007,"scheduling_latency_s":0.731023}1685gitlab # [ 315.704470] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:19:07.875Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"83dfa9bf71d565ed30a8e39e","created_at":"2026-08-13T13:19:07.051Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-5eb263a62f8b4fc4","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b723ee0de0757a4e78f15006c1188928","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:19:07.128Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-83dfa9bf71d565ed30a8e39e: done: 0.016126 sec","job_status":"done","queue_duration_s":0.731007,"scheduling_latency_s":0.731023,"redis_calls":13,"redis_duration_s":0.0016380000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000556,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001082,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011222,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016126,"completed_at":"2026-08-13T13:19:07.875Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1686gitlab # [ 315.743523] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:19:07.877Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b9134c8c459a0d8f379d2a94","created_at":"2026-08-13T13:19:07.051Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-5eb263a62f8b4fc4","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b723ee0de0757a4e78f15006c1188928","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:19:07.128Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b9134c8c459a0d8f379d2a94: start","job_status":"start","queue_duration_s":0.749149,"scheduling_latency_s":0.749168}1687gitlab # [ 315.756158] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:19:07.892Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b9134c8c459a0d8f379d2a94","created_at":"2026-08-13T13:19:07.051Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-5eb263a62f8b4fc4","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b723ee0de0757a4e78f15006c1188928","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:19:07.128Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b9134c8c459a0d8f379d2a94: done: 0.015099 sec","job_status":"done","queue_duration_s":0.749149,"scheduling_latency_s":0.749168,"redis_calls":13,"redis_duration_s":0.001489,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000537,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000952,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010591,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015099,"completed_at":"2026-08-13T13:19:07.892Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1688gitlab # [ 315.796161] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:19:07.894Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"aeaecec1ff424f8f3afb4e5d","created_at":"2026-08-13T13:19:07.051Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-5eb263a62f8b4fc4","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b723ee0de0757a4e78f15006c1188928","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:19:07.128Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-aeaecec1ff424f8f3afb4e5d: start","job_status":"start","queue_duration_s":0.765398,"scheduling_latency_s":0.765415}1689gitlab # [ 315.808432] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:19:07.909Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"aeaecec1ff424f8f3afb4e5d","created_at":"2026-08-13T13:19:07.051Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-5eb263a62f8b4fc4","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b723ee0de0757a4e78f15006c1188928","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:19:07.128Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-aeaecec1ff424f8f3afb4e5d: done: 0.015001 sec","job_status":"done","queue_duration_s":0.765398,"scheduling_latency_s":0.765415,"redis_calls":13,"redis_duration_s":0.00154,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000534,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001006,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0106,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015001,"completed_at":"2026-08-13T13:19:07.909Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1690gitlab # [ 315.847407] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:19:07.910Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e6ea6737edce88c7360256e0","created_at":"2026-08-13T13:19:07.051Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-5eb263a62f8b4fc4","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b723ee0de0757a4e78f15006c1188928","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:19:07.128Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e6ea6737edce88c7360256e0: start","job_status":"start","queue_duration_s":0.781512,"scheduling_latency_s":0.781529}1691gitlab # [ 315.860031] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:19:07.925Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e6ea6737edce88c7360256e0","created_at":"2026-08-13T13:19:07.051Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-5eb263a62f8b4fc4","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b723ee0de0757a4e78f15006c1188928","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:19:07.128Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e6ea6737edce88c7360256e0: done: 0.015066 sec","job_status":"done","queue_duration_s":0.781512,"scheduling_latency_s":0.781529,"redis_calls":13,"redis_duration_s":0.001592,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.0006,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000992,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0106,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015066,"completed_at":"2026-08-13T13:19:07.925Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1692gitlab # [ 315.898916] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:19:07.926Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c3d814e7c04b9339a425b434","created_at":"2026-08-13T13:19:07.051Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-5eb263a62f8b4fc4","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b723ee0de0757a4e78f15006c1188928","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:19:07.128Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c3d814e7c04b9339a425b434: start","job_status":"start","queue_duration_s":0.797775,"scheduling_latency_s":0.797792}1693gitlab # [ 315.911445] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:19:07.944Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c3d814e7c04b9339a425b434","created_at":"2026-08-13T13:19:07.051Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-5eb263a62f8b4fc4","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b723ee0de0757a4e78f15006c1188928","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:19:07.128Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c3d814e7c04b9339a425b434: done: 0.017595 sec","job_status":"done","queue_duration_s":0.797775,"scheduling_latency_s":0.797792,"redis_calls":13,"redis_duration_s":0.002565,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00077,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001795,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009748,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017595,"completed_at":"2026-08-13T13:19:07.943Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1694gitlab # [ 315.950557] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:19:07.945Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"73593f6b3eb821c649595dfd","created_at":"2026-08-13T13:19:07.051Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-5eb263a62f8b4fc4","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b723ee0de0757a4e78f15006c1188928","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:19:07.128Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-73593f6b3eb821c649595dfd: start","job_status":"start","queue_duration_s":0.817259,"scheduling_latency_s":0.817276}1695gitlab # [ 315.963240] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:19:07.960Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"73593f6b3eb821c649595dfd","created_at":"2026-08-13T13:19:07.051Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-5eb263a62f8b4fc4","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b723ee0de0757a4e78f15006c1188928","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:19:07.128Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-73593f6b3eb821c649595dfd: done: 0.014963 sec","job_status":"done","queue_duration_s":0.817259,"scheduling_latency_s":0.817276,"redis_calls":13,"redis_duration_s":0.001523,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000561,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000962,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010494,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014963,"completed_at":"2026-08-13T13:19:07.960Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1696gitlab # [ 316.003527] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:19:07.962Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8088b286bc9769704c0bd485","created_at":"2026-08-13T13:19:07.051Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-5eb263a62f8b4fc4","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b723ee0de0757a4e78f15006c1188928","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:19:07.128Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8088b286bc9769704c0bd485: start","job_status":"start","queue_duration_s":0.833597,"scheduling_latency_s":0.833614}1697gitlab # [ 316.016212] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:19:07.977Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8088b286bc9769704c0bd485","created_at":"2026-08-13T13:19:07.051Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-5eb263a62f8b4fc4","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b723ee0de0757a4e78f15006c1188928","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:19:07.128Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8088b286bc9769704c0bd485: done: 0.015086 sec","job_status":"done","queue_duration_s":0.833597,"scheduling_latency_s":0.833614,"redis_calls":13,"redis_duration_s":0.001497,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000537,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00096,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010587,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015086,"completed_at":"2026-08-13T13:19:07.977Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1698gitlab # [ 316.055565] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:19:07.978Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"463b01943c88453ac4da9d98","created_at":"2026-08-13T13:19:07.051Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-5eb263a62f8b4fc4","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b723ee0de0757a4e78f15006c1188928","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:19:07.128Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-463b01943c88453ac4da9d98: start","job_status":"start","queue_duration_s":0.849775,"scheduling_latency_s":0.849792}1699gitlab # [ 316.067928] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:19:07.993Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"463b01943c88453ac4da9d98","created_at":"2026-08-13T13:19:07.051Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-5eb263a62f8b4fc4","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b723ee0de0757a4e78f15006c1188928","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:19:07.128Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-463b01943c88453ac4da9d98: done: 0.015307 sec","job_status":"done","queue_duration_s":0.849775,"scheduling_latency_s":0.849792,"redis_calls":13,"redis_duration_s":0.001609,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00058,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001029,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010116,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015307,"completed_at":"2026-08-13T13:19:07.993Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1700gitlab # [ 316.107220] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:19:07.995Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2bde7bb166222bdcf2c1ac17","created_at":"2026-08-13T13:19:07.051Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-5eb263a62f8b4fc4","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b723ee0de0757a4e78f15006c1188928","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:19:07.128Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2bde7bb166222bdcf2c1ac17: start","job_status":"start","queue_duration_s":0.866815,"scheduling_latency_s":0.866832}1701gitlab # [ 316.119778] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:19:08.011Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2bde7bb166222bdcf2c1ac17","created_at":"2026-08-13T13:19:07.051Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-5eb263a62f8b4fc4","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b723ee0de0757a4e78f15006c1188928","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:19:07.128Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2bde7bb166222bdcf2c1ac17: done: 0.015565 sec","job_status":"done","queue_duration_s":0.866815,"scheduling_latency_s":0.866832,"redis_calls":13,"redis_duration_s":0.0015210000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00054,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000981,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010769,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015565,"completed_at":"2026-08-13T13:19:08.010Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1702gitlab # [ 316.159082] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:19:08.012Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5ddcf7ef1d5ed45ed0a72340","created_at":"2026-08-13T13:19:07.051Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-5eb263a62f8b4fc4","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b723ee0de0757a4e78f15006c1188928","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:19:07.128Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5ddcf7ef1d5ed45ed0a72340: start","job_status":"start","queue_duration_s":0.883503,"scheduling_latency_s":0.883518}1703gitlab # [ 316.171617] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:19:08.027Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5ddcf7ef1d5ed45ed0a72340","created_at":"2026-08-13T13:19:07.051Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-5eb263a62f8b4fc4","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b723ee0de0757a4e78f15006c1188928","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:19:07.128Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5ddcf7ef1d5ed45ed0a72340: done: 0.015634 sec","job_status":"done","queue_duration_s":0.883503,"scheduling_latency_s":0.883518,"redis_calls":13,"redis_duration_s":0.0023769999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000672,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001705,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01035,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015634,"completed_at":"2026-08-13T13:19:08.027Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1704gitlab # [ 316.212005] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:19:08.028Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"30955d7178684ab57763bb36","created_at":"2026-08-13T13:19:07.051Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-5eb263a62f8b4fc4","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b723ee0de0757a4e78f15006c1188928","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:19:07.128Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-30955d7178684ab57763bb36: start","job_status":"start","queue_duration_s":0.900227,"scheduling_latency_s":0.900243}1705gitlab # [ 316.224178] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:19:08.045Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"30955d7178684ab57763bb36","created_at":"2026-08-13T13:19:07.051Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-5eb263a62f8b4fc4","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b723ee0de0757a4e78f15006c1188928","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:19:07.128Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-30955d7178684ab57763bb36: done: 0.016428 sec","job_status":"done","queue_duration_s":0.900227,"scheduling_latency_s":0.900243,"redis_calls":13,"redis_duration_s":0.002434,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000909,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001525,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009631,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016428,"completed_at":"2026-08-13T13:19:08.045Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1706gitlab # [ 316.262985] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:19:08.047Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bf243922df8e96bc950ce657","created_at":"2026-08-13T13:19:07.051Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-5eb263a62f8b4fc4","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b723ee0de0757a4e78f15006c1188928","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:19:07.128Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bf243922df8e96bc950ce657: start","job_status":"start","queue_duration_s":0.918717,"scheduling_latency_s":0.918734}1707gitlab # [ 316.275534] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:19:08.062Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bf243922df8e96bc950ce657","created_at":"2026-08-13T13:19:07.051Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-5eb263a62f8b4fc4","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b723ee0de0757a4e78f15006c1188928","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:19:07.128Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bf243922df8e96bc950ce657: done: 0.015198 sec","job_status":"done","queue_duration_s":0.918717,"scheduling_latency_s":0.918734,"redis_calls":13,"redis_duration_s":0.001922,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000937,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000985,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010285,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015198,"completed_at":"2026-08-13T13:19:08.062Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1708gitlab # [ 316.314642] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:19:08.063Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b8eaa71e6b158b0c4de84d65","created_at":"2026-08-13T13:19:07.051Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-5eb263a62f8b4fc4","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b723ee0de0757a4e78f15006c1188928","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:19:07.128Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b8eaa71e6b158b0c4de84d65: start","job_status":"start","queue_duration_s":0.935072,"scheduling_latency_s":0.935089}1709gitlab # [ 316.327146] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:19:08.078Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b8eaa71e6b158b0c4de84d65","created_at":"2026-08-13T13:19:07.051Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-5eb263a62f8b4fc4","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b723ee0de0757a4e78f15006c1188928","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:19:07.128Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b8eaa71e6b158b0c4de84d65: done: 0.014796 sec","job_status":"done","queue_duration_s":0.935072,"scheduling_latency_s":0.935089,"redis_calls":13,"redis_duration_s":0.001493,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000522,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000971,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010368,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014796,"completed_at":"2026-08-13T13:19:08.078Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1710gitlab # [ 316.366562] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:19:08.079Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"eb6c44fee81148aedda647d4","created_at":"2026-08-13T13:19:07.051Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-5eb263a62f8b4fc4","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b723ee0de0757a4e78f15006c1188928","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:19:07.128Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-eb6c44fee81148aedda647d4: start","job_status":"start","queue_duration_s":0.951007,"scheduling_latency_s":0.951023}1711gitlab # [ 316.379192] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:19:08.094Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"eb6c44fee81148aedda647d4","created_at":"2026-08-13T13:19:07.051Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-5eb263a62f8b4fc4","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b723ee0de0757a4e78f15006c1188928","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:19:07.128Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-eb6c44fee81148aedda647d4: done: 0.014548 sec","job_status":"done","queue_duration_s":0.951007,"scheduling_latency_s":0.951023,"redis_calls":13,"redis_duration_s":0.0014919999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000557,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000935,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010156,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014548,"completed_at":"2026-08-13T13:19:08.094Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1712gitlab # [ 316.419456] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:19:08.095Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bed07b8e22b2d034fc4a756a","created_at":"2026-08-13T13:19:07.051Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-5eb263a62f8b4fc4","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b723ee0de0757a4e78f15006c1188928","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:19:07.128Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bed07b8e22b2d034fc4a756a: start","job_status":"start","queue_duration_s":0.966706,"scheduling_latency_s":0.966722}1713gitlab # [ 316.432085] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:19:08.110Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bed07b8e22b2d034fc4a756a","created_at":"2026-08-13T13:19:07.051Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-5eb263a62f8b4fc4","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b723ee0de0757a4e78f15006c1188928","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:19:07.128Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bed07b8e22b2d034fc4a756a: done: 0.01506 sec","job_status":"done","queue_duration_s":0.966706,"scheduling_latency_s":0.966722,"redis_calls":13,"redis_duration_s":0.001887,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000825,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001062,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009804,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01506,"completed_at":"2026-08-13T13:19:08.110Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1714gitlab # [ 316.470868] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:19:08.111Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fc97e13c38b11b65f177d520","created_at":"2026-08-13T13:19:07.051Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-5eb263a62f8b4fc4","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b723ee0de0757a4e78f15006c1188928","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:19:07.128Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fc97e13c38b11b65f177d520: start","job_status":"start","queue_duration_s":0.983176,"scheduling_latency_s":0.983193}1715gitlab # [ 316.483475] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:19:08.126Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fc97e13c38b11b65f177d520","created_at":"2026-08-13T13:19:07.051Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-5eb263a62f8b4fc4","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b723ee0de0757a4e78f15006c1188928","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:19:07.128Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fc97e13c38b11b65f177d520: done: 0.015024 sec","job_status":"done","queue_duration_s":0.983176,"scheduling_latency_s":0.983193,"redis_calls":13,"redis_duration_s":0.002051,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000537,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001514,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010397,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015024,"completed_at":"2026-08-13T13:19:08.126Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1716gitlab # [ 316.522583] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:19:08.127Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6d3fd5442e4ff05e997b723c","created_at":"2026-08-13T13:19:07.051Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-5eb263a62f8b4fc4","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b723ee0de0757a4e78f15006c1188928","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:19:07.128Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6d3fd5442e4ff05e997b723c: start","job_status":"start","queue_duration_s":0.999274,"scheduling_latency_s":0.99929}1717gitlab # [ 316.535087] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:19:08.142Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6d3fd5442e4ff05e997b723c","created_at":"2026-08-13T13:19:07.051Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-5eb263a62f8b4fc4","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b723ee0de0757a4e78f15006c1188928","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:19:07.128Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6d3fd5442e4ff05e997b723c: done: 0.014811 sec","job_status":"done","queue_duration_s":0.999274,"scheduling_latency_s":0.99929,"redis_calls":13,"redis_duration_s":0.001467,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000545,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000922,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010375,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014811,"completed_at":"2026-08-13T13:19:08.142Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1718gitlab # [ 316.574534] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:19:08.144Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"052c5a6931f496086d69bf5e","created_at":"2026-08-13T13:19:07.051Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-5eb263a62f8b4fc4","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b723ee0de0757a4e78f15006c1188928","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:19:07.128Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-052c5a6931f496086d69bf5e: start","job_status":"start","queue_duration_s":1.015593,"scheduling_latency_s":1.015609}1719gitlab # [ 316.586894] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:19:08.159Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"052c5a6931f496086d69bf5e","created_at":"2026-08-13T13:19:07.051Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-5eb263a62f8b4fc4","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b723ee0de0757a4e78f15006c1188928","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:19:07.128Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-052c5a6931f496086d69bf5e: done: 0.01481 sec","job_status":"done","queue_duration_s":1.015593,"scheduling_latency_s":1.015609,"redis_calls":13,"redis_duration_s":0.001699,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000765,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000934,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01021,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01481,"completed_at":"2026-08-13T13:19:08.159Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1720gitlab # [ 316.627860] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:19:08.160Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9ae47a39f1af3c72042676e3","created_at":"2026-08-13T13:19:07.051Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-5eb263a62f8b4fc4","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b723ee0de0757a4e78f15006c1188928","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:19:07.128Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9ae47a39f1af3c72042676e3: start","job_status":"start","queue_duration_s":1.031562,"scheduling_latency_s":1.031579}1721gitlab # [ 316.640739] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:19:08.175Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9ae47a39f1af3c72042676e3","created_at":"2026-08-13T13:19:07.051Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-5eb263a62f8b4fc4","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b723ee0de0757a4e78f15006c1188928","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:19:07.128Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9ae47a39f1af3c72042676e3: done: 0.015197 sec","job_status":"done","queue_duration_s":1.031562,"scheduling_latency_s":1.031579,"redis_calls":13,"redis_duration_s":0.0016539999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000601,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001053,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010351,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015197,"completed_at":"2026-08-13T13:19:08.175Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1722gitlab # [ 316.680558] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:19:08.176Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f7e7b8ac9471988b3bc2c5dd","created_at":"2026-08-13T13:19:07.051Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-5eb263a62f8b4fc4","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b723ee0de0757a4e78f15006c1188928","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:19:07.128Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f7e7b8ac9471988b3bc2c5dd: start","job_status":"start","queue_duration_s":1.047866,"scheduling_latency_s":1.047882}1723gitlab # [ 316.693069] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:19:08.190Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f7e7b8ac9471988b3bc2c5dd","created_at":"2026-08-13T13:19:07.051Z","trace_propagation_headers":{"sentry-trace":"9cc73561f3234096a8e7a7b70f8ac74e-5eb263a62f8b4fc4","baggage":"sentry-trace_id=9cc73561f3234096a8e7a7b70f8ac74e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b723ee0de0757a4e78f15006c1188928","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:19:07.128Z","job_size_bytes":2,"pid":2031,"sidekiq_tid":"mao7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f7e7b8ac9471988b3bc2c5dd: done: 0.014286 sec","job_status":"done","queue_duration_s":1.047866,"scheduling_latency_s":1.047882,"redis_calls":13,"redis_duration_s":0.00147,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00054,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00093,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009857,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014286,"completed_at":"2026-08-13T13:19:08.190Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1724gitlab # [ 316.732974] postgres[3319]: [3319] ERROR: relation "table_without_models" does not exist1725gitlab # [ 316.734031] postgres[3319]: [3319] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1726gitlab # [ 322.890885] runuser[2981]: pam_unix(runuser:session): session closed for user gitlab1727gitlab # [ 322.892404] setup-gitlab-start[2964]: + systemctl restart gitlab-sidekiq.service1728gitlab # [ 322.919133] systemd[1]: Stopping gitlab-sidekiq.service...1729gitlab # [ 322.936516] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:19:16.762Z","message":"Shutting down"}1730gitlab # [ 322.938021] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:19:16.763Z","message":"Scheduler exiting..."}1731gitlab # [ 322.939531] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:19:16.763Z","message":"Terminating quiet threads for default capsule"}1732gitlab # [ 322.941440] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:19:16.764Z","message":"Scheduler exiting..."}1733gitlab # [ 323.446726] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:19:17.272Z","message":"Pausing to allow jobs to finish..."}1734gitlab # [ 324.450245] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:19:18.275Z","message":"Bye!"}1735gitlab # [ 324.491394] sidekiq-cluster[2031]: {"severity":"INFO","time":"2026-08-13T13:19:18.317Z","message":"stopped","memwd_reason":"background task stopped","memwd_handler_class":"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler","memwd_sleep_time_s":3,"pid":2031,"worker_id":"sidekiq_0","memwd_rss_bytes":923729920,"retry":0}1736gitlab # [ 325.744775] systemd[1]: gitlab-sidekiq.service: Deactivated successfully.1737gitlab # [ 325.745171] systemd[1]: Stopped gitlab-sidekiq.service.1738gitlab # [ 325.745406] systemd[1]: gitlab-sidekiq.service: Consumed 1min 53.804s CPU time over 3min 20.384s wall clock time, 938.8M memory peak, 4.6M read from disk.1739gitlab # [ 325.758811] systemd[1]: Started gitlab-sidekiq.service.1740gitlab # [ 325.765149] setup-gitlab-start[2964]: + mkdir -p /var/lib/secrets1741gitlab # [ 325.770436] setup-gitlab-start[2964]: + echo nixbot-test-token-of-20-chars1742gitlab # [ 325.773630] setup-gitlab-start[2964]: + chmod 644 /var/lib/secrets/gitlab-token1743gitlab # [ 325.776624] setup-gitlab-start[2964]: + curl -fs -X POST -H 'PRIVATE-TOKEN: nixbot-test-token-of-20-chars' -H 'Content-Type: application/json' -d '{"name":"test-flake","visibility":"public","topics":["build-with-buildbot"]}' http://gitlab/api/v4/projects1744gitlab # [ 327.141587] gitaly[895]: time="2026-08-13T13:19:20.967Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01KZXMDXJDA7F3XV581TQMAN2J error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-13T13:19:30.003" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-13T13:19:20.966" pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1745gitlab # [ 327.144617] gitaly[895]: time="2026-08-13T13:19:20.967Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KZXMDXJDA7F3XV581TQMAN2J grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-13T13:19:30.003" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=95 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-13T13:19:20.966" grpc.time_ms=1.462 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1746gitlab # [ 327.360344] gitaly[895]: time="2026-08-13T13:19:21.186Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01KZXMDXJDA7F3XV581TQMAN2J error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-13T13:19:31.005" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-13T13:19:21.186" pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1747gitlab # [ 327.425266] gitaly[895]: time="2026-08-13T13:19:21.187Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KZXMDXJDA7F3XV581TQMAN2J grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-13T13:19:31.005" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-13T13:19:21.186" grpc.time_ms=0.683 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1748gitlab # [ 327.456192] gitaly[895]: time="2026-08-13T13:19:21.250Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KZXMDXJDA7F3XV581TQMAN2J diskcache=0950aa31-9627-4bc5-b08b-7c9d789763ae grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-08-13T13:19:31.016" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-13T13:19:21.197" pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1749gitlab # [ 327.478525] gitaly[895]: time="2026-08-13T13:19:21.251Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=24 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1436 command.oublock=32 command.real_time_ms=30 command.spawn_token_fork_ms=3 command.system_time_ms=24 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZXMDXJDA7F3XV581TQMAN2J grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-08-13T13:19:31.016" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-13T13:19:21.197" grpc.time_ms=53.631 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1750gitlab # [ 327.503669] gitaly[895]: time="2026-08-13T13:19:21.269Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01KZXMDXJDA7F3XV581TQMAN2J grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-13T13:19:31.086" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-13T13:19:21.267" pid=895 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root1751gitlab # [ 327.518942] gitaly[895]: time="2026-08-13T13:19:21.269Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KZXMDXJDA7F3XV581TQMAN2J grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-13T13:19:31.086" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-13T13:19:21.267" grpc.time_ms=1.976 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1752gitlab # [ 327.533134] gitaly[895]: time="2026-08-13T13:19:21.288Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=2 command.system_time_ms=4 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01KZXMDXJDA7F3XV581TQMAN2J grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-13T13:19:31.095" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-13T13:19:21.275" grpc.time_ms=12.827 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1753gitlab # [ 327.550276] gitaly[895]: time="2026-08-13T13:19:21.376Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01KZXMDXJDA7F3XV581TQMAN2J error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-13T13:19:31.195" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-13T13:19:21.376" pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1754gitlab # [ 327.563127] gitaly[895]: time="2026-08-13T13:19:21.376Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KZXMDXJDA7F3XV581TQMAN2J grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-13T13:19:31.195" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-13T13:19:21.376" grpc.time_ms=0.305 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1755gitlab # [ 327.589332] gitaly[895]: time="2026-08-13T13:19:21.415Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KZXMDXJDA7F3XV581TQMAN2J diskcache=17053cd0-71ae-4bf2-a97d-ae959adbfc6f grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-08-13T13:19:31.199" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-13T13:19:21.379" pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1756gitlab # [ 327.602388] gitaly[895]: time="2026-08-13T13:19:21.416Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1437 command.oublock=32 command.real_time_ms=17 command.spawn_token_fork_ms=2 command.system_time_ms=5 command.user_time_ms=8 component=gitaly.UnaryServerInterceptor correlation_id=01KZXMDXJDA7F3XV581TQMAN2J grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-08-13T13:19:31.199" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=137 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-13T13:19:21.379" grpc.time_ms=36.523 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1757gitlab # [ 327.619188] gitaly[895]: time="2026-08-13T13:19:21.424Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01KZXMDXJDA7F3XV581TQMAN2J grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-13T13:19:31.242" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-13T13:19:21.422" pid=895 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root1758gitlab # [ 327.631076] gitaly[895]: time="2026-08-13T13:19:21.424Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KZXMDXJDA7F3XV581TQMAN2J grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-13T13:19:31.242" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-13T13:19:21.422" grpc.time_ms=1.386 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1759gitlab # [ 327.642742] gitaly[895]: time="2026-08-13T13:19:21.438Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=2 command.system_time_ms=0 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01KZXMDXJDA7F3XV581TQMAN2J grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-13T13:19:31.248" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-13T13:19:21.429" grpc.time_ms=8.823 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1760gitlab # [ 327.657706] gitaly[895]: time="2026-08-13T13:19:21.479Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KZXMDXJDA7F3XV581TQMAN2J grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-13T13:19:31.297" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-13T13:19:21.478" grpc.time_ms=0.84 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1761gitlab # [ 327.668960] gitaly[895]: time="2026-08-13T13:19:21.487Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KZXMDXJDA7F3XV581TQMAN2J grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-08-13T13:19:31.006" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-13T13:19:21.486" grpc.time_ms=0.554 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1762gitlab # [ 328.639838] gitaly[895]: time="2026-08-13T13:19:22.465Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01KZXMDXJDA7F3XV581TQMAN2J grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-13T13:19:32.267" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-13T13:19:22.447" grpc.time_ms=16.901 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1763gitlab # [ 330.881331] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/13:13:19:24 +0000] "POST /api/v4/projects HTTP/1.1" 201 4828 "" "curl/8.21.0" 50761764gitlab # [ 330.885232] setup-gitlab-start[2964]: + mkdir -p /tmp/test-flake1765gitlab # [ 330.888740] setup-gitlab-start[2964]: + cd /tmp/test-flake1766gitlab # [ 330.890870] setup-gitlab-start[2964]: + git init -b master1767gitlab # [ 330.910643] setup-gitlab-start[3440]: Initialized empty Git repository in /tmp/test-flake/.git/1768gitlab # [ 330.914560] setup-gitlab-start[2964]: + git config user.name test1769gitlab # [ 330.917301] setup-gitlab-start[2964]: + git config user.email test@example.com1770gitlab # [ 330.920890] setup-gitlab-start[2964]: + cat1771gitlab # [ 330.924956] setup-gitlab-start[2964]: + git add flake.nix1772gitlab # [ 330.930855] setup-gitlab-start[2964]: + git commit -m 'initial commit'1773gitlab # [ 330.948398] setup-gitlab-start[3445]: [master (root-commit) d91f803] initial commit1774gitlab # [ 330.950460] setup-gitlab-start[3445]: 1 file changed, 10 insertions(+)1775gitlab # [ 330.952206] setup-gitlab-start[3445]: create mode 100644 flake.nix1776gitlab # [ 330.953827] setup-gitlab-start[2964]: + git remote add origin http://oauth2:nixbot-test-token-of-20-chars@gitlab/root/test-flake.git1777gitlab # [ 330.964643] setup-gitlab-start[2964]: + git push -u origin master1778gitlab # [ 331.035700] sidekiq-cluster[3379]: {"severity":"INFO","time":"2026-08-13T13:19:24.831Z","message":"Starting cluster with 1 processes"}1779gitlab # [ 331.085500] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/13:13:19:24 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.55.0" 771780gitlab # [ 331.277095] gitaly[895]: time="2026-08-13T13:19:25.100Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=581 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZXME2QKE63V0T7989801S7B grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=242 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-13T13:19:25.083" grpc.time_ms=16.565 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1781gitlab # [ 331.317992] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/13:13:19:25 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 178 "" "git/2.55.0" 1841782gitlab # [ 332.261897] gitaly[895]: time="2026-08-13T13:19:26.087Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZXME2Y0M0QGCJC99SVX5ENK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-13T13:19:36.009" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=169 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-13T13:19:26.069" grpc.time_ms=17.637 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1783gitlab # [ 332.322920] gitaly[895]: time="2026-08-13T13:19:26.148Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=302 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=6 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZXME2Y0M0QGCJC99SVX5ENK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-08-13T13:19:56.032" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-08-13T13:19:26.133" grpc.time_ms=14.832 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1784gitlab # [ 332.359882] gitaly[895]: time="2026-08-13T13:19:26.181Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01KZXME2Y0M0QGCJC99SVX5ENK duration_ms=849ns method=POST pid=895 status=200 url="http://unix/api/v4/internal/allowed"1785gitlab # [ 332.392855] gitaly[895]: time="2026-08-13T13:19:26.219Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01KZXME2Y0M0QGCJC99SVX5ENK duration_ms=37ns method=POST pid=895 status=200 url="http://unix/api/v4/internal/pre_receive"1786gitlab # [ 332.401648] gitaly[895]: time="2026-08-13T13:19:26.219Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZXME2Y0M0QGCJC99SVX5ENK grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5315 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-13T13:19:25.329" grpc.time_ms=889.796 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1787gitlab # [ 332.451068] gitaly[895]: time="2026-08-13T13:19:26.277Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZXME2Y0M0QGCJC99SVX5ENK grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4785 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-13T13:19:26.276" grpc.time_ms=1.08 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1788gitlab # [ 332.503106] gitaly[895]: time="2026-08-13T13:19:26.329Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZXME2Y0M0QGCJC99SVX5ENK grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4784 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-13T13:19:26.327" grpc.time_ms=1.108 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1789gitlab # [ 332.546123] gitaly[895]: time="2026-08-13T13:19:26.372Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZXME2Y0M0QGCJC99SVX5ENK grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4786 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-13T13:19:26.371" grpc.time_ms=0.666 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1790gitlab # [ 332.724628] gitaly[895]: time="2026-08-13T13:19:26.551Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01KZXME2Y0M0QGCJC99SVX5ENK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-13T13:19:36.002" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-13T13:19:26.533" grpc.time_ms=17.511 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1791gitlab # [ 332.776842] gitaly[895]: time="2026-08-13T13:19:26.603Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=29 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1434 command.oublock=0 command.real_time_ms=34 command.spawn_token_fork_ms=2 command.system_time_ms=23 command.user_time_ms=6 component=gitaly.UnaryServerInterceptor correlation_id=01KZXME2Y0M0QGCJC99SVX5ENK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-08-13T13:19:36.034" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-08-13T13:19:26.565" grpc.time_ms=37.489 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1792gitlab # [ 332.810524] gitaly[895]: time="2026-08-13T13:19:26.622Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01KZXME2Y0M0QGCJC99SVX5ENK duration_ms=211ns method=POST pid=895 status=200 url="http://unix/api/v4/internal/post_receive"1793gitlab # [ 332.817093] gitaly[895]: time="2026-08-13T13:19:26.623Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZXME2Y0M0QGCJC99SVX5ENK grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4809 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-13T13:19:26.410" grpc.time_ms=213.266 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1794gitlab # [ 332.838789] gitaly[895]: time="2026-08-13T13:19:26.636Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01KZXME2Y0M0QGCJC99SVX5ENK diskcache=0e20a2df-0142-48ca-bcb8-580d5aa2e0c7 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-13T13:19:25.209" pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1795gitlab # [ 332.855789] gitaly[895]: time="2026-08-13T13:19:26.637Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=320 command.inblock=8 command.majflt=0 command.maxrssanon_bytes=847872 command.minflt=13398 command.oublock=32 command.real_time_ms=1417 command.spawn_token_fork_ms=2 command.system_time_ms=157 command.user_time_ms=163 component=gitaly.StreamServerInterceptor correlation_id=01KZXME2Y0M0QGCJC99SVX5ENK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=684 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=56 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-13T13:19:25.209" grpc.time_ms=1427.689 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1796gitlab # [ 332.875077] systemd[1]: Finished setup-gitlab.service.1797gitlab # [ 332.876320] setup-gitlab-start[3449]: To http://gitlab/root/test-flake.git1798gitlab # [ 332.877496] setup-gitlab-start[3449]: * [new branch] master -> master1799gitlab # [ 332.878676] setup-gitlab-start[3449]: branch 'master' set up to track 'origin/master'.1800gitlab # [ 332.880498] gitlab-workhorse[817]: time="2026-08-13T13:19:26Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=521801gitlab # [ 332.882886] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/13:13:19:26 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.55.0" 15171802gitlab # [ 332.885464] systemd[1]: Starting nixbot CI service...1803gitlab: (finished: waiting for unit setup-gitlab.service, in 334.02 seconds)1804gitlab: waiting for unit nixbot.service1805gitlab # [ 334.173057] nixbot[3544]: {"ts": "2026-08-13T13:19:27.998Z", "level": "info", "logger": "nixbot.main", "msg": "nixbot starting", "url": "http://localhost:8010", "state_dir": "/var/lib/nixbot"}1806gitlab # [ 334.210580] nixbot[3544]: {"ts": "2026-08-13T13:19:28.036Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 1, "migration": "initial"}1807gitlab # [ 334.254022] nixbot[3544]: {"ts": "2026-08-13T13:19:28.080Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 2, "migration": "scheduled_effects"}1808gitlab # [ 334.263042] nixbot[3544]: {"ts": "2026-08-13T13:19:28.089Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 3, "migration": "gitea_webhook_secrets"}1809gitlab # [ 334.271166] nixbot[3544]: {"ts": "2026-08-13T13:19:28.097Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 4, "migration": "api_tokens"}1810gitlab # [ 334.284831] nixbot[3544]: {"ts": "2026-08-13T13:19:28.111Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 5, "migration": "status_notify"}1811gitlab # [ 334.291603] nixbot[3544]: {"ts": "2026-08-13T13:19:28.117Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 6, "migration": "webhook_secrets"}1812gitlab # [ 334.298319] nixbot[3544]: {"ts": "2026-08-13T13:19:28.121Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 7, "migration": "build_effects"}1813gitlab # [ 334.305559] nixbot[3544]: {"ts": "2026-08-13T13:19:28.131Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 8, "migration": "api_token_groups"}1814gitlab # [ 334.312161] nixbot[3544]: {"ts": "2026-08-13T13:19:28.135Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 9, "migration": "scheduled_effect_runs"}1815gitlab # [ 334.319022] nixbot[3544]: {"ts": "2026-08-13T13:19:28.144Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 10, "migration": "work_queue"}1816gitlab # [ 334.328652] nixbot[3544]: {"ts": "2026-08-13T13:19:28.154Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 11, "migration": "revoked_sessions"}1817gitlab # [ 334.335362] nixbot[3544]: {"ts": "2026-08-13T13:19:28.160Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 12, "migration": "truncate_notify_names"}1818gitlab # [ 334.342232] nixbot[3544]: {"ts": "2026-08-13T13:19:28.163Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 13, "migration": "failed_builds_per_project"}1819gitlab # [ 334.348709] nixbot[3544]: {"ts": "2026-08-13T13:19:28.170Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 14, "migration": "streamed_eval_warnings"}1820gitlab # [ 334.354971] nixbot[3544]: {"ts": "2026-08-13T13:19:28.173Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 15, "migration": "eval_completed"}1821gitlab # [ 334.360747] nixbot[3544]: {"ts": "2026-08-13T13:19:28.176Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 16, "migration": "reconcile_watermark"}1822gitlab # [ 334.366265] nixbot[3544]: {"ts": "2026-08-13T13:19:28.178Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 17, "migration": "check_runs"}1823gitlab # [ 334.371549] nixbot[3544]: {"ts": "2026-08-13T13:19:28.186Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 18, "migration": "effects_commit"}1824gitlab # [ 334.376890] nixbot[3544]: {"ts": "2026-08-13T13:19:28.189Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 19, "migration": "scheduled_run_notify"}1825gitlab # [ 334.382209] nixbot[3544]: {"ts": "2026-08-13T13:19:28.192Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 20, "migration": "log_metadata"}1826gitlab # [ 334.387294] nixbot[3544]: {"ts": "2026-08-13T13:19:28.199Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 21, "migration": "forge_refresh_tokens"}1827gitlab # [ 334.392316] nixbot[3544]: {"ts": "2026-08-13T13:19:28.202Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 22, "migration": "attr_finished_idx"}1828gitlab # [ 334.397733] nixbot[3544]: {"ts": "2026-08-13T13:19:28.206Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 23, "migration": "effect_deps"}1829gitlab # [ 334.401889] nixbot[3544]: {"ts": "2026-08-13T13:19:28.209Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 24, "migration": "drop_forge_tokens"}1830gitlab # [ 334.843024] nixbot[3544]: INFO: Started server process [3544]1831gitlab # [ 334.845981] nixbot[3544]: INFO: Uvicorn running on socket ('::', 8010, 0, 0) (Press CTRL+C to quit)1832gitlab # [ 334.862651] nixbot[3544]: INFO: ::ffff:127.0.0.1:39164 - "GET /health HTTP/1.1" 200 OK1833gitlab # [ 334.870400] systemd[1]: Started nixbot CI service.1834gitlab # [ 334.872750] systemd[1]: Reached target Multi-User System.1835gitlab # [ 334.875110] systemd[1]: Startup finished in 821ms (kernel) + 5.256s (initrd) + 5min 28.795s (userspace) = 5min 34.872s.1836gitlab: (finished: waiting for unit nixbot.service, in 2.15 seconds)1837gitlab: waiting for success: curl --fail -s http://127.0.0.1:8010/health1838gitlab # [ 335.780576] nixbot[3544]: INFO: ::ffff:127.0.0.1:39180 - "GET /health HTTP/1.1" 200 OK1839gitlab: (finished: waiting for success: curl --fail -s http://127.0.0.1:8010/health, in 0.06 seconds)1840subtest: project discovered and webhook registered1841gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks1842gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks, in 0.17 seconds)1843gitlab # [ 335.957398] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/13:13:19:29 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 2 "" "curl/8.21.0" 1191844gitlab # [ 336.163535] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/13:13:19:29 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4909 "" "python-httpx/0.28.1" 13001845gitlab # [ 336.167189] nixbot[3544]: {"ts": "2026-08-13T13:19:29.992Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects?membership=true&archived=false&per_page=100 \"HTTP/1.1 200 OK\""}1846gitlab # [ 336.195815] nixbot[3544]: {"ts": "2026-08-13T13:19:30.022Z", "level": "info", "logger": "nixbot.repos", "msg": "legacy topic import complete", "topics": {"gitlab": "build-with-buildbot"}, "enabled": 1}1847gitlab # [ 336.283284] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/13:13:19:30 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 731848gitlab # [ 336.286289] nixbot[3544]: {"ts": "2026-08-13T13:19:30.111Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 200 OK\""}1849gitlab # [ 336.289262] nixbot[3544]: {"ts": "2026-08-13T13:19:30.115Z", "level": "info", "logger": "nixbot.hook_registration", "msg": "registering webhook", "repo": "root/test-flake"}1850gitlab # [ 336.468249] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/13:13:19:30 +0000] "POST /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 201 919 "" "python-httpx/0.28.1" 1741851gitlab # [ 336.470426] nixbot[3544]: {"ts": "2026-08-13T13:19:30.296Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 201 Created\""}1852gitlab # [ 336.883270] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/13:13:19:30 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4909 "" "python-httpx/0.28.1" 3941853gitlab # [ 336.891696] nixbot[3544]: {"ts": "2026-08-13T13:19:30.711Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects?membership=true&archived=false&per_page=100 \"HTTP/1.1 200 OK\""}1854gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks1855gitlab # [ 337.022161] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/13:13:19:30 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 882 "" "python-httpx/0.28.1" 1201856gitlab # [ 337.026778] nixbot[3544]: {"ts": "2026-08-13T13:19:30.850Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 200 OK\""}1857gitlab # [ 337.142346] nixbot[3544]: {"ts": "2026-08-13T13:19:30.968Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: PUT http://gitlab/api/v4/projects/root%2Ftest-flake/hooks/1 \"HTTP/1.1 200 OK\""}1858gitlab # [ 337.146103] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/13:13:19:30 +0000] "PUT /api/v4/projects/root%2Ftest-flake/hooks/1 HTTP/1.1" 200 919 "" "python-httpx/0.28.1" 1061859gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks, in 0.23 seconds)1860(finished: subtest: project discovered and webhook registered, in 1.40 seconds)1861subtest: push delivers the webhook1862gitlab: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master1863gitlab # [ 337.184094] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/13:13:19:31 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 882 "" "curl/8.21.0" 1701864gitlab # [ 337.274486] gitaly[895]: time="2026-08-13T13:19:31.100Z" level=info msg="finished unary call with code OK" catfile.duration_ms=2 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=2 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=4 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZXME8N5F62NJN8MKTBGR7RC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindBranch grpc.request.deadline="2026-08-13T13:20:01.080" grpc.request.fullMethod=/gitaly.RefService/FindBranch grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=215 grpc.service=gitaly.RefService grpc.start_time="2026-08-13T13:19:31.081" grpc.time_ms=17.705 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1865gitlab # [ 337.297479] gitaly[895]: time="2026-08-13T13:19:31.123Z" level=info msg="finished unary call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZXME8N5F62NJN8MKTBGR7RC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-13T13:20:01.019" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-13T13:19:31.121" grpc.time_ms=2.162 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1866gitlab # [ 337.312896] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/13:13:19:31 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.55.0" 411867gitlab # [ 337.315245] gitaly[895]: time="2026-08-13T13:19:31.141Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=5 command.system_time_ms=4 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01KZXME8N5F62NJN8MKTBGR7RC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitIsAncestor grpc.request.deadline="2026-08-13T13:19:41.069" grpc.request.fullMethod=/gitaly.CommitService/CommitIsAncestor grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-08-13T13:19:31.129" grpc.time_ms=11.306 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1868gitlab # [ 337.376627] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/13:13:19:31 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/branches/master HTTP/1.1" 200 732 "" "python-httpx/0.28.1" 2211869gitlab # [ 337.381412] nixbot[3544]: {"ts": "2026-08-13T13:19:31.204Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/repository/branches/master \"HTTP/1.1 200 OK\""}1870gitlab # [ 337.408486] gitaly[895]: time="2026-08-13T13:19:31.234Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=582 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=4 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZXME8SM5623ANXW9Q4AF8CA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=246 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-13T13:19:31.223" grpc.time_ms=11.575 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1871gitlab # [ 337.442389] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/13:13:19:31 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 203 "" "git/2.55.0" 1101872gitlab # Enumerating objects: 5, done.1873gitlab # Counting objects: 20% (1/5)Counting objects: 40% (2/5)Counting objects: 60% (3/5)Counting objects: 80% (4/5)Counting objects: 100% (5/5)Counting objects: 100% (5/5), done.1874gitlab # Delta compression using up to 4 threads1875gitlab # Compressing objects: 50% (1/2)Compressing objects: 100% (2/2)Compressing objects: 100% (2/2), done.1876gitlab # Writing objects: 33% (1/3)Writing objects: 66% (2/3)Writing objects: 100% (3/3)Writing objects: 100% (3/3), 274 bytes | 137.00 KiB/s, done.1877gitlab # Total 3 (delta 1), reused 0 (delta 0), pack-reused 0 (from 0)1878gitlab # [ 337.508604] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/13:13:19:31 +0000] "GET /api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 1221879gitlab # [ 337.516315] nixbot[3544]: {"ts": "2026-08-13T13:19:31.336Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 \"HTTP/1.1 200 OK\""}1880gitlab # [ 337.524706] nixbot[3544]: {"ts": "2026-08-13T13:19:31.340Z", "level": "info", "logger": "nixbot.reconcile", "msg": "reconciliation: building unbuilt head", "project": "root/test-flake", "branch": "master", "pr": null}1881gitlab # [ 337.622665] gitaly[895]: time="2026-08-13T13:19:31.449Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=579 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=2 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZXME91PWTCNX9W6JF63S9GK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-13T13:19:31.440" grpc.time_ms=8.217 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc1882gitlab # [ 337.656446] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/13:13:19:31 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 661883gitlab # [ 337.727072] gitaly[895]: time="2026-08-13T13:19:31.553Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01KZXME93TCDPAD5RKZ89KMZWH grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-13T13:19:31.543" pid=895 remote_ip="2001:db8:1::1" request_sha=cbf4cb85c7b4a4aa26c72509fcce4a61c2433abb response_bytes=113 span.kind=server system=grpc1884gitlab # [ 337.759513] gitaly[895]: time="2026-08-13T13:19:31.553Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=2 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZXME93TCDPAD5RKZ89KMZWH grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-13T13:19:31.543" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc1885gitlab # [ 337.794365] gitlab-workhorse[817]: time="2026-08-13T13:19:31Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=1131886gitlab # [ 337.799329] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/13:13:19:31 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 113 "" "git/2.55.0" 1031887gitlab # [ 337.803415] gitaly[895]: time="2026-08-13T13:19:31.553Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=2 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZXME93TCDPAD5RKZ89KMZWH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=7 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-13T13:19:31.543" grpc.time_ms=9.581 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc1888gitlab # [ 337.827803] gitaly[895]: time="2026-08-13T13:19:31.575Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=301 command.oublock=0 command.real_time_ms=27 command.spawn_token_fork_ms=2 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZXME8YW2W3Z33W7AYXPFKX1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-08-13T13:20:01.042" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-08-13T13:19:31.543" grpc.time_ms=31.757 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1889gitlab # [ 337.849852] gitaly[895]: time="2026-08-13T13:19:31.594Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01KZXME8YW2W3Z33W7AYXPFKX1 duration_ms=130ns method=POST pid=895 status=200 url="http://unix/api/v4/internal/allowed"1890gitlab # [ 337.854561] gitaly[895]: time="2026-08-13T13:19:31.626Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01KZXME8YW2W3Z33W7AYXPFKX1 duration_ms=30ns method=POST pid=895 status=200 url="http://unix/api/v4/internal/pre_receive"1891gitlab # [ 337.858862] gitaly[895]: time="2026-08-13T13:19:31.626Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZXME8YW2W3Z33W7AYXPFKX1 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5315 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-13T13:19:31.464" grpc.time_ms=162.487 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1892gitlab # [ 337.872299] gitaly[895]: time="2026-08-13T13:19:31.673Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZXME8YW2W3Z33W7AYXPFKX1 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4785 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-13T13:19:31.671" grpc.time_ms=1.597 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1893gitlab # [ 337.888222] gitaly[895]: time="2026-08-13T13:19:31.690Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01KZXME975XEN0CWG33A4Y8E67 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-13T13:19:31.665" pid=895 remote_ip="2001:db8:1::1" request_sha=2463873953dc5cee031ec5f4c4f970621d8a89b2 response_bytes=228 span.kind=server system=grpc1894gitlab # [ 337.900117] gitlab-workhorse[817]: time="2026-08-13T13:19:31Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2281895gitlab # [ 337.902095] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/13:13:19:31 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 228 "" "git/2.55.0" 1341896gitlab # [ 337.904078] gitaly[895]: time="2026-08-13T13:19:31.691Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1136 command.oublock=0 command.real_time_ms=22 command.spawn_token_fork_ms=6 command.system_time_ms=2 command.user_time_ms=9 component=gitaly.UnaryServerInterceptor correlation_id=01KZXME975XEN0CWG33A4Y8E67 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-13T13:19:31.665" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc1897gitlab # [ 337.918280] gitaly[895]: time="2026-08-13T13:19:31.695Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1136 command.oublock=0 command.real_time_ms=22 command.spawn_token_fork_ms=6 command.system_time_ms=2 command.user_time_ms=9 component=gitaly.UnaryServerInterceptor correlation_id=01KZXME975XEN0CWG33A4Y8E67 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-13T13:19:31.665" grpc.time_ms=25.828 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc1898gitlab # [ 337.933761] gitaly[895]: time="2026-08-13T13:19:31.706Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZXME8YW2W3Z33W7AYXPFKX1 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4784 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-13T13:19:31.705" grpc.time_ms=1.17 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1899gitlab # [ 337.944503] gitaly[895]: time="2026-08-13T13:19:31.742Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZXME8YW2W3Z33W7AYXPFKX1 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4786 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-13T13:19:31.741" grpc.time_ms=0.969 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1900gitlab # [ 337.960307] gitaly[895]: time="2026-08-13T13:19:31.786Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=579 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=0 command.user_time_ms=6 component=gitaly.StreamServerInterceptor correlation_id=01KZXME9CCT1TTWZ0PQX2BJRWA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-13T13:19:31.776" grpc.time_ms=10.664 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc1901gitlab # [ 337.974147] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/13:13:19:31 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 621902gitlab # [ 338.019676] gitaly[895]: time="2026-08-13T13:19:31.846Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01KZXME8YW2W3Z33W7AYXPFKX1 duration_ms=73ns method=POST pid=895 status=200 url="http://unix/api/v4/internal/post_receive"1903gitlab # [ 338.024547] gitaly[895]: time="2026-08-13T13:19:31.846Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZXME8YW2W3Z33W7AYXPFKX1 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4809 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-13T13:19:31.771" grpc.time_ms=74.671 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1904gitlab # To http://gitlab/root/test-flake.git1905gitlab # [ 338.041414] gitaly[895]: time="2026-08-13T13:19:31.857Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01KZXME8YW2W3Z33W7AYXPFKX1 diskcache=fe7c3af8-ee82-4b49-9bac-10341740571e grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-13T13:19:31.378" pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1906gitlab # d91f803..a79f628 master -> master1907gitlab # [ 338.058053] gitlab-workhorse[817]: time="2026-08-13T13:19:31Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=521908gitlab # [ 338.060946] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/13:13:19:31 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.55.0" 5651909gitlab # [ 338.063581] gitlab-workhorse[817]: time="2026-08-13T13:19:31Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671910gitlab: (finished: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master, in 0.89 seconds)1911gitlab # [ 338.066031] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/13:13:19:31 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 781912gitlab: must succeed: git -C /tmp/test-flake rev-parse master1913gitlab # [ 338.069455] gitaly[895]: time="2026-08-13T13:19:31.857Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=182 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=831488 command.minflt=13322 command.oublock=32 command.real_time_ms=470 command.spawn_token_fork_ms=2 command.system_time_ms=115 command.user_time_ms=67 component=gitaly.StreamServerInterceptor correlation_id=01KZXME8YW2W3Z33W7AYXPFKX1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=606 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=58 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-13T13:19:31.378" grpc.time_ms=479.317 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1914gitlab: (finished: must succeed: git -C /tmp/test-flake rev-parse master, in 0.01 seconds)1915gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219'1916gitlab # [ 338.086878] gitaly[895]: time="2026-08-13T13:19:31.869Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01KZXME9EFBVMN7RK6TV2YR036 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-13T13:19:31.860" pid=895 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc1917gitlab # [ 338.099472] gitaly[895]: time="2026-08-13T13:19:31.869Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=2 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZXME9EFBVMN7RK6TV2YR036 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-13T13:19:31.860" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc1918gitlab # [ 338.115067] gitaly[895]: time="2026-08-13T13:19:31.869Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=2 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZXME9EFBVMN7RK6TV2YR036 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-13T13:19:31.860" grpc.time_ms=9.469 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc1919gitlab # [ 338.131352] gitaly[895]: time="2026-08-13T13:19:31.942Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01KZXME9GZ68CFMGE0VMTJMGYV grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-13T13:19:31.928" pid=895 remote_ip="2001:db8:1::1" request_sha=376ce5606fa4335281db656a763a07cc45388174 response_bytes=342 span.kind=server system=grpc1920gitlab # [ 338.141836] gitlab-workhorse[817]: time="2026-08-13T13:19:31Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=3421921gitlab # [ 338.143656] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/13:13:19:31 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 342 "" "git/2.55.0" 711922gitlab # [ 338.145625] gitaly[895]: time="2026-08-13T13:19:31.942Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1129 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=1 command.system_time_ms=5 command.user_time_ms=5 component=gitaly.UnaryServerInterceptor correlation_id=01KZXME9GZ68CFMGE0VMTJMGYV grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-13T13:19:31.928" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=1 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc1923gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219', in 0.08 seconds)1924gitlab # [ 338.159272] gitaly[895]: time="2026-08-13T13:19:31.942Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1129 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=1 command.system_time_ms=5 command.user_time_ms=5 component=gitaly.UnaryServerInterceptor correlation_id=01KZXME9GZ68CFMGE0VMTJMGYV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=22 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-13T13:19:31.928" grpc.time_ms=13.987 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=1 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc1925gitlab # [ 338.174400] nixbot[3544]: INFO: ::ffff:127.0.0.1:39182 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219 HTTP/1.1" 200 OK1926gitlab # [ 338.281496] gitaly[895]: time="2026-08-13T13:19:32.106Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=579 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZXME9NJ8P0TGDAPS7XAKDNB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=186 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-13T13:19:32.092" grpc.time_ms=14.02 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc1927gitlab # [ 338.317893] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/13:13:19:32 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 881928gitlab # [ 338.405693] gitaly[895]: time="2026-08-13T13:19:32.232Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01KZXME9RD3F87E9NX0SMAP19Q grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-13T13:19:32.198" pid=895 remote_ip="2001:db8:1::1" request_sha=fb62c37b60b550dd367e34acce88d0d3e3444d95 response_bytes=209 span.kind=server system=grpc1929gitlab # [ 338.438049] gitaly[895]: time="2026-08-13T13:19:32.232Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=29 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1103 command.oublock=0 command.real_time_ms=30 command.spawn_token_fork_ms=2 command.system_time_ms=25 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01KZXME9RD3F87E9NX0SMAP19Q grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-13T13:19:32.198" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc1930gitlab # [ 338.469589] gitlab-workhorse[817]: time="2026-08-13T13:19:32Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2091931gitlab # [ 338.472852] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/13:13:19:32 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 209 "" "git/2.55.0" 1231932gitlab # [ 338.476221] gitaly[895]: time="2026-08-13T13:19:32.232Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=29 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1103 command.oublock=0 command.real_time_ms=30 command.spawn_token_fork_ms=2 command.system_time_ms=25 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01KZXME9RD3F87E9NX0SMAP19Q grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-13T13:19:32.198" grpc.time_ms=33.824 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc1933gitlab # [ 338.597320] gitaly[895]: time="2026-08-13T13:19:32.423Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZXME9YMBHJA9PCJWRHTV330 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-13T13:20:02.321" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-13T13:19:32.421" grpc.time_ms=1.288 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1934gitlab # [ 338.681874] gitaly[895]: time="2026-08-13T13:19:32.508Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=15 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=590 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=15 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZXME9YMBHJA9PCJWRHTV330 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-08-13T13:20:02.387" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-08-13T13:19:32.488" grpc.time_ms=19.779 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1935gitlab # [ 338.732296] gitaly[895]: time="2026-08-13T13:19:32.558Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=2 command.system_time_ms=6 command.user_time_ms=5 component=gitaly.StreamServerInterceptor correlation_id=01KZXME9YMBHJA9PCJWRHTV330 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-13T13:19:42.010" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-13T13:19:32.541" grpc.time_ms=16.427 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1936gitlab # [ 338.770576] gitaly[895]: time="2026-08-13T13:19:32.596Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=4 command.system_time_ms=9 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01KZXME9YMBHJA9PCJWRHTV330 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-13T13:19:42.047" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-08-13T13:19:32.578" grpc.time_ms=17.933 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1937gitlab # [ 338.927287] gitaly[895]: time="2026-08-13T13:19:32.753Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KZXME9YMBHJA9PCJWRHTV330 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-08-13T13:19:42.221" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-13T13:19:32.752" grpc.time_ms=0.64 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1938gitlab # [ 338.961787] gitaly[895]: time="2026-08-13T13:19:32.788Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=570 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=6 command.system_time_ms=11 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01KZXME9YMBHJA9PCJWRHTV330 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-08-13T13:19:42.237" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-13T13:19:32.768" grpc.time_ms=18.978 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1939gitlab # [ 339.035327] gitaly[895]: time="2026-08-13T13:19:32.861Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZXME9YMBHJA9PCJWRHTV330 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4153 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-13T13:19:32.860" grpc.time_ms=0.927 pid=895 span.kind=server system=grpc1940gitlab # [ 339.082778] gitaly[895]: time="2026-08-13T13:19:32.909Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZXME9YMBHJA9PCJWRHTV330 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4155 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-13T13:19:32.907" grpc.time_ms=0.978 pid=895 span.kind=server system=grpc1941gitlab # [ 339.110749] gitaly[895]: time="2026-08-13T13:19:32.920Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KZXME9YMBHJA9PCJWRHTV330 diskcache=93fea5eb-4037-4935-96e7-4affe3c001d4 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-13T13:19:42.261" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-13T13:19:32.792" pid=895 ref=refs/keep-around/d91f803177b21f3f0989157b74e357c736589f91 remote_ip="2001:db8:1::1" revision=d91f803177b21f3f0989157b74e357c736589f91 span.kind=server system=grpc username=root1942gitlab # [ 339.135724] gitaly[895]: time="2026-08-13T13:19:32.921Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=121 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5278 command.oublock=8 command.real_time_ms=118 command.spawn_token_fork_ms=2 command.system_time_ms=73 command.user_time_ms=48 component=gitaly.UnaryServerInterceptor correlation_id=01KZXME9YMBHJA9PCJWRHTV330 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-13T13:19:42.261" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-13T13:19:32.792" grpc.time_ms=128.192 pid=895 ref=refs/keep-around/d91f803177b21f3f0989157b74e357c736589f91 remote_ip="2001:db8:1::1" revision=d91f803177b21f3f0989157b74e357c736589f91 span.kind=server system=grpc username=root1943gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219'1944gitlab # [ 339.162849] gitaly[895]: time="2026-08-13T13:19:32.928Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZXME9YMBHJA9PCJWRHTV330 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-13T13:20:02.826" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-13T13:19:32.927" grpc.time_ms=0.739 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1945gitlab # [ 339.226071] nixbot[3544]: INFO: ::ffff:127.0.0.1:39186 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219 HTTP/1.1" 200 OK1946gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219', in 0.06 seconds)1947gitlab # [ 339.351236] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/13:13:19:33 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/d91f803177b21f3f0989157b74e357c736589f91 HTTP/1.1" 201 631 "" "python-httpx/0.28.1" 8671948gitlab # [ 339.359539] nixbot[3544]: {"ts": "2026-08-13T13:19:33.177Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/d91f803177b21f3f0989157b74e357c736589f91 \"HTTP/1.1 201 Created\""}1949gitlab # [ 339.368504] nixbot[3544]: {"ts": "2026-08-13T13:19:33.188Z", "level": "info", "logger": "nixbot.flake_prefetch", "msg": "prefetching flake inputs", "flake_dir": "/var/lib/nixbot/worktrees/1-d91f803177b2-0"}1950gitlab # [ 339.473908] systemd[1]: Started Nix Daemon.1951gitlab # [ 339.596186] nix-daemon[3765]: accepted connection from pid 3759, user nixbot1952gitlab # [ 339.734925] nix-daemon[3765]: accepted connection from pid 3772, user nixbot1953gitlab # [ 339.760397] nixbot[3544]: {"ts": "2026-08-13T13:19:33.586Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-d91f803177b2-0", "argv0": "bwrap"}1954gitlab # [ 339.975178] nix-daemon[3765]: accepted connection from pid 3782, user nixbot1955gitlab # [ 340.097806] nix-daemon[3765]: accepted connection from pid 3792, user nixbot1956gitlab # [ 340.126198] nix-daemon[3765]: accepted connection from pid 3782, user nixbot1957gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219'1958gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219', in 0.06 seconds)1959gitlab # [ 340.285789] nixbot[3544]: INFO: ::ffff:127.0.0.1:39194 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219 HTTP/1.1" 200 OK1960gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219'1961gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219', in 0.05 seconds)1962gitlab # [ 341.338179] nixbot[3544]: INFO: ::ffff:127.0.0.1:57252 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219 HTTP/1.1" 200 OK1963gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219'1964gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219', in 0.05 seconds)1965gitlab # [ 342.391551] nixbot[3544]: INFO: ::ffff:127.0.0.1:57266 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219 HTTP/1.1" 200 OK1966gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219'1967gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219', in 0.05 seconds)1968gitlab # [ 343.445894] nixbot[3544]: INFO: ::ffff:127.0.0.1:57270 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219 HTTP/1.1" 200 OK1969gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219'1970gitlab # [ 344.500284] nixbot[3544]: INFO: ::ffff:127.0.0.1:57274 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219 HTTP/1.1" 200 OK1971gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219', in 0.06 seconds)1972gitlab # [ 345.048747] gitaly[895]: time="2026-08-13T13:19:38.874Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZXMEG895RQDHWAKMDRQMB85 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-13T13:20:08.771" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-13T13:19:38.872" grpc.time_ms=1.278 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1973gitlab # [ 345.140708] gitaly[895]: time="2026-08-13T13:19:38.967Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01KZXMEG895RQDHWAKMDRQMB85 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-13T13:19:48.007" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-13T13:19:38.948" grpc.time_ms=18.48 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1974gitlab # [ 345.296256] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/13:13:19:39 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/d91f803177b21f3f0989157b74e357c736589f91 HTTP/1.1" 201 670 "" "python-httpx/0.28.1" 3591975gitlab # [ 345.302438] nixbot[3544]: {"ts": "2026-08-13T13:19:39.124Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/d91f803177b21f3f0989157b74e357c736589f91 \"HTTP/1.1 201 Created\""}1976gitlab # [ 345.391928] gitaly[895]: time="2026-08-13T13:19:39.218Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZXMEGKXR99BABEQE4DQEQ9N grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-13T13:20:09.116" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-13T13:19:39.216" grpc.time_ms=1.141 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1977gitlab # [ 345.468710] gitaly[895]: time="2026-08-13T13:19:39.295Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZXMEGKXR99BABEQE4DQEQ9N grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-13T13:19:49.216" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-13T13:19:39.276" grpc.time_ms=18.179 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1978gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219'1979gitlab # [ 345.550009] nixbot[3544]: INFO: ::ffff:127.0.0.1:57282 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219 HTTP/1.1" 200 OK1980gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219', in 0.05 seconds)1981gitlab # [ 345.582661] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/13:13:19:39 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/d91f803177b21f3f0989157b74e357c736589f91 HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 2741982gitlab # [ 345.588447] nixbot[3544]: {"ts": "2026-08-13T13:19:39.410Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/d91f803177b21f3f0989157b74e357c736589f91 \"HTTP/1.1 201 Created\""}1983gitlab # [ 345.885380] gitaly[895]: time="2026-08-13T13:19:39.711Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZXMEGXBSX0EE1W62AGPGKNV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-13T13:20:09.209" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-13T13:19:39.710" grpc.time_ms=1.103 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1984gitlab # [ 346.098637] gitaly[895]: time="2026-08-13T13:19:39.923Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01KZXMEGXBSX0EE1W62AGPGKNV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-13T13:19:49.004" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-13T13:19:39.904" grpc.time_ms=18.714 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1985gitlab # [ 346.271487] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/13:13:19:40 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/d91f803177b21f3f0989157b74e357c736589f91 HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 6621986gitlab # [ 346.275101] nixbot[3544]: {"ts": "2026-08-13T13:19:40.099Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/d91f803177b21f3f0989157b74e357c736589f91 \"HTTP/1.1 201 Created\""}1987gitlab # [ 346.441153] nix-daemon[3765]: accepted connection from pid 3834, user nixbot1988gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219'1989gitlab # [ 346.616113] nixbot[3544]: INFO: ::ffff:127.0.0.1:57286 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219 HTTP/1.1" 200 OK1990gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219', in 0.06 seconds)1991gitlab # [ 346.631041] gitaly[895]: time="2026-08-13T13:19:40.457Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=579 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01KZXMEHSZQA3Q34XC5GS2YE40 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=186 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-13T13:19:40.440" grpc.time_ms=16.548 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc1992gitlab # [ 346.659739] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/13:13:19:40 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 1061993gitlab # [ 346.785519] gitaly[895]: time="2026-08-13T13:19:40.611Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01KZXMEHXCYFT3FRYKRSJVBRHD grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-13T13:19:40.591" pid=895 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc1994gitlab # [ 346.819861] gitaly[895]: time="2026-08-13T13:19:40.612Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZXMEHXCYFT3FRYKRSJVBRHD grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-13T13:19:40.591" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc1995gitlab # [ 346.851593] gitlab-workhorse[817]: time="2026-08-13T13:19:40Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671996gitlab # [ 346.857242] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/13:13:19:40 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 1521997gitlab # [ 346.862173] gitaly[895]: time="2026-08-13T13:19:40.612Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZXMEHXCYFT3FRYKRSJVBRHD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-13T13:19:40.591" grpc.time_ms=21.161 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc1998gitlab # [ 346.922296] nix-daemon[3765]: accepted connection from pid 3866, user nixbot1999gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219'2000gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219', in 0.06 seconds)2001gitlab # [ 347.670949] nixbot[3544]: INFO: ::ffff:127.0.0.1:57294 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219 HTTP/1.1" 200 OK2002gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219'2003gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219', in 0.05 seconds)2004gitlab # [ 348.724226] nixbot[3544]: INFO: ::ffff:127.0.0.1:57310 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219 HTTP/1.1" 200 OK2005gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219'2006gitlab # [ 349.758956] nixbot[3544]: INFO: ::ffff:127.0.0.1:57312 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219 HTTP/1.1" 200 OK2007gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219', in 0.04 seconds)2008gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219'2009gitlab # [ 350.818114] nixbot[3544]: INFO: ::ffff:127.0.0.1:57320 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219 HTTP/1.1" 200 OK2010gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219', in 0.06 seconds)2011gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219'2012gitlab # [ 351.874166] nixbot[3544]: INFO: ::ffff:127.0.0.1:51510 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219 HTTP/1.1" 200 OK2013gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219', in 0.06 seconds)2014gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219'2015gitlab # [ 352.929501] nixbot[3544]: INFO: ::ffff:127.0.0.1:51518 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219 HTTP/1.1" 200 OK2016gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219', in 0.05 seconds)2017gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219'2018gitlab # [ 353.986334] nixbot[3544]: INFO: ::ffff:127.0.0.1:51532 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219 HTTP/1.1" 200 OK2019gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219', in 0.06 seconds)2020gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219'2021gitlab # [ 355.042661] nixbot[3544]: INFO: ::ffff:127.0.0.1:51548 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219 HTTP/1.1" 200 OK2022gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219', in 0.06 seconds)2023gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219'2024gitlab # [ 356.097903] nixbot[3544]: INFO: ::ffff:127.0.0.1:51562 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219 HTTP/1.1" 200 OK2025gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219', in 0.06 seconds)2026gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219'2027gitlab # [ 357.152339] nixbot[3544]: INFO: ::ffff:127.0.0.1:51564 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219 HTTP/1.1" 200 OK2028gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219', in 0.05 seconds)2029gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219'2030gitlab # [ 358.208773] nixbot[3544]: INFO: ::ffff:127.0.0.1:51578 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219 HTTP/1.1" 200 OK2031gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219', in 0.06 seconds)2032gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219'2033gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219', in 0.05 seconds)2034gitlab # [ 359.266313] nixbot[3544]: INFO: ::ffff:127.0.0.1:51586 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219 HTTP/1.1" 200 OK2035gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219'2036gitlab # [ 360.320553] nixbot[3544]: INFO: ::ffff:127.0.0.1:51590 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219 HTTP/1.1" 200 OK2037gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219', in 0.06 seconds)2038gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219'2039gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219', in 0.05 seconds)2040gitlab # [ 361.375611] nixbot[3544]: INFO: ::ffff:127.0.0.1:37312 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219 HTTP/1.1" 200 OK2041gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219'2042gitlab # [ 362.428663] nixbot[3544]: INFO: ::ffff:127.0.0.1:37328 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219 HTTP/1.1" 200 OK2043gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219', in 0.05 seconds)2044gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219'2045gitlab # [ 363.482895] nixbot[3544]: INFO: ::ffff:127.0.0.1:37340 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219 HTTP/1.1" 200 OK2046gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219', in 0.05 seconds)2047gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219'2048gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219', in 0.05 seconds)2049gitlab # [ 364.539279] nixbot[3544]: INFO: ::ffff:127.0.0.1:37352 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219 HTTP/1.1" 200 OK2050gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219'2051gitlab # [ 365.593044] nixbot[3544]: INFO: ::ffff:127.0.0.1:37368 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219 HTTP/1.1" 200 OK2052gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219', in 0.06 seconds)2053gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219'2054gitlab # [ 366.649293] nixbot[3544]: INFO: ::ffff:127.0.0.1:37376 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219 HTTP/1.1" 200 OK2055gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219', in 0.06 seconds)2056gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219'2057gitlab # [ 367.703697] nixbot[3544]: INFO: ::ffff:127.0.0.1:37390 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219 HTTP/1.1" 200 OK2058gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219', in 0.05 seconds)2059gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219'2060gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219', in 0.05 seconds)2061gitlab # [ 368.758737] nixbot[3544]: INFO: ::ffff:127.0.0.1:37406 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219 HTTP/1.1" 200 OK2062gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219'2063gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219', in 0.05 seconds)2064gitlab # [ 369.811637] nixbot[3544]: INFO: ::ffff:127.0.0.1:37410 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219 HTTP/1.1" 200 OK2065gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219'2066gitlab # [ 370.865380] nixbot[3544]: INFO: ::ffff:127.0.0.1:41182 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219 HTTP/1.1" 200 OK2067gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219', in 0.06 seconds)2068gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219'2069gitlab # [ 371.920865] nixbot[3544]: INFO: ::ffff:127.0.0.1:41190 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219 HTTP/1.1" 200 OK2070gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219', in 0.06 seconds)2071gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219'2072gitlab # [ 372.976647] nixbot[3544]: INFO: ::ffff:127.0.0.1:41204 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219 HTTP/1.1" 200 OK2073gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219', in 0.05 seconds)2074gitlab # [ 373.628712] sidekiq-cluster[3454]: 2026-08-13T13:20:07.453Z pid=3454 tid=yqe INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>3454, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>431738880}2075gitlab # [ 373.922294] sidekiq-cluster[3454]: W, [2026-08-13T13:20:07.748449 #3454] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.2076gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219'2077gitlab # [ 373.992115] sidekiq-cluster[3454]: {"severity":"INFO","time":"2026-08-13T13:20:07.814Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"}2078gitlab # [ 374.032571] nixbot[3544]: INFO: ::ffff:127.0.0.1:41208 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219 HTTP/1.1" 200 OK2079gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219', in 0.06 seconds)2080gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219'2081gitlab # [ 375.088647] nixbot[3544]: INFO: ::ffff:127.0.0.1:41214 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219 HTTP/1.1" 200 OK2082gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219', in 0.06 seconds)2083gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219'2084gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219', in 0.05 seconds)2085gitlab # [ 376.145177] nixbot[3544]: INFO: ::ffff:127.0.0.1:41222 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219 HTTP/1.1" 200 OK2086gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219'2087gitlab # [ 377.198285] nixbot[3544]: INFO: ::ffff:127.0.0.1:41230 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219 HTTP/1.1" 200 OK2088gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219', in 0.06 seconds)2089gitlab # [ 377.663857] sidekiq-cluster[3454]: {"severity":"INFO","time":"2026-08-13T13:20:11.489Z","message":"GitLab reliable fetch activated!"}2090gitlab # [ 377.670118] sidekiq-cluster[3454]: {"severity":"INFO","time":"2026-08-13T13:20:11.489Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}2091gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219'2092gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219', in 0.05 seconds)2093gitlab # [ 378.253644] nixbot[3544]: INFO: ::ffff:127.0.0.1:41244 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219 HTTP/1.1" 200 OK2094gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219'2095gitlab # [ 379.305880] nixbot[3544]: INFO: ::ffff:127.0.0.1:41248 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219 HTTP/1.1" 200 OK2096gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219', in 0.05 seconds)2097gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219'2098gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219', in 0.05 seconds)2099gitlab # [ 380.361061] nixbot[3544]: INFO: ::ffff:127.0.0.1:41264 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219 HTTP/1.1" 200 OK2100gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219'2101gitlab # [ 381.413715] nixbot[3544]: INFO: ::ffff:127.0.0.1:39278 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219 HTTP/1.1" 200 OK2102gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219', in 0.06 seconds)2103gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219'2104gitlab # [ 382.469238] nixbot[3544]: INFO: ::ffff:127.0.0.1:39282 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219 HTTP/1.1" 200 OK2105gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219', in 0.05 seconds)2106gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219'2107gitlab # [ 383.523844] nixbot[3544]: INFO: ::ffff:127.0.0.1:39296 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219 HTTP/1.1" 200 OK2108gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219', in 0.05 seconds)2109gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219'2110gitlab # [ 384.578631] nixbot[3544]: INFO: ::ffff:127.0.0.1:39306 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219 HTTP/1.1" 200 OK2111gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219', in 0.05 seconds)2112gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219'2113gitlab # [ 385.633463] nixbot[3544]: INFO: ::ffff:127.0.0.1:39318 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219 HTTP/1.1" 200 OK2114gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219', in 0.05 seconds)2115gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219'2116gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219', in 0.05 seconds)2117gitlab # [ 386.690080] nixbot[3544]: INFO: ::ffff:127.0.0.1:39330 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219 HTTP/1.1" 200 OK2118gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219'2119gitlab # [ 387.742633] nixbot[3544]: INFO: ::ffff:127.0.0.1:39332 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219 HTTP/1.1" 200 OK2120gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219', in 0.06 seconds)2121gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219'2122gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219', in 0.05 seconds)2123gitlab # [ 388.797767] nixbot[3544]: INFO: ::ffff:127.0.0.1:39348 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219 HTTP/1.1" 200 OK2124gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219'2125gitlab # [ 389.850616] nixbot[3544]: INFO: ::ffff:127.0.0.1:39354 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219 HTTP/1.1" 200 OK2126gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219', in 0.06 seconds)2127gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219'2128gitlab # [ 390.906059] nixbot[3544]: INFO: ::ffff:127.0.0.1:41450 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219 HTTP/1.1" 200 OK2129gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219', in 0.05 seconds)2130gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219'2131gitlab # [ 391.961197] nixbot[3544]: INFO: ::ffff:127.0.0.1:41458 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219 HTTP/1.1" 200 OK2132gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219', in 0.05 seconds)2133gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219'2134gitlab # [ 393.015860] nixbot[3544]: INFO: ::ffff:127.0.0.1:41472 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219 HTTP/1.1" 200 OK2135gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219', in 0.05 seconds)2136gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219'2137gitlab # [ 394.070992] nixbot[3544]: INFO: ::ffff:127.0.0.1:41478 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219 HTTP/1.1" 200 OK2138gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219', in 0.06 seconds)2139gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219'2140gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219', in 0.05 seconds)2141gitlab # [ 395.126150] nixbot[3544]: INFO: ::ffff:127.0.0.1:41484 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219 HTTP/1.1" 200 OK2142gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219'2143gitlab # [ 396.179779] nixbot[3544]: INFO: ::ffff:127.0.0.1:41492 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219 HTTP/1.1" 200 OK2144gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219', in 0.06 seconds)2145gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219'2146gitlab # [ 397.235074] nixbot[3544]: INFO: ::ffff:127.0.0.1:41500 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219 HTTP/1.1" 200 OK2147gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219', in 0.06 seconds)2148gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219'2149gitlab # [ 398.291188] nixbot[3544]: INFO: ::ffff:127.0.0.1:41506 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219 HTTP/1.1" 200 OK2150gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219', in 0.06 seconds)2151gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219'2152gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219', in 0.05 seconds)2153gitlab # [ 399.346941] nixbot[3544]: INFO: ::ffff:127.0.0.1:41514 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219 HTTP/1.1" 200 OK2154gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219'2155gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219', in 0.05 seconds)2156gitlab # [ 400.399776] nixbot[3544]: INFO: ::ffff:127.0.0.1:41518 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219 HTTP/1.1" 200 OK2157gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219'2158gitlab # [ 401.452890] nixbot[3544]: INFO: ::ffff:127.0.0.1:34890 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219 HTTP/1.1" 200 OK2159gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219', in 0.06 seconds)2160gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219'2161gitlab # [ 402.507809] nixbot[3544]: INFO: ::ffff:127.0.0.1:34892 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219 HTTP/1.1" 200 OK2162gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219', in 0.05 seconds)2163gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219'2164gitlab # [ 403.562802] nixbot[3544]: INFO: ::ffff:127.0.0.1:34896 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219 HTTP/1.1" 200 OK2165gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219', in 0.05 seconds)2166gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219'2167gitlab # [ 404.618313] nixbot[3544]: INFO: ::ffff:127.0.0.1:34906 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219 HTTP/1.1" 200 OK2168gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219', in 0.06 seconds)2169gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219'2170gitlab # [ 405.673544] nixbot[3544]: INFO: ::ffff:127.0.0.1:34916 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219 HTTP/1.1" 200 OK2171gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219', in 0.06 seconds)2172gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219'2173gitlab # [ 406.729804] nixbot[3544]: INFO: ::ffff:127.0.0.1:34918 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219 HTTP/1.1" 200 OK2174gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219', in 0.06 seconds)2175gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219'2176gitlab # [ 407.786006] nixbot[3544]: INFO: ::ffff:127.0.0.1:34928 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219 HTTP/1.1" 200 OK2177gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219', in 0.06 seconds)2178gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219'2179gitlab # [ 408.842370] nixbot[3544]: INFO: ::ffff:127.0.0.1:34942 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219 HTTP/1.1" 200 OK2180gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219', in 0.06 seconds)2181gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219'2182gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219', in 0.05 seconds)2183gitlab # [ 409.899795] nixbot[3544]: INFO: ::ffff:127.0.0.1:34958 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219 HTTP/1.1" 200 OK2184gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219'2185gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219', in 0.05 seconds)2186gitlab # [ 410.952735] nixbot[3544]: INFO: ::ffff:127.0.0.1:43422 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219 HTTP/1.1" 200 OK2187gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219'2188gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219', in 0.05 seconds)2189gitlab # [ 412.005835] nixbot[3544]: INFO: ::ffff:127.0.0.1:43426 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219 HTTP/1.1" 200 OK2190gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219'2191gitlab # [ 413.059119] nixbot[3544]: INFO: ::ffff:127.0.0.1:43434 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219 HTTP/1.1" 200 OK2192gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219', in 0.06 seconds)2193gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219'2194gitlab # [ 414.114941] nixbot[3544]: INFO: ::ffff:127.0.0.1:43440 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219 HTTP/1.1" 200 OK2195gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219', in 0.06 seconds)2196gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219'2197gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219', in 0.05 seconds)2198gitlab # [ 415.170881] nixbot[3544]: INFO: ::ffff:127.0.0.1:43456 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219 HTTP/1.1" 200 OK2199gitlab # [ 416.100796] postgres[4085]: [4085] ERROR: relation "table_without_models" does not exist2200gitlab # [ 416.104526] postgres[4085]: [4085] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')2201gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219'2202gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219', in 0.05 seconds)2203gitlab # [ 416.225078] nixbot[3544]: INFO: ::ffff:127.0.0.1:43468 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219 HTTP/1.1" 200 OK2204gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219'2205gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219', in 0.05 seconds)2206gitlab # [ 417.277953] nixbot[3544]: INFO: ::ffff:127.0.0.1:43474 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219 HTTP/1.1" 200 OK2207gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219'2208gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219', in 0.05 seconds)2209gitlab # [ 418.330134] nixbot[3544]: INFO: ::ffff:127.0.0.1:43476 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219 HTTP/1.1" 200 OK2210gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219'2211gitlab # [ 419.382634] nixbot[3544]: INFO: ::ffff:127.0.0.1:43492 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219 HTTP/1.1" 200 OK2212gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219', in 0.05 seconds)2213gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219'2214gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219', in 0.05 seconds)2215gitlab # [ 420.438280] nixbot[3544]: INFO: ::ffff:127.0.0.1:43500 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219 HTTP/1.1" 200 OK2216gitlab # [ 421.118050] sidekiq-cluster[3454]: {"severity":"INFO","time":"2026-08-13T13:20:54.943Z","message":"Booted Rails 7.2.3.1 application in production environment"}2217gitlab # [ 421.118540] sidekiq-cluster[3454]: {"severity":"INFO","time":"2026-08-13T13:20:54.943Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [aarch64-linux]"}2218gitlab # [ 421.118725] sidekiq-cluster[3454]: {"severity":"INFO","time":"2026-08-13T13:20:54.943Z","message":"See LICENSE and the LGPL-3.0 for licensing details."}2219gitlab # [ 421.118851] sidekiq-cluster[3454]: {"severity":"INFO","time":"2026-08-13T13:20:54.943Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"}2220gitlab # [ 421.128086] sidekiq-cluster[3454]: {"severity":"INFO","time":"2026-08-13T13:20:54.952Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}2221gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219'2222gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219', in 0.05 seconds)2223gitlab # [ 421.492267] nixbot[3544]: INFO: ::ffff:127.0.0.1:58114 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219 HTTP/1.1" 200 OK2224gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219'2225gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219', in 0.09 seconds)2226gitlab # [ 422.577487] nixbot[3544]: INFO: ::ffff:127.0.0.1:58130 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219 HTTP/1.1" 200 OK2227gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219'2228gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219', in 0.05 seconds)2229gitlab # [ 423.632941] nixbot[3544]: INFO: ::ffff:127.0.0.1:58146 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219 HTTP/1.1" 200 OK2230gitlab # [ 423.822810] sidekiq-cluster[3454]: {"severity":"INFO","time":"2026-08-13T13:20:57.647Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"4ceea29331f9b5b49c443644","created_at":"2026-08-13T13:19:21.303Z","trace_propagation_headers":{"sentry-trace":"cba63c1b49714d46965201d17ee187f2-2b4f91dddc33437a","baggage":"sentry-trace_id=cba63c1b49714d46965201d17ee187f2,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZXMDXJDA7F3XV581TQMAN2J","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-08-13T13:19:21.346Z","job_size_bytes":2,"pid":3454,"sidekiq_tid":"m8le","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-4ceea29331f9b5b49c443644: start","job_status":"start","queue_duration_s":96.301022,"scheduling_latency_s":96.301074}2231gitlab # [ 424.194603] sidekiq-cluster[3454]: {"severity":"INFO","time":"2026-08-13T13:20:58.019Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"4ceea29331f9b5b49c443644","created_at":"2026-08-13T13:19:21.303Z","trace_propagation_headers":{"sentry-trace":"cba63c1b49714d46965201d17ee187f2-2b4f91dddc33437a","baggage":"sentry-trace_id=cba63c1b49714d46965201d17ee187f2,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZXMDXJDA7F3XV581TQMAN2J","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-08-13T13:19:21.346Z","job_size_bytes":2,"pid":3454,"sidekiq_tid":"m8le","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-4ceea29331f9b5b49c443644: done: 0.372326 sec","job_status":"done","queue_duration_s":96.301022,"scheduling_latency_s":96.301074,"redis_calls":23,"redis_duration_s":0.010236,"redis_read_bytes":910,"redis_write_bytes":2540,"redis_feature_flag_calls":13,"redis_feature_flag_duration_s":0.005404,"redis_feature_flag_read_bytes":902,"redis_feature_flag_write_bytes":1375,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002715,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":606,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002117,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":559,"db_count":10,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":10,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.023,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":9,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.019,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.191449,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.19134104,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.372326,"completed_at":"2026-08-13T13:20:58.019Z","load_balancing_strategy":"primary","db_duration_s":0.104136,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2232gitlab # [ 424.295119] sidekiq-cluster[3454]: {"severity":"INFO","time":"2026-08-13T13:20:58.022Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"acd7038460574c632d373448","created_at":"2026-08-13T13:19:21.361Z","trace_propagation_headers":{"sentry-trace":"cba63c1b49714d46965201d17ee187f2-2b4f91dddc33437a","baggage":"sentry-trace_id=cba63c1b49714d46965201d17ee187f2,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZXMDXJDA7F3XV581TQMAN2J","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-08-13T13:19:21.369Z","job_size_bytes":2,"pid":3454,"sidekiq_tid":"m8le","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-acd7038460574c632d373448: start","job_status":"start","queue_duration_s":96.653122,"scheduling_latency_s":96.653159}2233gitlab # [ 424.373600] sidekiq-cluster[3454]: {"severity":"INFO","time":"2026-08-13T13:20:58.199Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"acd7038460574c632d373448","created_at":"2026-08-13T13:19:21.361Z","trace_propagation_headers":{"sentry-trace":"cba63c1b49714d46965201d17ee187f2-2b4f91dddc33437a","baggage":"sentry-trace_id=cba63c1b49714d46965201d17ee187f2,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZXMDXJDA7F3XV581TQMAN2J","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-08-13T13:19:21.369Z","job_size_bytes":2,"pid":3454,"sidekiq_tid":"m8le","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-acd7038460574c632d373448: done: 0.176561 sec","job_status":"done","queue_duration_s":96.653122,"scheduling_latency_s":96.653159,"redis_calls":14,"redis_duration_s":0.0046029999999999995,"redis_read_bytes":140,"redis_write_bytes":1653,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000925,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":422,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002253,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":680,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001425,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":551,"db_count":8,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.017,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.014,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.130284,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.13807806,"extra.projects_process_sync_events_worker.estimated_total_events":1,"extra.projects_process_sync_events_worker.consumable_events":1,"extra.projects_process_sync_events_worker.processed_events":1,"duration_s":0.176561,"completed_at":"2026-08-13T13:20:58.199Z","load_balancing_strategy":"primary","db_duration_s":0.035953,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2234gitlab # [ 424.478556] sidekiq-cluster[3454]: {"severity":"INFO","time":"2026-08-13T13:20:58.201Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"dbcd2a37d6ccb6ad92b7f1c4","created_at":"2026-08-13T13:19:22.225Z","trace_propagation_headers":{"sentry-trace":"cba63c1b49714d46965201d17ee187f2-2b4f91dddc33437a","baggage":"sentry-trace_id=cba63c1b49714d46965201d17ee187f2,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZXMDXJDA7F3XV581TQMAN2J","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-08-13T13:19:22.236Z","job_size_bytes":5,"pid":3454,"sidekiq_tid":"m8le","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-dbcd2a37d6ccb6ad92b7f1c4: start","job_status":"start","queue_duration_s":95.965787,"scheduling_latency_s":95.965815}2235gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219'2236gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219', in 0.06 seconds)2237gitlab # [ 424.600842] sidekiq-cluster[3454]: {"severity":"INFO","time":"2026-08-13T13:20:58.426Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"dbcd2a37d6ccb6ad92b7f1c4","created_at":"2026-08-13T13:19:22.225Z","trace_propagation_headers":{"sentry-trace":"cba63c1b49714d46965201d17ee187f2-2b4f91dddc33437a","baggage":"sentry-trace_id=cba63c1b49714d46965201d17ee187f2,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZXMDXJDA7F3XV581TQMAN2J","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-08-13T13:19:22.236Z","job_size_bytes":5,"pid":3454,"sidekiq_tid":"m8le","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-dbcd2a37d6ccb6ad92b7f1c4: done: 0.224832 sec","job_status":"done","queue_duration_s":95.965787,"scheduling_latency_s":95.965815,"redis_calls":12,"redis_duration_s":0.0034839999999999997,"redis_read_bytes":138,"redis_write_bytes":1541,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000911,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":491,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002057,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":784,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000516,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":14,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":14,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.024,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.024,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.175075,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00036612,"duration_s":0.224832,"completed_at":"2026-08-13T13:20:58.426Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.042468,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2238gitlab # [ 424.711689] sidekiq-cluster[3454]: {"severity":"INFO","time":"2026-08-13T13:20:58.428Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"f779ad540f48f6c840acd360","created_at":"2026-08-13T13:19:22.277Z","trace_propagation_headers":{"sentry-trace":"cba63c1b49714d46965201d17ee187f2-2b4f91dddc33437a","baggage":"sentry-trace_id=cba63c1b49714d46965201d17ee187f2,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZXMDXJDA7F3XV581TQMAN2J","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-08-13T13:19:22.286Z","job_size_bytes":3,"pid":3454,"sidekiq_tid":"m8le","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-f779ad540f48f6c840acd360: start","job_status":"start","queue_duration_s":96.142091,"scheduling_latency_s":96.142113}2239gitlab # [ 424.737745] nixbot[3544]: INFO: ::ffff:127.0.0.1:58158 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219 HTTP/1.1" 200 OK2240gitlab # [ 424.880907] sidekiq-cluster[3454]: {"severity":"INFO","time":"2026-08-13T13:20:58.705Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"f779ad540f48f6c840acd360","created_at":"2026-08-13T13:19:22.277Z","trace_propagation_headers":{"sentry-trace":"cba63c1b49714d46965201d17ee187f2-2b4f91dddc33437a","baggage":"sentry-trace_id=cba63c1b49714d46965201d17ee187f2,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZXMDXJDA7F3XV581TQMAN2J","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-08-13T13:19:22.286Z","job_size_bytes":3,"pid":3454,"sidekiq_tid":"m8le","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-f779ad540f48f6c840acd360: done: 0.27718 sec","job_status":"done","queue_duration_s":96.142091,"scheduling_latency_s":96.142113,"redis_calls":11,"redis_duration_s":0.003108,"redis_read_bytes":137,"redis_write_bytes":1147,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000692,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":407,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001833,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":538,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000583,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":202,"db_count":35,"db_write_count":6,"db_cached_count":2,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":35,"db_replica_write_count":0,"db_primary_write_count":6,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.044,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":34,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":6,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":2,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.234,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.234,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.042,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.170576,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0006149,"duration_s":0.27718,"completed_at":"2026-08-13T13:20:58.705Z","load_balancing_strategy":"primary","db_duration_s":0.109473,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2241gitlab # [ 424.977479] sidekiq-cluster[3454]: {"severity":"INFO","time":"2026-08-13T13:20:58.708Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"890cf7b817418bcb7dcec6ea","created_at":"2026-08-13T13:19:22.291Z","trace_propagation_headers":{"sentry-trace":"cba63c1b49714d46965201d17ee187f2-2b4f91dddc33437a","baggage":"sentry-trace_id=cba63c1b49714d46965201d17ee187f2,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZXMDXJDA7F3XV581TQMAN2J","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-08-13T13:19:22.299Z","job_size_bytes":89,"pid":3454,"sidekiq_tid":"m8le","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-890cf7b817418bcb7dcec6ea: start","job_status":"start","queue_duration_s":96.408569,"scheduling_latency_s":96.408594}2242gitlab # [ 424.998295] sidekiq-cluster[3454]: {"severity":"INFO","time":"2026-08-13T13:20:58.756Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"890cf7b817418bcb7dcec6ea","created_at":"2026-08-13T13:19:22.291Z","trace_propagation_headers":{"sentry-trace":"cba63c1b49714d46965201d17ee187f2-2b4f91dddc33437a","baggage":"sentry-trace_id=cba63c1b49714d46965201d17ee187f2,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZXMDXJDA7F3XV581TQMAN2J","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-08-13T13:19:22.299Z","job_size_bytes":89,"pid":3454,"sidekiq_tid":"m8le","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-890cf7b817418bcb7dcec6ea: done: 0.048539 sec","job_status":"done","queue_duration_s":96.408569,"scheduling_latency_s":96.408594,"redis_calls":11,"redis_duration_s":0.003046,"redis_read_bytes":137,"redis_write_bytes":1267,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000782,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":443,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00171,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":594,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000554,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":230,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.030688,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00056464,"duration_s":0.048539,"completed_at":"2026-08-13T13:20:58.756Z","load_balancing_strategy":"primary","db_duration_s":0.00861,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2243gitlab # [ 425.045587] sidekiq-cluster[3454]: {"severity":"INFO","time":"2026-08-13T13:20:58.758Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 d91f803177b21f3f0989157b74e357c736589f91 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"28ebcb29407bc440cab54ac9","created_at":"2026-08-13T13:19:26.457Z","trace_propagation_headers":{"sentry-trace":"f540fb3a378c498896453f5c0d88faaa-e3f2347f920b47dc","baggage":"sentry-trace_id=f540fb3a378c498896453f5c0d88faaa,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZXME2Y0M0QGCJC99SVX5ENK","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:19:26.489Z","job_size_bytes":185,"pid":3454,"sidekiq_tid":"m8le","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-28ebcb29407bc440cab54ac9: start","job_status":"start","queue_duration_s":92.269495,"scheduling_latency_s":92.269517}2244gitlab # [ 425.062751] sidekiq-cluster[3454]: {"severity":"INFO","time":"2026-08-13T13:20:58.778Z","message":"changes: \"0000000000000000000000000000000000000000 d91f803177b21f3f0989157b74e357c736589f91 refs/heads/master\\n\""}2245gitlab # [ 425.065554] gitaly[895]: time="2026-08-13T13:20:58.828Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=1 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01KZXME2Y0M0QGCJC99SVX5ENK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-13T13:21:08.010" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-08-13T13:20:58.811" grpc.time_ms=17.182 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2246gitlab # [ 425.078788] gitaly[895]: time="2026-08-13T13:20:58.857Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=0 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZXME2Y0M0QGCJC99SVX5ENK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-13T13:21:08.039" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-13T13:20:58.839" grpc.time_ms=17.634 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2247gitlab # [ 425.117339] gitaly[895]: time="2026-08-13T13:20:58.943Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=583 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=1 command.system_time_ms=12 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZXME2Y0M0QGCJC99SVX5ENK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-08-13T13:21:08.126" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=266 grpc.service=gitaly.RefService grpc.start_time="2026-08-13T13:20:58.926" grpc.time_ms=17.024 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2248gitlab # [ 425.189398] gitaly[895]: time="2026-08-13T13:20:59.015Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZXME2Y0M0QGCJC99SVX5ENK grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3936 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-13T13:20:59.013" grpc.time_ms=1.838 pid=895 span.kind=server system=grpc2249gitlab # [ 425.240256] gitaly[895]: time="2026-08-13T13:20:59.066Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZXME2Y0M0QGCJC99SVX5ENK grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3938 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-13T13:20:59.065" grpc.time_ms=0.707 pid=895 span.kind=server system=grpc2250gitlab # [ 425.263886] gitaly[895]: time="2026-08-13T13:20:59.080Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KZXME2Y0M0QGCJC99SVX5ENK diskcache=27e2b2b3-b522-4e7a-9b56-de4f68ca3bfa grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-13T13:21:08.156" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-13T13:20:58.957" pid=895 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root2251gitlab # [ 425.283197] gitaly[895]: time="2026-08-13T13:20:59.080Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=131 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5170 command.oublock=8 command.real_time_ms=115 command.spawn_token_fork_ms=1 command.system_time_ms=81 command.user_time_ms=50 component=gitaly.UnaryServerInterceptor correlation_id=01KZXME2Y0M0QGCJC99SVX5ENK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-13T13:21:08.156" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=148 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-13T13:20:58.957" grpc.time_ms=123.235 pid=895 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root2252gitlab # [ 425.302963] gitaly[895]: time="2026-08-13T13:20:59.109Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KZXME2Y0M0QGCJC99SVX5ENK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-13T13:21:09.008" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-13T13:20:59.109" grpc.time_ms=0.289 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2253gitlab # [ 425.316646] gitaly[895]: time="2026-08-13T13:20:59.143Z" level=info msg="finished unary call with code OK" command.count=3 command.cpu_time_ms=20 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=859 command.oublock=0 command.real_time_ms=24 command.spawn_token_fork_ms=3 command.system_time_ms=17 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01KZXME2Y0M0QGCJC99SVX5ENK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-08-13T13:21:09.015" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-08-13T13:20:59.116" grpc.time_ms=26.725 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2254gitlab # [ 425.489086] gitaly[895]: time="2026-08-13T13:20:59.315Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=312 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=1 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZXME2Y0M0QGCJC99SVX5ENK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindCommits grpc.request.deadline="2026-08-13T13:21:29.002" grpc.request.fullMethod=/gitaly.CommitService/FindCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=173 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-13T13:20:59.302" grpc.time_ms=12.334 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2255gitlab # [ 425.547833] gitaly[895]: time="2026-08-13T13:20:59.374Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KZXME2Y0M0QGCJC99SVX5ENK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-08-13T13:21:09.272" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-13T13:20:59.373" grpc.time_ms=0.649 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2256gitlab # [ 425.578622] gitaly[895]: time="2026-08-13T13:20:59.389Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=316 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01KZXME2Y0M0QGCJC99SVX5ENK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-08-13T13:21:09.277" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=112 grpc.service=gitaly.DiffService grpc.start_time="2026-08-13T13:20:59.378" grpc.time_ms=10.737 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2257gitlab # [ 425.610087] gitaly[895]: time="2026-08-13T13:20:59.436Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZXME2Y0M0QGCJC99SVX5ENK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-13T13:21:09.007" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-13T13:20:59.418" grpc.time_ms=17.939 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2258gitlab # [ 425.638090] gitaly[895]: time="2026-08-13T13:20:59.464Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=9 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01KZXME2Y0M0QGCJC99SVX5ENK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-13T13:21:09.036" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-08-13T13:20:59.447" grpc.time_ms=16.966 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2259gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219'2260gitlab # [ 425.690834] gitaly[895]: time="2026-08-13T13:20:59.517Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=19 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=882 command.oublock=0 command.real_time_ms=23 command.spawn_token_fork_ms=3 command.system_time_ms=9 command.user_time_ms=10 component=gitaly.StreamServerInterceptor correlation_id=01KZXME2Y0M0QGCJC99SVX5ENK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-08-13T13:21:29.188" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=155 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=80 grpc.service=gitaly.CommitService grpc.start_time="2026-08-13T13:20:59.488" grpc.time_ms=28.219 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2261gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219', in 0.08 seconds)2262gitlab # [ 425.770460] nixbot[3544]: INFO: ::ffff:127.0.0.1:58164 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219 HTTP/1.1" 200 OK2263gitlab # [ 426.444751] gitaly[895]: time="2026-08-13T13:21:00.269Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZXME2Y0M0QGCJC99SVX5ENK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-08-13T13:21:10.166" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-13T13:21:00.267" grpc.time_ms=2.52 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2264gitlab # [ 426.491164] sidekiq-cluster[3454]: {"severity":"INFO","time":"2026-08-13T13:21:00.315Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 d91f803177b21f3f0989157b74e357c736589f91 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"28ebcb29407bc440cab54ac9","created_at":"2026-08-13T13:19:26.457Z","trace_propagation_headers":{"sentry-trace":"f540fb3a378c498896453f5c0d88faaa-e3f2347f920b47dc","baggage":"sentry-trace_id=f540fb3a378c498896453f5c0d88faaa,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZXME2Y0M0QGCJC99SVX5ENK","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:19:26.489Z","job_size_bytes":185,"pid":3454,"sidekiq_tid":"m8le","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-28ebcb29407bc440cab54ac9: done: 1.556967 sec","job_status":"done","queue_duration_s":92.269495,"scheduling_latency_s":92.269517,"gitaly_calls":13,"gitaly_duration_s":0.347487,"redis_calls":198,"redis_allowed_cross_slot_calls":6,"redis_duration_s":0.067747,"redis_read_bytes":2103,"redis_write_bytes":21748,"redis_cache_calls":15,"redis_cache_duration_s":0.006886,"redis_cache_read_bytes":20,"redis_cache_write_bytes":991,"redis_feature_flag_calls":27,"redis_feature_flag_duration_s":0.009261,"redis_feature_flag_read_bytes":1678,"redis_feature_flag_write_bytes":3082,"redis_queues_calls":10,"redis_queues_duration_s":0.002375,"redis_queues_read_bytes":10,"redis_queues_write_bytes":7836,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.006541,"redis_queues_metadata_read_bytes":13,"redis_queues_metadata_write_bytes":1467,"redis_repository_cache_calls":90,"redis_repository_cache_allowed_cross_slot_calls":6,"redis_repository_cache_duration_s":0.025471,"redis_repository_cache_read_bytes":249,"redis_repository_cache_write_bytes":6237,"redis_shared_state_calls":46,"redis_shared_state_duration_s":0.017213,"redis_shared_state_read_bytes":133,"redis_shared_state_write_bytes":2135,"db_count":47,"db_write_count":8,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":47,"db_replica_write_count":0,"db_primary_write_count":8,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.091,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":47,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":8,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.346,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.393,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.091,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":1.057785,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00084594,"exclusive_lock_hold_duration_s":0.04016756,"duration_s":1.556967,"completed_at":"2026-08-13T13:21:00.315Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.160443,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2265gitlab # [ 426.594462] sidekiq-cluster[3454]: {"severity":"INFO","time":"2026-08-13T13:21:00.317Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","d91f803177b21f3f0989157b74e357c736589f91 a79f628c9ab249a05c7812dd8cb5fa5e1935c219 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"a45f360883c7c3c10abd27af","created_at":"2026-08-13T13:19:31.816Z","trace_propagation_headers":{"sentry-trace":"4215cff1199e4c8d809a68e22cd2d368-2b602c4e6b5b4112","baggage":"sentry-trace_id=4215cff1199e4c8d809a68e22cd2d368,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZXME8YW2W3Z33W7AYXPFKX1","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:19:31.820Z","job_size_bytes":185,"pid":3454,"sidekiq_tid":"m8le","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-a45f360883c7c3c10abd27af: start","job_status":"start","queue_duration_s":88.497145,"scheduling_latency_s":88.497173}2266gitlab # [ 426.613349] sidekiq-cluster[3454]: {"severity":"INFO","time":"2026-08-13T13:21:00.333Z","message":"changes: \"d91f803177b21f3f0989157b74e357c736589f91 a79f628c9ab249a05c7812dd8cb5fa5e1935c219 refs/heads/master\\n\""}2267gitlab # [ 426.615840] sidekiq-cluster[3454]: {"severity":"INFO","time":"2026-08-13T13:21:00.407Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"f440a199f14aa338946e5fcb","created_at":"2026-08-13T13:21:00.403Z","trace_propagation_headers":{"sentry-trace":"4215cff1199e4c8d809a68e22cd2d368-58306ce7eb214956","baggage":"sentry-trace_id=4215cff1199e4c8d809a68e22cd2d368,sentry-release=Unknown"},"correlation_id":"01KZXME8YW2W3Z33W7AYXPFKX1","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","duplicate-of":"d4f7fe8e2a8302895a5e1d3d","job_size_bytes":46,"pid":3454,"job_status":"deduplicated","message":"ProjectCacheWorker JID-f440a199f14aa338946e5fcb: deduplicated: until executing","deduplication.type":"until executing"}2268gitlab # [ 426.631218] gitaly[895]: time="2026-08-13T13:21:00.371Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01KZXME8YW2W3Z33W7AYXPFKX1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-13T13:21:10.259" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-08-13T13:21:00.360" grpc.time_ms=10.202 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2269gitlab # [ 426.644838] gitaly[895]: time="2026-08-13T13:21:00.398Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZXME8YW2W3Z33W7AYXPFKX1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-13T13:21:10.281" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-13T13:21:00.381" grpc.time_ms=16.388 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2270gitlab # [ 426.658356] gitaly[895]: time="2026-08-13T13:21:00.453Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=583 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01KZXME8YW2W3Z33W7AYXPFKX1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-08-13T13:21:10.024" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=266 grpc.service=gitaly.RefService grpc.start_time="2026-08-13T13:21:00.435" grpc.time_ms=17.86 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2271gitlab # [ 426.671973] gitaly[895]: time="2026-08-13T13:21:00.483Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=596 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=3 command.system_time_ms=6 command.user_time_ms=6 component=gitaly.StreamServerInterceptor correlation_id=01KZXME8YW2W3Z33W7AYXPFKX1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommits grpc.request.deadline="2026-08-13T13:21:30.162" grpc.request.fullMethod=/gitaly.CommitService/ListCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=212 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-13T13:21:00.462" grpc.time_ms=19.952 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2272gitlab # [ 426.690716] gitaly[895]: time="2026-08-13T13:21:00.516Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=318 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=4 component=gitaly.StreamServerInterceptor correlation_id=01KZXME8YW2W3Z33W7AYXPFKX1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-08-13T13:21:10.095" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=116 grpc.service=gitaly.DiffService grpc.start_time="2026-08-13T13:21:00.505" grpc.time_ms=11.22 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2273gitlab # [ 426.727058] gitaly[895]: time="2026-08-13T13:21:00.548Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=2 command.system_time_ms=4 command.user_time_ms=4 component=gitaly.StreamServerInterceptor correlation_id=01KZXME8YW2W3Z33W7AYXPFKX1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-13T13:21:10.126" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-13T13:21:00.536" grpc.time_ms=11.839 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2274gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219'2275gitlab # [ 426.833828] nixbot[3544]: INFO: ::ffff:127.0.0.1:58176 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219 HTTP/1.1" 200 OK2276gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219', in 0.07 seconds)2277gitlab # [ 427.044890] gitaly[895]: time="2026-08-13T13:21:00.871Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZXME8YW2W3Z33W7AYXPFKX1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-08-13T13:21:10.008" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-13T13:21:00.728" grpc.time_ms=142.352 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2278gitlab # [ 427.091581] sidekiq-cluster[3454]: {"severity":"INFO","time":"2026-08-13T13:21:00.916Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","d91f803177b21f3f0989157b74e357c736589f91 a79f628c9ab249a05c7812dd8cb5fa5e1935c219 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"a45f360883c7c3c10abd27af","created_at":"2026-08-13T13:19:31.816Z","trace_propagation_headers":{"sentry-trace":"4215cff1199e4c8d809a68e22cd2d368-2b602c4e6b5b4112","baggage":"sentry-trace_id=4215cff1199e4c8d809a68e22cd2d368,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZXME8YW2W3Z33W7AYXPFKX1","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:19:31.820Z","job_size_bytes":185,"pid":3454,"sidekiq_tid":"m8le","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-a45f360883c7c3c10abd27af: done: 0.598682 sec","job_status":"done","queue_duration_s":88.497145,"scheduling_latency_s":88.497173,"gitaly_calls":7,"gitaly_duration_s":0.263758,"redis_calls":110,"redis_allowed_cross_slot_calls":4,"redis_duration_s":0.032317,"redis_read_bytes":500,"redis_write_bytes":11942,"redis_cache_calls":9,"redis_cache_duration_s":0.003739,"redis_cache_read_bytes":14,"redis_cache_write_bytes":593,"redis_queues_calls":6,"redis_queues_duration_s":0.001608,"redis_queues_read_bytes":8,"redis_queues_write_bytes":5719,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.00409,"redis_queues_metadata_read_bytes":163,"redis_queues_metadata_write_bytes":1428,"redis_repository_cache_calls":41,"redis_repository_cache_allowed_cross_slot_calls":4,"redis_repository_cache_duration_s":0.011332,"redis_repository_cache_read_bytes":176,"redis_repository_cache_write_bytes":2193,"redis_shared_state_calls":44,"redis_shared_state_duration_s":0.011548,"redis_shared_state_read_bytes":139,"redis_shared_state_write_bytes":2009,"db_count":28,"db_write_count":3,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":28,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.046,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":28,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.051,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.051,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.046,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.429881,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00106582,"exclusive_lock_hold_duration_s":0.02921568,"duration_s":0.598682,"completed_at":"2026-08-13T13:21:00.916Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.049213,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2279gitlab # [ 427.192760] sidekiq-cluster[3454]: {"severity":"INFO","time":"2026-08-13T13:21:00.920Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"275f7d1a2138e7edf629d331","created_at":"2026-08-13T13:19:32.939Z","trace_propagation_headers":{"sentry-trace":"acaa85311dd14a6f9c056fed4bc31163-8f178eb7d2764ebc","baggage":"sentry-trace_id=acaa85311dd14a6f9c056fed4bc31163,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZXME9YMBHJA9PCJWRHTV330","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-08-13T13:19:32.949Z","job_size_bytes":65,"pid":3454,"sidekiq_tid":"m8le","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-275f7d1a2138e7edf629d331: start","job_status":"start","queue_duration_s":87.970366,"scheduling_latency_s":87.97042}2280gitlab # [ 427.270351] sidekiq-cluster[3454]: {"severity":"INFO","time":"2026-08-13T13:21:01.095Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"275f7d1a2138e7edf629d331","created_at":"2026-08-13T13:19:32.939Z","trace_propagation_headers":{"sentry-trace":"acaa85311dd14a6f9c056fed4bc31163-8f178eb7d2764ebc","baggage":"sentry-trace_id=acaa85311dd14a6f9c056fed4bc31163,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZXME9YMBHJA9PCJWRHTV330","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-08-13T13:19:32.949Z","job_size_bytes":65,"pid":3454,"sidekiq_tid":"m8le","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-275f7d1a2138e7edf629d331: done: 0.175927 sec","job_status":"done","queue_duration_s":87.970366,"scheduling_latency_s":87.97042,"redis_calls":16,"redis_duration_s":0.006749,"redis_read_bytes":269,"redis_write_bytes":1850,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.003363,"redis_feature_flag_read_bytes":262,"redis_feature_flag_write_bytes":1032,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002372,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":590,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001014,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":228,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.025,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.014,"db_ci_duration_s":0.011,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.121329,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00081414,"duration_s":0.175927,"completed_at":"2026-08-13T13:21:01.095Z","load_balancing_strategy":"primary","db_duration_s":0.041823,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2281gitlab # [ 427.354802] sidekiq-cluster[3454]: {"severity":"INFO","time":"2026-08-13T13:21:01.099Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"457f0a61359f8a4d3275db10","created_at":"2026-08-13T13:19:32.950Z","trace_propagation_headers":{"sentry-trace":"acaa85311dd14a6f9c056fed4bc31163-8f178eb7d2764ebc","baggage":"sentry-trace_id=acaa85311dd14a6f9c056fed4bc31163,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZXME9YMBHJA9PCJWRHTV330","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-08-13T13:19:32.958Z","job_size_bytes":65,"pid":3454,"sidekiq_tid":"m8le","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-457f0a61359f8a4d3275db10: start","job_status":"start","queue_duration_s":88.140889,"scheduling_latency_s":88.140921}2282gitlab # [ 427.469097] sidekiq-cluster[3454]: {"severity":"INFO","time":"2026-08-13T13:21:01.294Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"457f0a61359f8a4d3275db10","created_at":"2026-08-13T13:19:32.950Z","trace_propagation_headers":{"sentry-trace":"acaa85311dd14a6f9c056fed4bc31163-8f178eb7d2764ebc","baggage":"sentry-trace_id=acaa85311dd14a6f9c056fed4bc31163,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZXME9YMBHJA9PCJWRHTV330","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-08-13T13:19:32.958Z","job_size_bytes":65,"pid":3454,"sidekiq_tid":"m8le","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-457f0a61359f8a4d3275db10: done: 0.195644 sec","job_status":"done","queue_duration_s":88.140889,"scheduling_latency_s":88.140921,"redis_calls":21,"redis_duration_s":0.007731999999999999,"redis_read_bytes":148,"redis_write_bytes":2264,"redis_feature_flag_calls":9,"redis_feature_flag_duration_s":0.003658,"redis_feature_flag_read_bytes":136,"redis_feature_flag_write_bytes":1264,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002034,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":578,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.00204,"redis_shared_state_read_bytes":8,"redis_shared_state_write_bytes":422,"db_count":15,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.046,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.034,"db_ci_duration_s":0.012,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.126499,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0007047,"duration_s":0.195644,"completed_at":"2026-08-13T13:21:01.294Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.054574,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2283gitlab # [ 427.573991] sidekiq-cluster[3454]: {"severity":"INFO","time":"2026-08-13T13:21:01.297Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"d72e9e3818285b91ca8ab085","created_at":"2026-08-13T13:19:33.145Z","trace_propagation_headers":{"sentry-trace":"acaa85311dd14a6f9c056fed4bc31163-8f178eb7d2764ebc","baggage":"sentry-trace_id=acaa85311dd14a6f9c056fed4bc31163,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZXME9YMBHJA9PCJWRHTV330","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-13T13:19:33.154Z","job_size_bytes":3,"pid":3454,"sidekiq_tid":"m8le","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-d72e9e3818285b91ca8ab085: start","job_status":"start","queue_duration_s":88.143128,"scheduling_latency_s":88.143157}2284gitlab # [ 427.753322] gitaly[895]: time="2026-08-13T13:21:01.578Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZXME9YMBHJA9PCJWRHTV330 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3897 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-13T13:21:01.577" grpc.time_ms=0.838 pid=895 span.kind=server system=grpc2285gitlab # [ 427.808298] gitaly[895]: time="2026-08-13T13:21:01.634Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZXME9YMBHJA9PCJWRHTV330 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3895 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-13T13:21:01.633" grpc.time_ms=0.721 pid=895 span.kind=server system=grpc2286gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219'2287gitlab # [ 427.870619] gitaly[895]: time="2026-08-13T13:21:01.696Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZXME9YMBHJA9PCJWRHTV330 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3897 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-13T13:21:01.696" grpc.time_ms=0.798 pid=895 span.kind=server system=grpc2288gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219', in 0.06 seconds)2289gitlab # [ 427.899343] gitaly[895]: time="2026-08-13T13:21:01.708Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KZXME9YMBHJA9PCJWRHTV330 diskcache=36faaa7f-e7c3-4411-9226-f9c01595b451 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-13T13:21:31.218" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-13T13:21:01.519" pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2290gitlab # [ 427.922980] gitaly[895]: time="2026-08-13T13:21:01.709Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=206 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7483 command.oublock=0 command.real_time_ms=182 command.spawn_token_fork_ms=1 command.system_time_ms=123 command.user_time_ms=83 component=gitaly.UnaryServerInterceptor correlation_id=01KZXME9YMBHJA9PCJWRHTV330 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-13T13:21:31.218" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-13T13:21:01.519" grpc.time_ms=189.467 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2291gitlab # [ 427.947427] nixbot[3544]: INFO: ::ffff:127.0.0.1:58180 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219 HTTP/1.1" 200 OK2292gitlab # [ 428.069922] gitaly[895]: time="2026-08-13T13:21:01.896Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZXME9YMBHJA9PCJWRHTV330 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-13T13:21:31.593" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-13T13:21:01.894" grpc.time_ms=1.673 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2293gitlab # [ 428.127117] gitaly[895]: time="2026-08-13T13:21:01.953Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZXME9YMBHJA9PCJWRHTV330 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-13T13:21:31.651" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-13T13:21:01.951" grpc.time_ms=1.333 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2294gitlab # [ 428.164945] sidekiq-cluster[3454]: {"severity":"INFO","time":"2026-08-13T13:21:01.985Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"d72e9e3818285b91ca8ab085","created_at":"2026-08-13T13:19:33.145Z","trace_propagation_headers":{"sentry-trace":"acaa85311dd14a6f9c056fed4bc31163-8f178eb7d2764ebc","baggage":"sentry-trace_id=acaa85311dd14a6f9c056fed4bc31163,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZXME9YMBHJA9PCJWRHTV330","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-13T13:19:33.154Z","job_size_bytes":3,"pid":3454,"sidekiq_tid":"m8le","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-d72e9e3818285b91ca8ab085: done: 0.688275 sec","job_status":"done","queue_duration_s":88.143128,"scheduling_latency_s":88.143157,"gitaly_calls":3,"gitaly_duration_s":0.20291,"redis_calls":117,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.037493,"redis_read_bytes":457,"redis_write_bytes":28000,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.001753,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.001624,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_feature_flag_calls":40,"redis_feature_flag_duration_s":0.012768,"redis_feature_flag_read_bytes":294,"redis_feature_flag_write_bytes":6581,"redis_queues_calls":25,"redis_queues_duration_s":0.005169,"redis_queues_read_bytes":36,"redis_queues_write_bytes":14494,"redis_queues_metadata_calls":21,"redis_queues_metadata_duration_s":0.009858,"redis_queues_metadata_read_bytes":32,"redis_queues_metadata_write_bytes":3370,"redis_rate_limiting_calls":2,"redis_rate_limiting_duration_s":0.00092,"redis_rate_limiting_read_bytes":2,"redis_rate_limiting_write_bytes":166,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000775,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002873,"redis_shared_state_read_bytes":11,"redis_shared_state_write_bytes":851,"db_count":52,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":52,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.096,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":35,"db_ci_count":17,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.037,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.042,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.045,"db_ci_duration_s":0.05,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.355532,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.5908692799999999,"duration_s":0.688275,"completed_at":"2026-08-13T13:21:01.985Z","load_balancing_strategy":"primary","db_duration_s":0.112682,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2295gitlab # [ 428.257204] sidekiq-cluster[3454]: {"severity":"INFO","time":"2026-08-13T13:21:01.991Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"d4f7fe8e2a8302895a5e1d3d","created_at":"2026-08-13T13:20:58.862Z","trace_propagation_headers":{"sentry-trace":"f540fb3a378c498896453f5c0d88faaa-81468994dc374a5f","baggage":"sentry-trace_id=f540fb3a378c498896453f5c0d88faaa,sentry-release=Unknown"},"correlation_id":"01KZXME2Y0M0QGCJC99SVX5ENK","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-08-13T13:20:58.887Z","job_size_bytes":46,"pid":3454,"sidekiq_tid":"m8le","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-d4f7fe8e2a8302895a5e1d3d: start","job_status":"start","queue_duration_s":3.103938,"scheduling_latency_s":3.103984}2296gitlab # [ 428.285998] gitaly[895]: time="2026-08-13T13:21:02.112Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KZXME2Y0M0QGCJC99SVX5ENK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryInfo grpc.request.deadline="2026-08-13T19:21:02.100" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryInfo grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-13T13:21:02.101" grpc.time_ms=10.248 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2297gitlab # [ 428.323902] gitaly[895]: time="2026-08-13T13:21:02.150Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=595 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=2 command.system_time_ms=7 command.user_time_ms=7 component=gitaly.UnaryServerInterceptor correlation_id=01KZXME2Y0M0QGCJC99SVX5ENK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-08-13T13:21:32.030" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-08-13T13:21:02.131" grpc.time_ms=18.684 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2298gitlab # [ 428.388523] sidekiq-cluster[3454]: {"severity":"INFO","time":"2026-08-13T13:21:02.213Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"d4f7fe8e2a8302895a5e1d3d","created_at":"2026-08-13T13:20:58.862Z","trace_propagation_headers":{"sentry-trace":"f540fb3a378c498896453f5c0d88faaa-81468994dc374a5f","baggage":"sentry-trace_id=f540fb3a378c498896453f5c0d88faaa,sentry-release=Unknown"},"correlation_id":"01KZXME2Y0M0QGCJC99SVX5ENK","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-08-13T13:20:58.887Z","job_size_bytes":46,"pid":3454,"sidekiq_tid":"m8le","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-d4f7fe8e2a8302895a5e1d3d: done: 0.22271 sec","job_status":"done","queue_duration_s":3.103938,"scheduling_latency_s":3.103984,"gitaly_calls":2,"gitaly_duration_s":0.037658,"redis_calls":30,"redis_allowed_cross_slot_calls":2,"redis_duration_s":0.013755999999999999,"redis_read_bytes":69,"redis_write_bytes":4886,"redis_feature_flag_calls":6,"redis_feature_flag_duration_s":0.002652,"redis_feature_flag_read_bytes":6,"redis_feature_flag_write_bytes":1005,"redis_queues_calls":3,"redis_queues_duration_s":0.001055,"redis_queues_read_bytes":4,"redis_queues_write_bytes":2114,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002819,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":710,"redis_repository_cache_calls":11,"redis_repository_cache_allowed_cross_slot_calls":2,"redis_repository_cache_duration_s":0.006013,"redis_repository_cache_read_bytes":48,"redis_repository_cache_write_bytes":753,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.001217,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":304,"db_count":10,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":10,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.015,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":2,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.005,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.005,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.015,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.149882,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00065338,"duration_s":0.22271,"completed_at":"2026-08-13T13:21:02.213Z","load_balancing_strategy":"primary","db_duration_s":0.021391,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2299gitlab # [ 428.481889] sidekiq-cluster[3454]: {"severity":"INFO","time":"2026-08-13T13:21:02.217Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"c5641f17cdb59de011ddf8a9","created_at":"2026-08-13T13:20:58.912Z","trace_propagation_headers":{"sentry-trace":"f540fb3a378c498896453f5c0d88faaa-81468994dc374a5f","baggage":"sentry-trace_id=f540fb3a378c498896453f5c0d88faaa,sentry-release=Unknown"},"correlation_id":"01KZXME2Y0M0QGCJC99SVX5ENK","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-08-13T13:20:58.920Z","job_size_bytes":3,"pid":3454,"sidekiq_tid":"m8le","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-c5641f17cdb59de011ddf8a9: start","job_status":"start","queue_duration_s":3.29661,"scheduling_latency_s":3.296653}2300gitlab # [ 428.504382] gitaly[895]: time="2026-08-13T13:21:02.304Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KZXME2Y0M0QGCJC99SVX5ENK diskcache=3877fe3e-6098-4e5f-8dca-a79f9c0ae630 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-08-13T19:21:02.263" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-08-13T13:21:02.263" pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2301gitlab # [ 428.517010] gitaly[895]: time="2026-08-13T13:21:02.305Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=4 command.cpu_time_ms=27 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1172 command.oublock=0 command.real_time_ms=50 command.spawn_token_fork_ms=4 command.system_time_ms=13 command.user_time_ms=14 component=gitaly.UnaryServerInterceptor correlation_id=01KZXME2Y0M0QGCJC99SVX5ENK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-08-13T19:21:02.263" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-08-13T13:21:02.263" grpc.time_ms=41.083 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2302gitlab # [ 428.574694] sidekiq-cluster[3454]: {"severity":"INFO","time":"2026-08-13T13:21:02.399Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"c5641f17cdb59de011ddf8a9","created_at":"2026-08-13T13:20:58.912Z","trace_propagation_headers":{"sentry-trace":"f540fb3a378c498896453f5c0d88faaa-81468994dc374a5f","baggage":"sentry-trace_id=f540fb3a378c498896453f5c0d88faaa,sentry-release=Unknown"},"correlation_id":"01KZXME2Y0M0QGCJC99SVX5ENK","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-08-13T13:20:58.920Z","job_size_bytes":3,"pid":3454,"sidekiq_tid":"m8le","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-c5641f17cdb59de011ddf8a9: done: 0.182034 sec","job_status":"done","queue_duration_s":3.29661,"scheduling_latency_s":3.296653,"gitaly_calls":1,"gitaly_duration_s":0.045276,"redis_calls":15,"redis_duration_s":0.006489,"redis_read_bytes":68,"redis_write_bytes":1520,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00061,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002541,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":558,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.001028,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00231,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":520,"db_count":12,"db_write_count":4,"db_cached_count":0,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":4,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.02,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":4,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.026,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.049,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.02,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.094113,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.13069078,"duration_s":0.182034,"completed_at":"2026-08-13T13:21:02.398Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.033274,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2303gitlab # [ 428.649534] sidekiq-cluster[3454]: {"severity":"INFO","time":"2026-08-13T13:21:02.402Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"66ffccfedc8c3a8d3edc2663","created_at":"2026-08-13T13:20:59.101Z","trace_propagation_headers":{"sentry-trace":"f540fb3a378c498896453f5c0d88faaa-81468994dc374a5f","baggage":"sentry-trace_id=f540fb3a378c498896453f5c0d88faaa,sentry-release=Unknown"},"correlation_id":"01KZXME2Y0M0QGCJC99SVX5ENK","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-08-13T13:20:59.104Z","job_size_bytes":23,"pid":3454,"sidekiq_tid":"m8le","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-66ffccfedc8c3a8d3edc2663: start","job_status":"start","queue_duration_s":3.29734,"scheduling_latency_s":3.297381}2304gitlab # [ 428.668574] gitaly[895]: time="2026-08-13T13:21:02.470Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=15 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=597 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=11 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01KZXME2Y0M0QGCJC99SVX5ENK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-08-13T13:21:32.351" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-08-13T13:21:02.452" grpc.time_ms=18.354 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2305gitlab # [ 428.682918] sidekiq-cluster[3454]: {"severity":"INFO","time":"2026-08-13T13:21:02.487Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"66ffccfedc8c3a8d3edc2663","created_at":"2026-08-13T13:20:59.101Z","trace_propagation_headers":{"sentry-trace":"f540fb3a378c498896453f5c0d88faaa-81468994dc374a5f","baggage":"sentry-trace_id=f540fb3a378c498896453f5c0d88faaa,sentry-release=Unknown"},"correlation_id":"01KZXME2Y0M0QGCJC99SVX5ENK","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-08-13T13:20:59.104Z","job_size_bytes":23,"pid":3454,"sidekiq_tid":"m8le","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-66ffccfedc8c3a8d3edc2663: done: 0.08547 sec","job_status":"done","queue_duration_s":3.29734,"scheduling_latency_s":3.297381,"gitaly_calls":1,"gitaly_duration_s":0.022132,"redis_calls":16,"redis_duration_s":0.00573,"redis_read_bytes":52,"redis_write_bytes":2048,"redis_queues_calls":1,"redis_queues_duration_s":0.000489,"redis_queues_read_bytes":1,"redis_queues_write_bytes":979,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001662,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":437,"redis_repository_cache_calls":7,"redis_repository_cache_duration_s":0.002556,"redis_repository_cache_read_bytes":44,"redis_repository_cache_write_bytes":344,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.001023,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":288,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.049441,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.08547,"completed_at":"2026-08-13T13:21:02.487Z","load_balancing_strategy":"primary","db_duration_s":0.005966,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2306gitlab # [ 428.728469] sidekiq-cluster[3454]: {"severity":"INFO","time":"2026-08-13T13:21:02.490Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"c4b069f630b368fdf536406c","created_at":"2026-08-13T13:20:59.987Z","trace_propagation_headers":{"sentry-trace":"f540fb3a378c498896453f5c0d88faaa-81468994dc374a5f","baggage":"sentry-trace_id=f540fb3a378c498896453f5c0d88faaa,sentry-release=Unknown"},"correlation_id":"01KZXME2Y0M0QGCJC99SVX5ENK","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4da6be2a8cad1a2ced3f6506075b207f9a96870e29ee587d5497ff41da186528","size_limiter":"validated","enqueued_at":"2026-08-13T13:21:00.000Z","job_size_bytes":467,"pid":3454,"sidekiq_tid":"m8le","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-c4b069f630b368fdf536406c: start","job_status":"start","queue_duration_s":2.489767,"scheduling_latency_s":2.489799}2307gitlab # [ 428.745487] gitaly[895]: time="2026-08-13T13:21:02.534Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZXME2Y0M0QGCJC99SVX5ENK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-13T13:21:32.432" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-13T13:21:02.532" grpc.time_ms=1.022 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2308gitlab # [ 428.758362] gitaly[895]: time="2026-08-13T13:21:02.555Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=575 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZXME2Y0M0QGCJC99SVX5ENK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-08-13T13:21:12.127" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-08-13T13:21:02.537" grpc.time_ms=17.15 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2309gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219'2310gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219', in 0.07 seconds)2311gitlab # [ 428.965861] nixbot[3544]: INFO: ::ffff:127.0.0.1:58184 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219 HTTP/1.1" 200 OK2312gitlab # [ 428.972385] gitaly[895]: time="2026-08-13T13:21:02.798Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZXME2Y0M0QGCJC99SVX5ENK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-13T13:21:32.695" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-13T13:21:02.797" grpc.time_ms=1.45 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2313gitlab # [ 429.005094] gitaly[895]: time="2026-08-13T13:21:02.811Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=33 command.oublock=0 command.real_time_ms=2 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZXME2Y0M0QGCJC99SVX5ENK error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-08-13T13:21:32.706" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-13T13:21:02.807" grpc.time_ms=4.398 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2314gitlab # [ 429.160410] gitaly[895]: time="2026-08-13T13:21:02.986Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZXME2Y0M0QGCJC99SVX5ENK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-13T13:21:12.247" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-13T13:21:02.968" grpc.time_ms=18.099 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2315gitlab # [ 429.832990] gitaly[895]: time="2026-08-13T13:21:03.658Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=21 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=880 command.oublock=0 command.real_time_ms=23 command.spawn_token_fork_ms=2 command.system_time_ms=14 command.user_time_ms=7 component=gitaly.StreamServerInterceptor correlation_id=01KZXME2Y0M0QGCJC99SVX5ENK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-08-13T13:21:33.529" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-08-13T13:21:03.629" grpc.time_ms=28.055 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2316gitlab # [ 429.851968] gitaly[895]: time="2026-08-13T13:21:03.678Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=1 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZXME2Y0M0QGCJC99SVX5ENK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-08-13T13:21:33.563" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-08-13T13:21:03.664" grpc.time_ms=14.028 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2317gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219'2318gitlab # [ 429.918828] sidekiq-cluster[3454]: {"severity":"WARN","time":"2026-08-13T13:21:03.743Z","class":"CreatePipelineWorker","correlation_id":"01KZXME2Y0M0QGCJC99SVX5ENK","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"0000000000000000000000000000000000000000","after":"d91f803177b21f3f0989157b74e357c736589f91","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"d91f803177b21f3f0989157b74e357c736589f91","ref":"refs/heads/master"},"retry":0}2319gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219', in 0.07 seconds)2320gitlab # [ 429.973343] sidekiq-cluster[3454]: {"severity":"INFO","time":"2026-08-13T13:21:03.761Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"c4b069f630b368fdf536406c","created_at":"2026-08-13T13:20:59.987Z","trace_propagation_headers":{"sentry-trace":"f540fb3a378c498896453f5c0d88faaa-81468994dc374a5f","baggage":"sentry-trace_id=f540fb3a378c498896453f5c0d88faaa,sentry-release=Unknown"},"correlation_id":"01KZXME2Y0M0QGCJC99SVX5ENK","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4da6be2a8cad1a2ced3f6506075b207f9a96870e29ee587d5497ff41da186528","size_limiter":"validated","enqueued_at":"2026-08-13T13:21:00.000Z","job_size_bytes":467,"pid":3454,"sidekiq_tid":"m8le","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-c4b069f630b368fdf536406c: done: 1.271212 sec","job_status":"done","queue_duration_s":2.489767,"scheduling_latency_s":2.489799,"gitaly_calls":7,"gitaly_duration_s":0.114149,"redis_calls":51,"redis_duration_s":0.016975,"redis_read_bytes":169,"redis_write_bytes":4167,"redis_cache_calls":4,"redis_cache_duration_s":0.001736,"redis_cache_read_bytes":10,"redis_cache_write_bytes":342,"redis_feature_flag_calls":16,"redis_feature_flag_duration_s":0.007252,"redis_feature_flag_read_bytes":16,"redis_feature_flag_write_bytes":2174,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002129,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":510,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.004031,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001827,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":513,"db_count":36,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":36,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.052,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":32,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.045,"db_ci_duration_s":0.007,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":1.075436,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00096278,"duration_s":1.271212,"completed_at":"2026-08-13T13:21:03.761Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.091843,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2321gitlab # [ 430.054551] sidekiq-cluster[3454]: {"severity":"INFO","time":"2026-08-13T13:21:03.765Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{\"idempotency_key\"=\u003e\"0756cc32-ab9b-4b6d-b284-45eee01d0a05\"}"],"class":"WebHookWorker","jid":"ba62c76fe244b8ae0f9af6b9","created_at":"2026-08-13T13:21:00.224Z","trace_propagation_headers":{"sentry-trace":"f540fb3a378c498896453f5c0d88faaa-81468994dc374a5f","baggage":"sentry-trace_id=f540fb3a378c498896453f5c0d88faaa,sentry-release=Unknown"},"correlation_id":"01KZXME2Y0M0QGCJC99SVX5ENK","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:848fa4c020bf69bf5307c89ff1b1e2fd64840cc48e7b472755d952c984dd034d","size_limiter":"validated","enqueued_at":"2026-08-13T13:21:00.232Z","job_size_bytes":1751,"pid":3454,"sidekiq_tid":"m8le","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-ba62c76fe244b8ae0f9af6b9: start","job_status":"start","queue_duration_s":3.532597,"scheduling_latency_s":3.532635}2322gitlab # [ 430.080530] nixbot[3544]: INFO: ::ffff:127.0.0.1:58186 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219 HTTP/1.1" 200 OK2323gitlab # [ 430.155112] nixbot[3544]: INFO: ::ffff:127.0.0.1:58198 - "POST /webhooks/gitlab HTTP/1.1" 202 Accepted2324gitlab # [ 430.201138] sidekiq-cluster[3454]: {"severity":"INFO","time":"2026-08-13T13:21:04.025Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{:idempotency_key=\u003e\"0756cc32-ab9b-4b6d-b284-45eee01d0a05\"}"],"class":"WebHookWorker","jid":"ba62c76fe244b8ae0f9af6b9","created_at":"2026-08-13T13:21:00.224Z","trace_propagation_headers":{"sentry-trace":"f540fb3a378c498896453f5c0d88faaa-81468994dc374a5f","baggage":"sentry-trace_id=f540fb3a378c498896453f5c0d88faaa,sentry-release=Unknown"},"correlation_id":"01KZXME2Y0M0QGCJC99SVX5ENK","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:848fa4c020bf69bf5307c89ff1b1e2fd64840cc48e7b472755d952c984dd034d","size_limiter":"validated","enqueued_at":"2026-08-13T13:21:00.232Z","job_size_bytes":1751,"pid":3454,"sidekiq_tid":"m8le","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-ba62c76fe244b8ae0f9af6b9: done: 0.261 sec","job_status":"done","queue_duration_s":3.532597,"scheduling_latency_s":3.532635,"redis_calls":19,"redis_duration_s":0.007852,"redis_read_bytes":32,"redis_write_bytes":5367,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001683,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":622,"redis_queues_calls":2,"redis_queues_duration_s":0.000813,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3729,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.003749,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":690,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001607,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":326,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"external_http_count":1,"external_http_duration_s":0.08698565999998209,"cpu_s":0.146713,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00150246,"extra.web_hook_worker.response_status":"success","extra.web_hook_worker.http_status":"ok","extra.web_hook_worker.signing_token_present":false,"duration_s":0.261,"completed_at":"2026-08-13T13:21:04.025Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005763,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2325gitlab # [ 430.301973] sidekiq-cluster[3454]: {"severity":"INFO","time":"2026-08-13T13:21:04.030Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"5c2d117d81b9007d925d173b","created_at":"2026-08-13T13:21:00.421Z","trace_propagation_headers":{"sentry-trace":"4215cff1199e4c8d809a68e22cd2d368-58306ce7eb214956","baggage":"sentry-trace_id=4215cff1199e4c8d809a68e22cd2d368,sentry-release=Unknown"},"correlation_id":"01KZXME8YW2W3Z33W7AYXPFKX1","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","duplicate-of":"c5641f17cdb59de011ddf8a9","size_limiter":"validated","enqueued_at":"2026-08-13T13:21:00.427Z","job_size_bytes":3,"pid":3454,"sidekiq_tid":"m8le","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-5c2d117d81b9007d925d173b: start","job_status":"start","queue_duration_s":3.60257,"scheduling_latency_s":3.602618}2326gitlab # [ 430.325018] gitaly[895]: time="2026-08-13T13:21:04.091Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KZXME8YW2W3Z33W7AYXPFKX1 diskcache=9d8b8e3b-2546-426a-90ba-61f4adf9167e grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-08-13T19:21:04.075" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-08-13T13:21:04.076" pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2327gitlab # [ 430.336355] gitaly[895]: time="2026-08-13T13:21:04.091Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=289 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01KZXME8YW2W3Z33W7AYXPFKX1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-08-13T19:21:04.075" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-08-13T13:21:04.076" grpc.time_ms=15.239 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2328gitlab # [ 430.350227] sidekiq-cluster[3454]: {"severity":"INFO","time":"2026-08-13T13:21:04.134Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"5c2d117d81b9007d925d173b","created_at":"2026-08-13T13:21:00.421Z","trace_propagation_headers":{"sentry-trace":"4215cff1199e4c8d809a68e22cd2d368-58306ce7eb214956","baggage":"sentry-trace_id=4215cff1199e4c8d809a68e22cd2d368,sentry-release=Unknown"},"correlation_id":"01KZXME8YW2W3Z33W7AYXPFKX1","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","duplicate-of":"c5641f17cdb59de011ddf8a9","size_limiter":"validated","enqueued_at":"2026-08-13T13:21:00.427Z","job_size_bytes":3,"pid":3454,"sidekiq_tid":"m8le","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-5c2d117d81b9007d925d173b: done: 0.104627 sec","job_status":"done","queue_duration_s":3.60257,"scheduling_latency_s":3.602618,"gitaly_calls":1,"gitaly_duration_s":0.020479,"redis_calls":12,"redis_duration_s":0.004826,"redis_read_bytes":64,"redis_write_bytes":1136,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001935,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":479,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.001106,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001785,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":520,"db_count":8,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.015,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.017,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.017,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.015,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.063066,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.05846284,"duration_s":0.104627,"completed_at":"2026-08-13T13:21:04.134Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.015682,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2329gitlab # [ 430.396479] sidekiq-cluster[3454]: {"severity":"INFO","time":"2026-08-13T13:21:04.137Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"16e29840276662c8e3c47dfe","created_at":"2026-08-13T13:21:00.662Z","trace_propagation_headers":{"sentry-trace":"4215cff1199e4c8d809a68e22cd2d368-58306ce7eb214956","baggage":"sentry-trace_id=4215cff1199e4c8d809a68e22cd2d368,sentry-release=Unknown"},"correlation_id":"01KZXME8YW2W3Z33W7AYXPFKX1","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:728235c66c636cf5e11c4e6d71303c5db161c05df93405362e0a507d03c4d895","size_limiter":"validated","enqueued_at":"2026-08-13T13:21:00.670Z","job_size_bytes":467,"pid":3454,"sidekiq_tid":"m8le","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-16e29840276662c8e3c47dfe: start","job_status":"start","queue_duration_s":3.46747,"scheduling_latency_s":3.467508}2330gitlab # [ 430.413859] gitaly[895]: time="2026-08-13T13:21:04.180Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZXME8YW2W3Z33W7AYXPFKX1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-13T13:21:34.078" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-13T13:21:04.179" grpc.time_ms=1.031 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2331gitlab # [ 430.426129] gitaly[895]: time="2026-08-13T13:21:04.202Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=1 command.system_time_ms=7 command.user_time_ms=7 component=gitaly.UnaryServerInterceptor correlation_id=01KZXME8YW2W3Z33W7AYXPFKX1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-08-13T13:21:14.003" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-08-13T13:21:04.184" grpc.time_ms=18.333 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2332gitlab # [ 430.439378] gitaly[895]: time="2026-08-13T13:21:04.265Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=580 command.oublock=0 command.real_time_ms=18 command.spawn_token_fork_ms=2 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZXMH3J4527N3VPZRWHD8JK3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-13T13:21:04.244" grpc.time_ms=20.057 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc2333gitlab # [ 430.452896] gitaly[895]: time="2026-08-13T13:21:04.279Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZXME8YW2W3Z33W7AYXPFKX1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-13T13:21:34.175" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-13T13:21:04.276" grpc.time_ms=1.239 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2334gitlab # [ 430.466060] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/13:13:21:04 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 1982335gitlab # [ 430.468128] gitaly[895]: time="2026-08-13T13:21:04.288Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=21 command.oublock=0 command.real_time_ms=2 command.spawn_token_fork_ms=1 command.system_time_ms=0 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01KZXME8YW2W3Z33W7AYXPFKX1 error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-08-13T13:21:34.184" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-13T13:21:04.284" grpc.time_ms=3.495 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2336gitlab # [ 430.529073] gitaly[895]: time="2026-08-13T13:21:04.355Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=1 command.system_time_ms=7 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01KZXME8YW2W3Z33W7AYXPFKX1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-13T13:21:14.161" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-13T13:21:04.342" grpc.time_ms=13.227 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2337gitlab # [ 430.565467] gitaly[895]: time="2026-08-13T13:21:04.374Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01KZXMH3RD0BKYM0X8B3KX5541 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-13T13:21:04.361" pid=895 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2338gitlab # [ 430.584251] gitlab-workhorse[817]: time="2026-08-13T13:21:04Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672339gitlab # [ 430.587138] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/13:13:21:04 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 1052340gitlab # [ 430.590377] gitaly[895]: time="2026-08-13T13:21:04.374Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=1 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZXMH3RD0BKYM0X8B3KX5541 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-13T13:21:04.361" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc2341gitlab # [ 430.610242] nixbot[3544]: {"ts": "2026-08-13T13:21:04.413Z", "level": "info", "logger": "nixbot.build_reuse", "msg": "reusing build for tree hash", "build_id": 1, "tree_hash": "a8c90de643fa3b1e78fc9dc27f18f04a936ba912"}2342gitlab # [ 430.614013] gitaly[895]: time="2026-08-13T13:21:04.374Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=1 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZXMH3RD0BKYM0X8B3KX5541 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-13T13:21:04.361" grpc.time_ms=12.667 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc2343gitlab # [ 430.928561] gitaly[895]: time="2026-08-13T13:21:04.753Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZXMH3XA6XV0MPJSRSBGJKFR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-13T13:21:34.651" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-13T13:21:04.752" grpc.time_ms=1.217 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2344gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219'2345gitlab # [ 431.095613] nixbot[3544]: INFO: ::ffff:127.0.0.1:57786 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219 HTTP/1.1" 200 OK2346gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219', in 0.07 seconds)2347gitlab # [ 431.125163] gitaly[895]: time="2026-08-13T13:21:04.951Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=2 command.system_time_ms=5 command.user_time_ms=5 component=gitaly.StreamServerInterceptor correlation_id=01KZXMH3XA6XV0MPJSRSBGJKFR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-13T13:21:14.005" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-13T13:21:04.936" grpc.time_ms=14.745 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2348gitlab # [ 431.255449] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/13:13:21:05 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/d91f803177b21f3f0989157b74e357c736589f91 HTTP/1.1" 201 657 "" "python-httpx/0.28.1" 6542349gitlab # [ 431.264217] nixbot[3544]: {"ts": "2026-08-13T13:21:05.083Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/d91f803177b21f3f0989157b74e357c736589f91 \"HTTP/1.1 201 Created\""}2350gitlab # [ 431.272893] gitaly[895]: time="2026-08-13T13:21:05.086Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=15 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=881 command.oublock=0 command.real_time_ms=19 command.spawn_token_fork_ms=3 command.system_time_ms=9 command.user_time_ms=6 component=gitaly.StreamServerInterceptor correlation_id=01KZXME8YW2W3Z33W7AYXPFKX1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-08-13T13:21:35.061" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-08-13T13:21:05.061" grpc.time_ms=24.242 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2351gitlab # [ 431.310206] gitaly[895]: time="2026-08-13T13:21:05.105Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=3 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZXME8YW2W3Z33W7AYXPFKX1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-08-13T13:21:35.088" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-08-13T13:21:05.089" grpc.time_ms=16.543 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2352gitlab # [ 431.336459] sidekiq-cluster[3454]: {"severity":"WARN","time":"2026-08-13T13:21:05.125Z","class":"CreatePipelineWorker","correlation_id":"01KZXME8YW2W3Z33W7AYXPFKX1","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"d91f803177b21f3f0989157b74e357c736589f91","after":"a79f628c9ab249a05c7812dd8cb5fa5e1935c219","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"a79f628c9ab249a05c7812dd8cb5fa5e1935c219","ref":"refs/heads/master"},"retry":0}2353gitlab # [ 431.347325] sidekiq-cluster[3454]: {"severity":"INFO","time":"2026-08-13T13:21:05.137Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"16e29840276662c8e3c47dfe","created_at":"2026-08-13T13:21:00.662Z","trace_propagation_headers":{"sentry-trace":"4215cff1199e4c8d809a68e22cd2d368-58306ce7eb214956","baggage":"sentry-trace_id=4215cff1199e4c8d809a68e22cd2d368,sentry-release=Unknown"},"correlation_id":"01KZXME8YW2W3Z33W7AYXPFKX1","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:728235c66c636cf5e11c4e6d71303c5db161c05df93405362e0a507d03c4d895","size_limiter":"validated","enqueued_at":"2026-08-13T13:21:00.670Z","job_size_bytes":467,"pid":3454,"sidekiq_tid":"m8le","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-16e29840276662c8e3c47dfe: done: 1.000109 sec","job_status":"done","queue_duration_s":3.46747,"scheduling_latency_s":3.467508,"gitaly_calls":7,"gitaly_duration_s":0.103136,"redis_calls":33,"redis_duration_s":0.007948,"redis_read_bytes":185,"redis_write_bytes":1839,"redis_cache_calls":3,"redis_cache_duration_s":0.000888,"redis_cache_read_bytes":44,"redis_cache_write_bytes":255,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001902,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":443,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.003753,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001405,"redis_shared_state_read_bytes":17,"redis_shared_state_write_bytes":513,"db_count":27,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":27,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.038,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":24,"db_ci_count":3,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.033,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.866759,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":1.000109,"completed_at":"2026-08-13T13:21:05.137Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.03773,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2354gitlab # [ 431.401951] gitaly[895]: time="2026-08-13T13:21:05.162Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZXMH4J2ATKZKW8V52WDF5C9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-13T13:21:35.060" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-13T13:21:05.161" grpc.time_ms=0.659 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2355gitlab # [ 431.415075] sidekiq-cluster[3454]: {"severity":"INFO","time":"2026-08-13T13:21:05.142Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{\"idempotency_key\"=\u003e\"17bc2a55-bbf0-4ad2-8ccf-6f15d1c5e785\"}"],"class":"WebHookWorker","jid":"a4cb1d045c53156ab5619590","created_at":"2026-08-13T13:21:00.700Z","trace_propagation_headers":{"sentry-trace":"4215cff1199e4c8d809a68e22cd2d368-58306ce7eb214956","baggage":"sentry-trace_id=4215cff1199e4c8d809a68e22cd2d368,sentry-release=Unknown"},"correlation_id":"01KZXME8YW2W3Z33W7AYXPFKX1","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e75eccab4798bced78c649da211f4c5ecfb7214a4f709b3212c509fa9ea51952","size_limiter":"validated","enqueued_at":"2026-08-13T13:21:00.704Z","job_size_bytes":1749,"pid":3454,"sidekiq_tid":"m8le","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-a4cb1d045c53156ab5619590: start","job_status":"start","queue_duration_s":4.438384,"scheduling_latency_s":4.438437}2356gitlab # [ 431.432861] gitaly[895]: time="2026-08-13T13:21:05.231Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=4 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZXMH4J2ATKZKW8V52WDF5C9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-13T13:21:15.005" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-13T13:21:05.216" grpc.time_ms=14.872 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2357gitlab # [ 431.446452] nixbot[3544]: INFO: ::ffff:127.0.0.1:57796 - "POST /webhooks/gitlab HTTP/1.1" 202 Accepted2358gitlab # [ 431.447721] sidekiq-cluster[3454]: {"severity":"INFO","time":"2026-08-13T13:21:05.258Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{:idempotency_key=\u003e\"17bc2a55-bbf0-4ad2-8ccf-6f15d1c5e785\"}"],"class":"WebHookWorker","jid":"a4cb1d045c53156ab5619590","created_at":"2026-08-13T13:21:00.700Z","trace_propagation_headers":{"sentry-trace":"4215cff1199e4c8d809a68e22cd2d368-58306ce7eb214956","baggage":"sentry-trace_id=4215cff1199e4c8d809a68e22cd2d368,sentry-release=Unknown"},"correlation_id":"01KZXME8YW2W3Z33W7AYXPFKX1","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e75eccab4798bced78c649da211f4c5ecfb7214a4f709b3212c509fa9ea51952","size_limiter":"validated","enqueued_at":"2026-08-13T13:21:00.704Z","job_size_bytes":1749,"pid":3454,"sidekiq_tid":"m8le","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-a4cb1d045c53156ab5619590: done: 0.115693 sec","job_status":"done","queue_duration_s":4.438384,"scheduling_latency_s":4.438437,"redis_calls":14,"redis_duration_s":0.003503,"redis_read_bytes":26,"redis_write_bytes":4684,"redis_queues_calls":2,"redis_queues_duration_s":0.000388,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3728,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001837,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":630,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001278,"redis_shared_state_read_bytes":17,"redis_shared_state_write_bytes":326,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.022,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.022,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"external_http_count":1,"external_http_duration_s":0.015763380000009874,"cpu_s":0.064251,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.web_hook_worker.response_status":"success","extra.web_hook_worker.http_status":"ok","extra.web_hook_worker.signing_token_present":false,"duration_s":0.115693,"completed_at":"2026-08-13T13:21:05.258Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.021876,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2359gitlab # [ 431.495877] sidekiq-cluster[3454]: {"severity":"INFO","time":"2026-08-13T13:21:05.261Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"360a195494c53af4f0f397a0","created_at":"2026-08-13T13:21:01.495Z","trace_propagation_headers":{"sentry-trace":"acaa85311dd14a6f9c056fed4bc31163-edd2cc2da8344894","baggage":"sentry-trace_id=acaa85311dd14a6f9c056fed4bc31163,sentry-release=Unknown"},"correlation_id":"01KZXME9YMBHJA9PCJWRHTV330","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-08-13T13:21:01.503Z","job_size_bytes":23,"pid":3454,"sidekiq_tid":"m8le","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-360a195494c53af4f0f397a0: start","job_status":"start","queue_duration_s":3.757951,"scheduling_latency_s":3.757984}2360gitlab # [ 431.514643] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/13:13:21:05 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/d91f803177b21f3f0989157b74e357c736589f91 HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 2492361gitlab # [ 431.517350] nixbot[3544]: {"ts": "2026-08-13T13:21:05.341Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/d91f803177b21f3f0989157b74e357c736589f91 \"HTTP/1.1 201 Created\""}2362gitlab # [ 431.545912] sidekiq-cluster[3454]: {"severity":"INFO","time":"2026-08-13T13:21:05.371Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"360a195494c53af4f0f397a0","created_at":"2026-08-13T13:21:01.495Z","trace_propagation_headers":{"sentry-trace":"acaa85311dd14a6f9c056fed4bc31163-edd2cc2da8344894","baggage":"sentry-trace_id=acaa85311dd14a6f9c056fed4bc31163,sentry-release=Unknown"},"correlation_id":"01KZXME9YMBHJA9PCJWRHTV330","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-08-13T13:21:01.503Z","job_size_bytes":23,"pid":3454,"sidekiq_tid":"m8le","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-360a195494c53af4f0f397a0: done: 0.11072 sec","job_status":"done","queue_duration_s":3.757951,"scheduling_latency_s":3.757984,"redis_calls":10,"redis_duration_s":0.003023,"redis_read_bytes":9,"redis_write_bytes":1029,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000954,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001556,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":534,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000513,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":200,"db_count":15,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.016,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":11,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.005,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.005,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.013,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.083611,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00036652,"duration_s":0.11072,"completed_at":"2026-08-13T13:21:05.371Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.019206,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2363gitlab # [ 431.591132] sidekiq-cluster[3454]: {"severity":"INFO","time":"2026-08-13T13:21:05.373Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"1de2cb2b8d7ba8929c8198e7","created_at":"2026-08-13T13:21:01.719Z","trace_propagation_headers":{"sentry-trace":"acaa85311dd14a6f9c056fed4bc31163-edd2cc2da8344894","baggage":"sentry-trace_id=acaa85311dd14a6f9c056fed4bc31163,sentry-release=Unknown"},"correlation_id":"01KZXME9YMBHJA9PCJWRHTV330","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-08-13T13:21:01.733Z","job_size_bytes":3,"pid":3454,"sidekiq_tid":"m8le","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-1de2cb2b8d7ba8929c8198e7: start","job_status":"start","queue_duration_s":3.639701,"scheduling_latency_s":3.639725}2364gitlab # [ 431.609257] sidekiq-cluster[3454]: {"severity":"INFO","time":"2026-08-13T13:21:05.410Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"1de2cb2b8d7ba8929c8198e7","created_at":"2026-08-13T13:21:01.719Z","trace_propagation_headers":{"sentry-trace":"acaa85311dd14a6f9c056fed4bc31163-edd2cc2da8344894","baggage":"sentry-trace_id=acaa85311dd14a6f9c056fed4bc31163,sentry-release=Unknown"},"correlation_id":"01KZXME9YMBHJA9PCJWRHTV330","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-08-13T13:21:01.733Z","job_size_bytes":3,"pid":3454,"sidekiq_tid":"m8le","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-1de2cb2b8d7ba8929c8198e7: done: 0.037446 sec","job_status":"done","queue_duration_s":3.639701,"scheduling_latency_s":3.639725,"redis_calls":10,"redis_duration_s":0.0015270000000000001,"redis_read_bytes":9,"redis_write_bytes":1165,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000364,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000845,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000318,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":234,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026231,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00025082,"duration_s":0.037446,"completed_at":"2026-08-13T13:21:05.410Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004869,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2365gitlab # [ 431.654703] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/13:13:21:05 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 862366gitlab # [ 431.656939] gitlab-workhorse[817]: time="2026-08-13T13:21:05Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672367gitlab # [ 431.658793] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/13:13:21:05 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 962368gitlab # [ 431.660777] gitaly[895]: time="2026-08-13T13:21:05.372Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=579 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01KZXMH4R7TT295CAMGB7VKDSS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-13T13:21:05.361" grpc.time_ms=10.798 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc2369gitlab # [ 431.674385] sidekiq-cluster[3454]: {"severity":"INFO","time":"2026-08-13T13:21:05.412Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"951f1b5527a3b7c4a1a7acbe","created_at":"2026-08-13T13:21:01.755Z","trace_propagation_headers":{"sentry-trace":"acaa85311dd14a6f9c056fed4bc31163-edd2cc2da8344894","baggage":"sentry-trace_id=acaa85311dd14a6f9c056fed4bc31163,sentry-release=Unknown"},"correlation_id":"01KZXME9YMBHJA9PCJWRHTV330","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-08-13T13:21:01.768Z","job_size_bytes":3,"pid":3454,"sidekiq_tid":"m8le","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-951f1b5527a3b7c4a1a7acbe: start","job_status":"start","queue_duration_s":3.644138,"scheduling_latency_s":3.644162}2370gitlab # [ 431.692370] sidekiq-cluster[3454]: {"severity":"INFO","time":"2026-08-13T13:21:05.453Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"951f1b5527a3b7c4a1a7acbe","created_at":"2026-08-13T13:21:01.755Z","trace_propagation_headers":{"sentry-trace":"acaa85311dd14a6f9c056fed4bc31163-edd2cc2da8344894","baggage":"sentry-trace_id=acaa85311dd14a6f9c056fed4bc31163,sentry-release=Unknown"},"correlation_id":"01KZXME9YMBHJA9PCJWRHTV330","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-08-13T13:21:01.768Z","job_size_bytes":3,"pid":3454,"sidekiq_tid":"m8le","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-951f1b5527a3b7c4a1a7acbe: done: 0.04048 sec","job_status":"done","queue_duration_s":3.644138,"scheduling_latency_s":3.644162,"redis_calls":10,"redis_duration_s":0.0015010000000000002,"redis_read_bytes":9,"redis_write_bytes":1205,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000297,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000885,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000319,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.028779,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0002913,"duration_s":0.04048,"completed_at":"2026-08-13T13:21:05.453Z","load_balancing_strategy":"primary","db_duration_s":0.005125,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2371gitlab # [ 431.747485] gitaly[895]: time="2026-08-13T13:21:05.427Z" level=info msg="finished unary call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZXMH4T361K01RBET6745VSB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-13T13:21:35.424" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-13T13:21:05.424" grpc.time_ms=2.573 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2372gitlab # [ 431.761346] gitaly[895]: time="2026-08-13T13:21:05.471Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01KZXMH4V09WAYWJA5MHK2W0Q2 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-13T13:21:05.458" pid=895 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2373gitlab # [ 431.771654] sidekiq-cluster[3454]: {"severity":"INFO","time":"2026-08-13T13:21:05.454Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"75b6ecac937cd63fbb0be7d8","created_at":"2026-08-13T13:21:01.794Z","trace_propagation_headers":{"sentry-trace":"acaa85311dd14a6f9c056fed4bc31163-edd2cc2da8344894","baggage":"sentry-trace_id=acaa85311dd14a6f9c056fed4bc31163,sentry-release=Unknown"},"correlation_id":"01KZXME9YMBHJA9PCJWRHTV330","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-08-13T13:21:01.803Z","job_size_bytes":3,"pid":3454,"sidekiq_tid":"m8le","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-75b6ecac937cd63fbb0be7d8: start","job_status":"start","queue_duration_s":3.650839,"scheduling_latency_s":3.650861}2374gitlab # [ 431.787482] sidekiq-cluster[3454]: {"severity":"INFO","time":"2026-08-13T13:21:05.497Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"75b6ecac937cd63fbb0be7d8","created_at":"2026-08-13T13:21:01.794Z","trace_propagation_headers":{"sentry-trace":"acaa85311dd14a6f9c056fed4bc31163-edd2cc2da8344894","baggage":"sentry-trace_id=acaa85311dd14a6f9c056fed4bc31163,sentry-release=Unknown"},"correlation_id":"01KZXME9YMBHJA9PCJWRHTV330","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-08-13T13:21:01.803Z","job_size_bytes":3,"pid":3454,"sidekiq_tid":"m8le","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-75b6ecac937cd63fbb0be7d8: done: 0.042749 sec","job_status":"done","queue_duration_s":3.650839,"scheduling_latency_s":3.650861,"redis_calls":13,"redis_duration_s":0.001836,"redis_read_bytes":66,"redis_write_bytes":1182,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000287,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000916,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000328,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000305,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.029768,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0002467,"duration_s":0.042749,"completed_at":"2026-08-13T13:21:05.497Z","load_balancing_strategy":"primary","db_duration_s":0.005339,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2375gitlab # [ 431.832958] nix-daemon[3765]: accepted connection from pid 4332, user nixbot2376gitlab # [ 431.833966] gitaly[895]: time="2026-08-13T13:21:05.471Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=582 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=4 command.system_time_ms=4 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01KZXMH4V09WAYWJA5MHK2W0Q2 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-13T13:21:05.458" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc2377gitlab # [ 431.847374] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/13:13:21:05 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 622378gitlab # [ 431.849534] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/13:13:21:05 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/d91f803177b21f3f0989157b74e357c736589f91 HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 2632379gitlab # [ 431.851974] nixbot[3544]: {"ts": "2026-08-13T13:21:05.612Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/d91f803177b21f3f0989157b74e357c736589f91 \"HTTP/1.1 201 Created\""}2380gitlab # [ 431.855213] sidekiq-cluster[3454]: {"severity":"INFO","time":"2026-08-13T13:21:05.498Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"fe1f8a81525597e2d520a535","created_at":"2026-08-13T13:21:01.804Z","trace_propagation_headers":{"sentry-trace":"acaa85311dd14a6f9c056fed4bc31163-edd2cc2da8344894","baggage":"sentry-trace_id=acaa85311dd14a6f9c056fed4bc31163,sentry-release=Unknown"},"correlation_id":"01KZXME9YMBHJA9PCJWRHTV330","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-08-13T13:21:01.813Z","job_size_bytes":3,"pid":3454,"sidekiq_tid":"m8le","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-fe1f8a81525597e2d520a535: start","job_status":"start","queue_duration_s":3.685585,"scheduling_latency_s":3.685602}2381gitlab # [ 431.871902] sidekiq-cluster[3454]: {"severity":"INFO","time":"2026-08-13T13:21:05.540Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"fe1f8a81525597e2d520a535","created_at":"2026-08-13T13:21:01.804Z","trace_propagation_headers":{"sentry-trace":"acaa85311dd14a6f9c056fed4bc31163-edd2cc2da8344894","baggage":"sentry-trace_id=acaa85311dd14a6f9c056fed4bc31163,sentry-release=Unknown"},"correlation_id":"01KZXME9YMBHJA9PCJWRHTV330","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-08-13T13:21:01.813Z","job_size_bytes":3,"pid":3454,"sidekiq_tid":"m8le","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-fe1f8a81525597e2d520a535: done: 0.041571 sec","job_status":"done","queue_duration_s":3.685585,"scheduling_latency_s":3.685602,"redis_calls":10,"redis_duration_s":0.001565,"redis_read_bytes":9,"redis_write_bytes":1159,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000332,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000893,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00034,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.029805,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0002532,"duration_s":0.041571,"completed_at":"2026-08-13T13:21:05.540Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004631,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2382gitlab # [ 431.917378] gitaly[895]: time="2026-08-13T13:21:05.472Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=582 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=4 command.system_time_ms=4 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01KZXMH4V09WAYWJA5MHK2W0Q2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-13T13:21:05.458" grpc.time_ms=13.787 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc2383gitlab # [ 431.931758] gitlab-workhorse[817]: time="2026-08-13T13:21:05Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672384gitlab # [ 431.933706] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/13:13:21:05 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 1092385gitlab # [ 431.935581] sidekiq-cluster[3454]: {"severity":"INFO","time":"2026-08-13T13:21:05.541Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"03b03553d159ac4f26f507f2","created_at":"2026-08-13T13:21:01.814Z","trace_propagation_headers":{"sentry-trace":"acaa85311dd14a6f9c056fed4bc31163-edd2cc2da8344894","baggage":"sentry-trace_id=acaa85311dd14a6f9c056fed4bc31163,sentry-release=Unknown"},"correlation_id":"01KZXME9YMBHJA9PCJWRHTV330","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-08-13T13:21:01.822Z","job_size_bytes":19,"pid":3454,"sidekiq_tid":"m8le","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-03b03553d159ac4f26f507f2: start","job_status":"start","queue_duration_s":3.719,"scheduling_latency_s":3.719018}2386gitlab # [ 431.951862] sidekiq-cluster[3454]: {"severity":"INFO","time":"2026-08-13T13:21:05.585Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"03b03553d159ac4f26f507f2","created_at":"2026-08-13T13:21:01.814Z","trace_propagation_headers":{"sentry-trace":"acaa85311dd14a6f9c056fed4bc31163-edd2cc2da8344894","baggage":"sentry-trace_id=acaa85311dd14a6f9c056fed4bc31163,sentry-release=Unknown"},"correlation_id":"01KZXME9YMBHJA9PCJWRHTV330","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-08-13T13:21:01.822Z","job_size_bytes":19,"pid":3454,"sidekiq_tid":"m8le","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-03b03553d159ac4f26f507f2: done: 0.044145 sec","job_status":"done","queue_duration_s":3.719,"scheduling_latency_s":3.719018,"redis_calls":11,"redis_duration_s":0.008486,"redis_read_bytes":10,"redis_write_bytes":1121,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00029,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":287,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.007397,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":640,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000799,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":194,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026353,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0008581,"duration_s":0.044145,"completed_at":"2026-08-13T13:21:05.585Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004375,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2387gitlab # [ 431.996187] gitaly[895]: time="2026-08-13T13:21:05.482Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=8 command.system_time_ms=0 command.user_time_ms=6 component=gitaly.StreamServerInterceptor correlation_id=01KZXMH4T361K01RBET6745VSB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-13T13:21:15.259" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-13T13:21:05.469" grpc.time_ms=12.406 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2388gitlab # [ 432.009471] sidekiq-cluster[3454]: {"severity":"INFO","time":"2026-08-13T13:21:05.587Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"f1a6906d49b89dc506e870ab","created_at":"2026-08-13T13:21:01.827Z","trace_propagation_headers":{"sentry-trace":"acaa85311dd14a6f9c056fed4bc31163-edd2cc2da8344894","baggage":"sentry-trace_id=acaa85311dd14a6f9c056fed4bc31163,sentry-release=Unknown"},"correlation_id":"01KZXME9YMBHJA9PCJWRHTV330","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-08-13T13:21:01.833Z","job_size_bytes":66,"pid":3454,"sidekiq_tid":"m8le","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-f1a6906d49b89dc506e870ab: start","job_status":"start","queue_duration_s":3.754046,"scheduling_latency_s":3.754064}2389gitlab # [ 432.026882] sidekiq-cluster[3454]: {"severity":"INFO","time":"2026-08-13T13:21:05.630Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"f1a6906d49b89dc506e870ab","created_at":"2026-08-13T13:21:01.827Z","trace_propagation_headers":{"sentry-trace":"acaa85311dd14a6f9c056fed4bc31163-edd2cc2da8344894","baggage":"sentry-trace_id=acaa85311dd14a6f9c056fed4bc31163,sentry-release=Unknown"},"correlation_id":"01KZXME9YMBHJA9PCJWRHTV330","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-08-13T13:21:01.833Z","job_size_bytes":66,"pid":3454,"sidekiq_tid":"m8le","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-f1a6906d49b89dc506e870ab: done: 0.042829 sec","job_status":"done","queue_duration_s":3.754046,"scheduling_latency_s":3.754064,"redis_calls":10,"redis_duration_s":0.0014880000000000002,"redis_read_bytes":9,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000277,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":335,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000912,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000299,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":240,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.008,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026768,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0002764,"duration_s":0.042829,"completed_at":"2026-08-13T13:21:05.630Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005878,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2390gitlab # [ 432.073995] gitaly[895]: time="2026-08-13T13:21:05.579Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=578 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01KZXMH4ZDGHPZXK2WXYVFHZWH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=194 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-13T13:21:05.570" grpc.time_ms=9.413 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc2391gitlab # [ 432.090221] gitaly[895]: time="2026-08-13T13:21:05.689Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01KZXMH51D6JZ922Y6SHZV1T5Z grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-13T13:21:05.679" pid=895 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2392gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219'2393gitlab # [ 432.102787] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/13:13:21:05 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 932394gitlab # [ 432.105341] sidekiq-cluster[3454]: {"severity":"INFO","time":"2026-08-13T13:21:05.631Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"84c463c4de9c3cf95e15b0fc","created_at":"2026-08-13T13:21:01.834Z","trace_propagation_headers":{"sentry-trace":"acaa85311dd14a6f9c056fed4bc31163-edd2cc2da8344894","baggage":"sentry-trace_id=acaa85311dd14a6f9c056fed4bc31163,sentry-release=Unknown"},"correlation_id":"01KZXME9YMBHJA9PCJWRHTV330","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-08-13T13:21:01.840Z","job_size_bytes":3,"pid":3454,"sidekiq_tid":"m8le","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-84c463c4de9c3cf95e15b0fc: start","job_status":"start","queue_duration_s":3.791061,"scheduling_latency_s":3.791079}2395gitlab # [ 432.122779] sidekiq-cluster[3454]: {"severity":"INFO","time":"2026-08-13T13:21:05.674Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"84c463c4de9c3cf95e15b0fc","created_at":"2026-08-13T13:21:01.834Z","trace_propagation_headers":{"sentry-trace":"acaa85311dd14a6f9c056fed4bc31163-edd2cc2da8344894","baggage":"sentry-trace_id=acaa85311dd14a6f9c056fed4bc31163,sentry-release=Unknown"},"correlation_id":"01KZXME9YMBHJA9PCJWRHTV330","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-08-13T13:21:01.840Z","job_size_bytes":3,"pid":3454,"sidekiq_tid":"m8le","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-84c463c4de9c3cf95e15b0fc: done: 0.042704 sec","job_status":"done","queue_duration_s":3.791061,"scheduling_latency_s":3.791079,"redis_calls":10,"redis_duration_s":0.001696,"redis_read_bytes":9,"redis_write_bytes":973,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000299,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":281,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001061,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":506,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000336,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":186,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.031944,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0002452,"duration_s":0.042704,"completed_at":"2026-08-13T13:21:05.674Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00466,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2396gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219', in 0.07 seconds)2397gitlab # [ 432.168888] gitaly[895]: time="2026-08-13T13:21:05.690Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=1 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZXMH51D6JZ922Y6SHZV1T5Z grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-13T13:21:05.679" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc2398gitlab # [ 432.182551] nixbot[3544]: INFO: ::ffff:127.0.0.1:57806 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219 HTTP/1.1" 200 OK2399gitlab # [ 432.184561] sidekiq-cluster[3454]: {"severity":"INFO","time":"2026-08-13T13:21:05.677Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"968ce40f3bafbe70320ca04e","created_at":"2026-08-13T13:21:01.849Z","trace_propagation_headers":{"sentry-trace":"acaa85311dd14a6f9c056fed4bc31163-edd2cc2da8344894","baggage":"sentry-trace_id=acaa85311dd14a6f9c056fed4bc31163,sentry-release=Unknown"},"correlation_id":"01KZXME9YMBHJA9PCJWRHTV330","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-08-13T13:21:01.855Z","job_size_bytes":3,"pid":3454,"sidekiq_tid":"m8le","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-968ce40f3bafbe70320ca04e: start","job_status":"start","queue_duration_s":3.822869,"scheduling_latency_s":3.822892}2400gitlab # [ 432.200919] sidekiq-cluster[3454]: {"severity":"INFO","time":"2026-08-13T13:21:05.724Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"968ce40f3bafbe70320ca04e","created_at":"2026-08-13T13:21:01.849Z","trace_propagation_headers":{"sentry-trace":"acaa85311dd14a6f9c056fed4bc31163-edd2cc2da8344894","baggage":"sentry-trace_id=acaa85311dd14a6f9c056fed4bc31163,sentry-release=Unknown"},"correlation_id":"01KZXME9YMBHJA9PCJWRHTV330","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-08-13T13:21:01.855Z","job_size_bytes":3,"pid":3454,"sidekiq_tid":"m8le","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-968ce40f3bafbe70320ca04e: done: 0.047037 sec","job_status":"done","queue_duration_s":3.822869,"scheduling_latency_s":3.822892,"redis_calls":10,"redis_duration_s":0.0040809999999999996,"redis_read_bytes":9,"redis_write_bytes":1023,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000347,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003266,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000468,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":198,"db_count":7,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026515,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0002405,"duration_s":0.047037,"completed_at":"2026-08-13T13:21:05.724Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.010936,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2401gitlab # [ 432.245005] gitlab-workhorse[817]: time="2026-08-13T13:21:05Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2162402gitlab # [ 432.246855] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/13:13:21:05 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 216 "" "git/2.55.0" 992403gitlab # [ 432.248781] gitaly[895]: time="2026-08-13T13:21:05.690Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=1 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZXMH51D6JZ922Y6SHZV1T5Z grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-13T13:21:05.679" grpc.time_ms=10.808 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc2404gitlab # [ 432.263261] sidekiq-cluster[3454]: {"severity":"INFO","time":"2026-08-13T13:21:05.726Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"34bc2496ffe1bca1f70496e3","created_at":"2026-08-13T13:21:01.855Z","trace_propagation_headers":{"sentry-trace":"acaa85311dd14a6f9c056fed4bc31163-edd2cc2da8344894","baggage":"sentry-trace_id=acaa85311dd14a6f9c056fed4bc31163,sentry-release=Unknown"},"correlation_id":"01KZXME9YMBHJA9PCJWRHTV330","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-13T13:21:01.860Z","job_size_bytes":6,"pid":3454,"sidekiq_tid":"m8le","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-34bc2496ffe1bca1f70496e3: start","job_status":"start","queue_duration_s":3.865959,"scheduling_latency_s":3.865976}2405gitlab # [ 432.278996] sidekiq-cluster[3454]: {"severity":"INFO","time":"2026-08-13T13:21:05.753Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"34bc2496ffe1bca1f70496e3","created_at":"2026-08-13T13:21:01.855Z","trace_propagation_headers":{"sentry-trace":"acaa85311dd14a6f9c056fed4bc31163-edd2cc2da8344894","baggage":"sentry-trace_id=acaa85311dd14a6f9c056fed4bc31163,sentry-release=Unknown"},"correlation_id":"01KZXME9YMBHJA9PCJWRHTV330","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-13T13:21:01.860Z","job_size_bytes":6,"pid":3454,"sidekiq_tid":"m8le","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-34bc2496ffe1bca1f70496e3: done: 0.026981 sec","job_status":"done","queue_duration_s":3.865959,"scheduling_latency_s":3.865976,"redis_calls":10,"redis_duration_s":0.003295,"redis_read_bytes":9,"redis_write_bytes":1127,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000781,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":321,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002066,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000448,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":224,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015606,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00036606,"duration_s":0.026981,"completed_at":"2026-08-13T13:21:05.753Z","load_balancing_strategy":"primary","db_duration_s":0.002108,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2406gitlab # [ 432.322857] gitaly[895]: time="2026-08-13T13:21:05.830Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=580 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=2 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZXMH569AZGYMAA9NR6XE1KC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-13T13:21:05.814" grpc.time_ms=15.986 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc2407gitlab # [ 432.335914] gitaly[895]: time="2026-08-13T13:21:05.933Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01KZXMH59A8R1A6RW7D2KAJXS8 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-13T13:21:05.916" pid=895 remote_ip="2001:db8:1::1" request_sha=22300437632a556c435888000544c7c9bb3428e9 response_bytes=216 span.kind=server system=grpc2408gitlab # [ 432.347688] sidekiq-cluster[3454]: {"severity":"INFO","time":"2026-08-13T13:21:05.755Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"81a2e2910b1cc2582b07096b","created_at":"2026-08-13T13:21:01.861Z","trace_propagation_headers":{"sentry-trace":"acaa85311dd14a6f9c056fed4bc31163-edd2cc2da8344894","baggage":"sentry-trace_id=acaa85311dd14a6f9c056fed4bc31163,sentry-release=Unknown"},"correlation_id":"01KZXME9YMBHJA9PCJWRHTV330","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-08-13T13:21:01.866Z","job_size_bytes":3,"pid":3454,"sidekiq_tid":"m8le","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-81a2e2910b1cc2582b07096b: start","job_status":"start","queue_duration_s":3.889047,"scheduling_latency_s":3.889064}2409gitlab # [ 432.363624] sidekiq-cluster[3454]: {"severity":"INFO","time":"2026-08-13T13:21:05.797Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"81a2e2910b1cc2582b07096b","created_at":"2026-08-13T13:21:01.861Z","trace_propagation_headers":{"sentry-trace":"acaa85311dd14a6f9c056fed4bc31163-edd2cc2da8344894","baggage":"sentry-trace_id=acaa85311dd14a6f9c056fed4bc31163,sentry-release=Unknown"},"correlation_id":"01KZXME9YMBHJA9PCJWRHTV330","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-08-13T13:21:01.866Z","job_size_bytes":3,"pid":3454,"sidekiq_tid":"m8le","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-81a2e2910b1cc2582b07096b: done: 0.041863 sec","job_status":"done","queue_duration_s":3.889047,"scheduling_latency_s":3.889064,"redis_calls":10,"redis_duration_s":0.004121,"redis_read_bytes":9,"redis_write_bytes":989,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000776,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":285,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002915,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":514,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00043,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":190,"db_count":7,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024747,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0002476,"duration_s":0.041863,"completed_at":"2026-08-13T13:21:05.797Z","load_balancing_strategy":"primary","db_duration_s":0.008122,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2410gitlab # [ 432.406723] gitaly[895]: time="2026-08-13T13:21:05.933Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1103 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=7 component=gitaly.UnaryServerInterceptor correlation_id=01KZXMH59A8R1A6RW7D2KAJXS8 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-13T13:21:05.916" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc2411gitlab # [ 432.421545] sidekiq-cluster[3454]: {"severity":"INFO","time":"2026-08-13T13:21:05.798Z","retry":25,"queue":"default","version":0,"store":null,"args":["1"],"class":"Ci::TrackFirstPipelineSucceededWorker","jid":"823d08e8e07c3c8c8d355da6","created_at":"2026-08-13T13:21:01.873Z","trace_propagation_headers":{"sentry-trace":"acaa85311dd14a6f9c056fed4bc31163-edd2cc2da8344894","baggage":"sentry-trace_id=acaa85311dd14a6f9c056fed4bc31163,sentry-release=Unknown"},"correlation_id":"01KZXME9YMBHJA9PCJWRHTV330","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c5d2c9faee55896683425d4b50feeb49f6074c2dda34904072dea18e4eda0a9b","size_limiter":"validated","enqueued_at":"2026-08-13T13:21:01.879Z","job_size_bytes":3,"pid":3454,"sidekiq_tid":"m8le","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackFirstPipelineSucceededWorker JID-823d08e8e07c3c8c8d355da6: start","job_status":"start","queue_duration_s":3.919379,"scheduling_latency_s":3.919395}2412gitlab # [ 432.438445] sidekiq-cluster[3454]: {"severity":"INFO","time":"2026-08-13T13:21:05.889Z","retry":25,"queue":"default","version":0,"store":null,"args":["1"],"class":"Ci::TrackFirstPipelineSucceededWorker","jid":"823d08e8e07c3c8c8d355da6","created_at":"2026-08-13T13:21:01.873Z","trace_propagation_headers":{"sentry-trace":"acaa85311dd14a6f9c056fed4bc31163-edd2cc2da8344894","baggage":"sentry-trace_id=acaa85311dd14a6f9c056fed4bc31163,sentry-release=Unknown"},"correlation_id":"01KZXME9YMBHJA9PCJWRHTV330","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c5d2c9faee55896683425d4b50feeb49f6074c2dda34904072dea18e4eda0a9b","size_limiter":"validated","enqueued_at":"2026-08-13T13:21:01.879Z","job_size_bytes":3,"pid":3454,"sidekiq_tid":"m8le","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackFirstPipelineSucceededWorker JID-823d08e8e07c3c8c8d355da6: done: 0.090591 sec","job_status":"done","queue_duration_s":3.919379,"scheduling_latency_s":3.919395,"redis_calls":14,"redis_duration_s":0.00566,"redis_read_bytes":14,"redis_write_bytes":1335,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000599,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":317,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003136,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001925,"redis_shared_state_read_bytes":8,"redis_shared_state_write_bytes":436,"db_count":12,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.018,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.01,"db_ci_duration_s":0.007,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.050919,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0009493,"duration_s":0.090591,"completed_at":"2026-08-13T13:21:05.889Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.021803,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2413gitlab # [ 432.483515] gitaly[895]: time="2026-08-13T13:21:05.933Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1103 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=7 component=gitaly.UnaryServerInterceptor correlation_id=01KZXMH59A8R1A6RW7D2KAJXS8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-13T13:21:05.916" grpc.time_ms=16.903 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc2414gitlab # [ 432.498810] sidekiq-cluster[3454]: {"severity":"INFO","time":"2026-08-13T13:21:05.892Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"ee79df00cc3381bf91e31076","created_at":"2026-08-13T13:21:02.170Z","trace_propagation_headers":{"sentry-trace":"f540fb3a378c498896453f5c0d88faaa-d5aa34ee15eb4a01","baggage":"sentry-trace_id=f540fb3a378c498896453f5c0d88faaa,sentry-release=Unknown"},"correlation_id":"01KZXME2Y0M0QGCJC99SVX5ENK","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-08-13T13:21:02.182Z","job_size_bytes":3,"pid":3454,"sidekiq_tid":"m8le","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-ee79df00cc3381bf91e31076: start","job_status":"start","queue_duration_s":3.708985,"scheduling_latency_s":3.709022}2415gitlab # [ 432.515164] sidekiq-cluster[3454]: {"severity":"INFO","time":"2026-08-13T13:21:05.971Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"ee79df00cc3381bf91e31076","created_at":"2026-08-13T13:21:02.170Z","trace_propagation_headers":{"sentry-trace":"f540fb3a378c498896453f5c0d88faaa-d5aa34ee15eb4a01","baggage":"sentry-trace_id=f540fb3a378c498896453f5c0d88faaa,sentry-release=Unknown"},"correlation_id":"01KZXME2Y0M0QGCJC99SVX5ENK","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-08-13T13:21:02.182Z","job_size_bytes":3,"pid":3454,"sidekiq_tid":"m8le","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-ee79df00cc3381bf91e31076: done: 0.07955 sec","job_status":"done","queue_duration_s":3.708985,"scheduling_latency_s":3.709022,"redis_calls":19,"redis_duration_s":0.005006,"redis_read_bytes":21,"redis_write_bytes":4289,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000928,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":678,"redis_queues_calls":3,"redis_queues_duration_s":0.000637,"redis_queues_read_bytes":3,"redis_queues_write_bytes":2260,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.001829,"redis_queues_metadata_read_bytes":9,"redis_queues_metadata_write_bytes":1024,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.001612,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":327,"db_count":7,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.057558,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0093405,"duration_s":0.07955,"completed_at":"2026-08-13T13:21:05.971Z","load_balancing_strategy":"primary","db_duration_s":0.009237,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2416gitlab # [ 432.562349] gitaly[895]: time="2026-08-13T13:21:06.086Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZXMH5EE96TTN77SKYB5KRVP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-13T13:21:36.084" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-13T13:21:06.085" grpc.time_ms=0.788 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2417gitlab # [ 432.575355] nixbot[3544]: {"ts": "2026-08-13T13:21:06.361Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/a79f628c9ab249a05c7812dd8cb5fa5e1935c219 \"HTTP/1.1 201 Created\""}2418gitlab # [ 432.578293] nixbot[3544]: {"ts": "2026-08-13T13:21:06.369Z", "level": "info", "logger": "nixbot.flake_prefetch", "msg": "prefetching flake inputs", "flake_dir": "/var/lib/nixbot/worktrees/1-a79f628c9ab2-4"}2419gitlab # [ 432.580626] sidekiq-cluster[3454]: {"severity":"INFO","time":"2026-08-13T13:21:05.973Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","ba62c76fe244b8ae0f9af6b9"],"class":"WebHooks::LogExecutionWorker","jid":"d2d2e23e74de6dd33046369e","created_at":"2026-08-13T13:21:03.987Z","trace_propagation_headers":{"sentry-trace":"f540fb3a378c498896453f5c0d88faaa-b48468f0d08e41bc","baggage":"sentry-trace_id=f540fb3a378c498896453f5c0d88faaa,sentry-release=Unknown"},"correlation_id":"01KZXME2Y0M0QGCJC99SVX5ENK","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:555323d4c1cf86b41538cbee058c1de4decd34989524f9e884bdba6345ced75e","size_limiter":"validated","enqueued_at":"2026-08-13T13:21:04.003Z","job_size_bytes":2593,"pid":3454,"sidekiq_tid":"m8le","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-d2d2e23e74de6dd33046369e: start","job_status":"start","queue_duration_s":1.970036,"scheduling_latency_s":1.970066}2420gitlab # [ 432.597832] sidekiq-cluster[3454]: {"severity":"INFO","time":"2026-08-13T13:21:06.027Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","ba62c76fe244b8ae0f9af6b9"],"class":"WebHooks::LogExecutionWorker","jid":"d2d2e23e74de6dd33046369e","created_at":"2026-08-13T13:21:03.987Z","trace_propagation_headers":{"sentry-trace":"f540fb3a378c498896453f5c0d88faaa-b48468f0d08e41bc","baggage":"sentry-trace_id=f540fb3a378c498896453f5c0d88faaa,sentry-release=Unknown"},"correlation_id":"01KZXME2Y0M0QGCJC99SVX5ENK","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:555323d4c1cf86b41538cbee058c1de4decd34989524f9e884bdba6345ced75e","size_limiter":"validated","enqueued_at":"2026-08-13T13:21:04.003Z","job_size_bytes":2593,"pid":3454,"sidekiq_tid":"m8le","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-d2d2e23e74de6dd33046369e: done: 0.054049 sec","job_status":"done","queue_duration_s":1.970036,"scheduling_latency_s":1.970066,"redis_calls":10,"redis_duration_s":0.001954,"redis_read_bytes":9,"redis_write_bytes":1045,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000361,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001128,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000465,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":4,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.007,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.007,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.038786,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00043088,"duration_s":0.054049,"completed_at":"2026-08-13T13:21:06.027Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006365,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2421gitlab # [ 432.643736] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/13:13:21:06 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/a79f628c9ab249a05c7812dd8cb5fa5e1935c219 HTTP/1.1" 201 631 "" "python-httpx/0.28.1" 3602422gitlab # [ 432.646529] gitaly[895]: time="2026-08-13T13:21:06.111Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=591 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=1 command.system_time_ms=6 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01KZXMH5EE96TTN77SKYB5KRVP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-08-13T13:21:36.098" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-08-13T13:21:06.098" grpc.time_ms=12.56 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2423gitlab # [ 432.660686] sidekiq-cluster[3454]: {"severity":"INFO","time":"2026-08-13T13:21:06.030Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"217cf1fc0e27555d56cc3e81","created_at":"2026-08-13T13:21:05.038Z","trace_propagation_headers":{"sentry-trace":"1c64b9e34fd14044a1f5ddebc377dc38-335aecc040834d61","baggage":"sentry-trace_id=1c64b9e34fd14044a1f5ddebc377dc38,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZXMH3XA6XV0MPJSRSBGJKFR","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-13T13:21:05.048Z","job_size_bytes":3,"pid":3454,"sidekiq_tid":"m8le","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-217cf1fc0e27555d56cc3e81: start","job_status":"start","queue_duration_s":0.981748,"scheduling_latency_s":0.981775}2424gitlab # [ 432.676765] sidekiq-cluster[3454]: {"severity":"INFO","time":"2026-08-13T13:21:06.374Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"217cf1fc0e27555d56cc3e81","created_at":"2026-08-13T13:21:05.038Z","trace_propagation_headers":{"sentry-trace":"1c64b9e34fd14044a1f5ddebc377dc38-335aecc040834d61","baggage":"sentry-trace_id=1c64b9e34fd14044a1f5ddebc377dc38,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZXMH3XA6XV0MPJSRSBGJKFR","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-13T13:21:05.048Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":3454,"job_status":"rescheduled","message":"PipelineProcessWorker JID-217cf1fc0e27555d56cc3e81: rescheduled"}2425gitlab # [ 432.691789] nix-daemon[3765]: accepted connection from pid 4422, user nixbot2426gitlab # [ 432.692802] gitaly[895]: time="2026-08-13T13:21:06.130Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01KZXMH5EE96TTN77SKYB5KRVP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-13T13:21:16.009" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-13T13:21:06.120" grpc.time_ms=9.984 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2427gitlab # [ 432.706213] sidekiq-cluster[3454]: {"severity":"INFO","time":"2026-08-13T13:21:06.384Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"217cf1fc0e27555d56cc3e81","created_at":"2026-08-13T13:21:05.038Z","trace_propagation_headers":{"sentry-trace":"1c64b9e34fd14044a1f5ddebc377dc38-335aecc040834d61","baggage":"sentry-trace_id=1c64b9e34fd14044a1f5ddebc377dc38,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZXMH3XA6XV0MPJSRSBGJKFR","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-13T13:21:05.048Z","job_size_bytes":3,"pid":3454,"sidekiq_tid":"m8le","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-217cf1fc0e27555d56cc3e81: done: 0.354408 sec","job_status":"done","queue_duration_s":0.981748,"scheduling_latency_s":0.981775,"gitaly_calls":3,"gitaly_duration_s":0.126656,"redis_calls":66,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.014946000000000001,"redis_read_bytes":150,"redis_write_bytes":18015,"redis_action_cable_calls":2,"redis_action_cable_duration_s":0.000394,"redis_action_cable_read_bytes":2,"redis_action_cable_write_bytes":407,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.000884,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_queues_calls":22,"redis_queues_duration_s":0.004537,"redis_queues_read_bytes":28,"redis_queues_write_bytes":12314,"redis_queues_metadata_calls":19,"redis_queues_metadata_duration_s":0.005309,"redis_queues_metadata_read_bytes":30,"redis_queues_metadata_write_bytes":3093,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000198,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.00142,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.00181,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":30,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":30,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.041,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":16,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":2,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.009,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.009,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.016,"db_ci_duration_s":0.025,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.18194,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.29987032,"duration_s":0.354408,"completed_at":"2026-08-13T13:21:06.384Z","load_balancing_strategy":"primary","db_duration_s":0.042617,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2428gitlab # [ 432.758807] sidekiq-cluster[3454]: {"severity":"INFO","time":"2026-08-13T13:21:06.387Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","a4cb1d045c53156ab5619590"],"class":"WebHooks::LogExecutionWorker","jid":"4da072a3f671b00304321633","created_at":"2026-08-13T13:21:05.244Z","trace_propagation_headers":{"sentry-trace":"4215cff1199e4c8d809a68e22cd2d368-2f74ec2df5e24aab","baggage":"sentry-trace_id=4215cff1199e4c8d809a68e22cd2d368,sentry-release=Unknown"},"correlation_id":"01KZXME8YW2W3Z33W7AYXPFKX1","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d6d1c8f69312879801316eca2e96e1b70e35820870057db668679d1571360e17","size_limiter":"validated","enqueued_at":"2026-08-13T13:21:05.248Z","job_size_bytes":2592,"pid":3454,"sidekiq_tid":"m8le","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-4da072a3f671b00304321633: start","job_status":"start","queue_duration_s":1.138316,"scheduling_latency_s":1.138351}2429gitlab # [ 432.775745] gitaly[895]: time="2026-08-13T13:21:06.156Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KZXMH5EE96TTN77SKYB5KRVP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-08-13T13:21:16.045" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-13T13:21:06.155" grpc.time_ms=0.279 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2430gitlab # [ 432.786867] gitaly[895]: time="2026-08-13T13:21:06.159Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZXMH3XA6XV0MPJSRSBGJKFR grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3897 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-13T13:21:06.158" grpc.time_ms=0.45 pid=895 span.kind=server system=grpc2431gitlab # [ 432.796634] nixbot[3544]: {"ts": "2026-08-13T13:21:06.583Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-a79f628c9ab2-4", "argv0": "bwrap"}2432gitlab # [ 432.798955] sidekiq-cluster[3454]: {"severity":"INFO","time":"2026-08-13T13:21:06.426Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","a4cb1d045c53156ab5619590"],"class":"WebHooks::LogExecutionWorker","jid":"4da072a3f671b00304321633","created_at":"2026-08-13T13:21:05.244Z","trace_propagation_headers":{"sentry-trace":"4215cff1199e4c8d809a68e22cd2d368-2f74ec2df5e24aab","baggage":"sentry-trace_id=4215cff1199e4c8d809a68e22cd2d368,sentry-release=Unknown"},"correlation_id":"01KZXME8YW2W3Z33W7AYXPFKX1","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d6d1c8f69312879801316eca2e96e1b70e35820870057db668679d1571360e17","size_limiter":"validated","enqueued_at":"2026-08-13T13:21:05.248Z","job_size_bytes":2592,"pid":3454,"sidekiq_tid":"m8le","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-4da072a3f671b00304321633: done: 0.039859 sec","job_status":"done","queue_duration_s":1.138316,"scheduling_latency_s":1.138351,"redis_calls":7,"redis_duration_s":0.002353,"redis_read_bytes":5,"redis_write_bytes":671,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001706,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000647,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":3,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.004,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.004,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.028556,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.039859,"completed_at":"2026-08-13T13:21:06.426Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004211,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2433gitlab # [ 432.842155] sidekiq-cluster[3454]: {"severity":"INFO","time":"2026-08-13T13:21:06.429Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"83a76cdb1723679a673ee31d","created_at":"2026-08-13T13:21:05.954Z","trace_propagation_headers":{"sentry-trace":"f540fb3a378c498896453f5c0d88faaa-9530876f56354255","baggage":"sentry-trace_id=f540fb3a378c498896453f5c0d88faaa,sentry-release=Unknown"},"correlation_id":"01KZXME2Y0M0QGCJC99SVX5ENK","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-08-13T13:21:05.960Z","job_size_bytes":3,"pid":3454,"sidekiq_tid":"m8le","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-83a76cdb1723679a673ee31d: start","job_status":"start","queue_duration_s":0.469117,"scheduling_latency_s":0.469154}2434gitlab # [ 432.859486] nix-daemon[3765]: accepted connection from pid 4430, user nixbot2435gitlab # [ 432.860504] gitaly[895]: time="2026-08-13T13:21:06.173Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=569 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01KZXMH5EE96TTN77SKYB5KRVP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-08-13T13:21:16.052" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-13T13:21:06.162" grpc.time_ms=10.077 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2436gitlab # [ 432.874072] gitaly[895]: time="2026-08-13T13:21:06.191Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZXMH3XA6XV0MPJSRSBGJKFR grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3895 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-13T13:21:06.190" grpc.time_ms=0.58 pid=895 span.kind=server system=grpc2437gitlab # [ 432.884180] sidekiq-cluster[3454]: {"severity":"INFO","time":"2026-08-13T13:21:06.608Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"83a76cdb1723679a673ee31d","created_at":"2026-08-13T13:21:05.954Z","trace_propagation_headers":{"sentry-trace":"f540fb3a378c498896453f5c0d88faaa-9530876f56354255","baggage":"sentry-trace_id=f540fb3a378c498896453f5c0d88faaa,sentry-release=Unknown"},"correlation_id":"01KZXME2Y0M0QGCJC99SVX5ENK","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-08-13T13:21:05.960Z","job_size_bytes":3,"pid":3454,"sidekiq_tid":"m8le","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-83a76cdb1723679a673ee31d: done: 0.179613 sec","job_status":"done","queue_duration_s":0.469117,"scheduling_latency_s":0.469154,"redis_calls":11,"redis_duration_s":0.0035949999999999997,"redis_read_bytes":10,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000556,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002387,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":672,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000652,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":210,"db_count":12,"db_write_count":3,"db_cached_count":0,"db_txn_count":3,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.032,"db_main_txn_count":3,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.006,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.015,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.032,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.118218,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00055248,"duration_s":0.179613,"completed_at":"2026-08-13T13:21:06.608Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.062803,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2438gitlab # [ 432.930512] sidekiq-cluster[3454]: {"severity":"INFO","time":"2026-08-13T13:21:06.611Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"25031666fcc75c1f52ecb215","created_at":"2026-08-13T13:21:06.109Z","trace_propagation_headers":{"sentry-trace":"1c64b9e34fd14044a1f5ddebc377dc38-59ce8febf093430f","baggage":"sentry-trace_id=1c64b9e34fd14044a1f5ddebc377dc38,sentry-release=Unknown"},"correlation_id":"01KZXMH3XA6XV0MPJSRSBGJKFR","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-08-13T13:21:06.113Z","job_size_bytes":23,"pid":3454,"sidekiq_tid":"m8le","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-25031666fcc75c1f52ecb215: start","job_status":"start","queue_duration_s":0.498156,"scheduling_latency_s":0.4982}2439gitlab # [ 432.947556] gitaly[895]: time="2026-08-13T13:21:06.211Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZXMH5EE96TTN77SKYB5KRVP grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4153 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-13T13:21:06.211" grpc.time_ms=0.375 pid=895 span.kind=server system=grpc2440gitlab # [ 432.957535] gitaly[895]: time="2026-08-13T13:21:06.230Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZXMH3XA6XV0MPJSRSBGJKFR grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3897 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-13T13:21:06.229" grpc.time_ms=0.471 pid=895 span.kind=server system=grpc2441gitlab # [ 432.968177] sidekiq-cluster[3454]: {"severity":"INFO","time":"2026-08-13T13:21:06.695Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"25031666fcc75c1f52ecb215","created_at":"2026-08-13T13:21:06.109Z","trace_propagation_headers":{"sentry-trace":"1c64b9e34fd14044a1f5ddebc377dc38-59ce8febf093430f","baggage":"sentry-trace_id=1c64b9e34fd14044a1f5ddebc377dc38,sentry-release=Unknown"},"correlation_id":"01KZXMH3XA6XV0MPJSRSBGJKFR","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-08-13T13:21:06.113Z","job_size_bytes":23,"pid":3454,"sidekiq_tid":"m8le","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-25031666fcc75c1f52ecb215: done: 0.083875 sec","job_status":"done","queue_duration_s":0.498156,"scheduling_latency_s":0.4982,"redis_calls":7,"redis_duration_s":0.002801,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002045,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000756,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.015,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.01,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.060821,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.083875,"completed_at":"2026-08-13T13:21:06.695Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.014915,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2442gitlab # [ 433.011952] sidekiq-cluster[3454]: {"severity":"INFO","time":"2026-08-13T13:21:06.698Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"76d02cc6f19a0829df992dfe","created_at":"2026-08-13T13:21:06.245Z","trace_propagation_headers":{"sentry-trace":"1c64b9e34fd14044a1f5ddebc377dc38-59ce8febf093430f","baggage":"sentry-trace_id=1c64b9e34fd14044a1f5ddebc377dc38,sentry-release=Unknown"},"correlation_id":"01KZXMH3XA6XV0MPJSRSBGJKFR","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-08-13T13:21:06.249Z","job_size_bytes":3,"pid":3454,"sidekiq_tid":"m8le","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-76d02cc6f19a0829df992dfe: start","job_status":"start","queue_duration_s":0.449417,"scheduling_latency_s":0.449465}2443gitlab # [ 433.029665] gitaly[895]: time="2026-08-13T13:21:06.237Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZXMH5EE96TTN77SKYB5KRVP grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4155 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-13T13:21:06.236" grpc.time_ms=0.424 pid=895 span.kind=server system=grpc2444gitlab # [ 433.039475] gitaly[895]: time="2026-08-13T13:21:06.237Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KZXMH3XA6XV0MPJSRSBGJKFR diskcache=87bc07cf-7d8c-4e51-bb9b-0b2d58af3774 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-13T13:21:36.022" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-13T13:21:06.122" pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2445gitlab # [ 433.049394] nix-daemon[3765]: accepted connection from pid 4440, user nixbot2446gitlab # [ 433.050356] sidekiq-cluster[3454]: {"severity":"INFO","time":"2026-08-13T13:21:06.775Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"76d02cc6f19a0829df992dfe","created_at":"2026-08-13T13:21:06.245Z","trace_propagation_headers":{"sentry-trace":"1c64b9e34fd14044a1f5ddebc377dc38-59ce8febf093430f","baggage":"sentry-trace_id=1c64b9e34fd14044a1f5ddebc377dc38,sentry-release=Unknown"},"correlation_id":"01KZXMH3XA6XV0MPJSRSBGJKFR","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-08-13T13:21:06.249Z","job_size_bytes":3,"pid":3454,"sidekiq_tid":"m8le","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-76d02cc6f19a0829df992dfe: done: 0.076731 sec","job_status":"done","queue_duration_s":0.449417,"scheduling_latency_s":0.449465,"redis_calls":7,"redis_duration_s":0.0035460000000000005,"redis_read_bytes":5,"redis_write_bytes":746,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002364,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001182,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":234,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.01,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.05492,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.076731,"completed_at":"2026-08-13T13:21:06.775Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.010069,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2447gitlab # [ 433.094376] sidekiq-cluster[3454]: {"severity":"INFO","time":"2026-08-13T13:21:06.778Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"e26c8330b937dea5e161564b","created_at":"2026-08-13T13:21:06.255Z","trace_propagation_headers":{"sentry-trace":"16c587dbaef04a9bbb73fe5a0e8c0af4-826781f7c4ad49de","baggage":"sentry-trace_id=16c587dbaef04a9bbb73fe5a0e8c0af4,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZXMH5EE96TTN77SKYB5KRVP","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-08-13T13:21:06.261Z","job_size_bytes":65,"pid":3454,"sidekiq_tid":"m8le","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-e26c8330b937dea5e161564b: start","job_status":"start","queue_duration_s":0.517476,"scheduling_latency_s":0.517522}2448gitlab # [ 433.111595] gitaly[895]: time="2026-08-13T13:21:06.237Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=105 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=6973 command.oublock=0 command.real_time_ms=110 command.spawn_token_fork_ms=1 command.system_time_ms=58 command.user_time_ms=47 component=gitaly.UnaryServerInterceptor correlation_id=01KZXMH3XA6XV0MPJSRSBGJKFR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-13T13:21:36.022" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-13T13:21:06.122" grpc.time_ms=114.75 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2449gitlab # [ 433.124959] sidekiq-cluster[3454]: {"severity":"INFO","time":"2026-08-13T13:21:06.840Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"e26c8330b937dea5e161564b","created_at":"2026-08-13T13:21:06.255Z","trace_propagation_headers":{"sentry-trace":"16c587dbaef04a9bbb73fe5a0e8c0af4-826781f7c4ad49de","baggage":"sentry-trace_id=16c587dbaef04a9bbb73fe5a0e8c0af4,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZXMH5EE96TTN77SKYB5KRVP","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-08-13T13:21:06.261Z","job_size_bytes":65,"pid":3454,"sidekiq_tid":"m8le","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-e26c8330b937dea5e161564b: done: 0.061389 sec","job_status":"done","queue_duration_s":0.517476,"scheduling_latency_s":0.517522,"redis_calls":7,"redis_duration_s":0.002502,"redis_read_bytes":5,"redis_write_bytes":731,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001782,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":503,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00072,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":228,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.014,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.01,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.038712,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.061389,"completed_at":"2026-08-13T13:21:06.840Z","load_balancing_strategy":"primary","db_duration_s":0.014073,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2450gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219'2451gitlab # [ 433.168644] sidekiq-cluster[3454]: {"severity":"INFO","time":"2026-08-13T13:21:06.843Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"83347e66a2d3bc7ecfde05e1","created_at":"2026-08-13T13:21:06.259Z","trace_propagation_headers":{"sentry-trace":"1c64b9e34fd14044a1f5ddebc377dc38-59ce8febf093430f","baggage":"sentry-trace_id=1c64b9e34fd14044a1f5ddebc377dc38,sentry-release=Unknown"},"correlation_id":"01KZXMH3XA6XV0MPJSRSBGJKFR","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-08-13T13:21:06.265Z","job_size_bytes":3,"pid":3454,"sidekiq_tid":"m8le","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-83347e66a2d3bc7ecfde05e1: start","job_status":"start","queue_duration_s":0.577992,"scheduling_latency_s":0.578032}2452gitlab # [ 433.184768] gitaly[895]: time="2026-08-13T13:21:06.247Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KZXMH5EE96TTN77SKYB5KRVP diskcache=1f1e5900-757e-422a-92f8-3d5696257e36 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-13T13:21:16.065" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-13T13:21:06.176" pid=895 ref=refs/keep-around/a79f628c9ab249a05c7812dd8cb5fa5e1935c219 remote_ip="2001:db8:1::1" revision=a79f628c9ab249a05c7812dd8cb5fa5e1935c219 span.kind=server system=grpc username=root2453gitlab # [ 433.195087] nix-daemon[3765]: accepted connection from pid 4450, user nixbot2454gitlab # [ 433.195940] nix-daemon[3765]: accepted connection from pid 4440, user nixbot2455gitlab # [ 433.196900] sidekiq-cluster[3454]: {"severity":"INFO","time":"2026-08-13T13:21:06.913Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"83347e66a2d3bc7ecfde05e1","created_at":"2026-08-13T13:21:06.259Z","trace_propagation_headers":{"sentry-trace":"1c64b9e34fd14044a1f5ddebc377dc38-59ce8febf093430f","baggage":"sentry-trace_id=1c64b9e34fd14044a1f5ddebc377dc38,sentry-release=Unknown"},"correlation_id":"01KZXMH3XA6XV0MPJSRSBGJKFR","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-08-13T13:21:06.265Z","job_size_bytes":3,"pid":3454,"sidekiq_tid":"m8le","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-83347e66a2d3bc7ecfde05e1: done: 0.070734 sec","job_status":"done","queue_duration_s":0.577992,"scheduling_latency_s":0.578032,"redis_calls":7,"redis_duration_s":0.002311,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001598,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000713,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.011,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.051752,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.070734,"completed_at":"2026-08-13T13:21:06.913Z","load_balancing_strategy":"primary","db_duration_s":0.011195,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2456gitlab # [ 433.237749] sidekiq-cluster[3454]: {"severity":"INFO","time":"2026-08-13T13:21:06.917Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"75b419a8d97b2abc2ef113f5","created_at":"2026-08-13T13:21:06.262Z","trace_propagation_headers":{"sentry-trace":"16c587dbaef04a9bbb73fe5a0e8c0af4-826781f7c4ad49de","baggage":"sentry-trace_id=16c587dbaef04a9bbb73fe5a0e8c0af4,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZXMH5EE96TTN77SKYB5KRVP","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-08-13T13:21:06.267Z","job_size_bytes":65,"pid":3454,"sidekiq_tid":"m8le","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-75b419a8d97b2abc2ef113f5: start","job_status":"start","queue_duration_s":0.649436,"scheduling_latency_s":0.649479}2457gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219', in 0.09 seconds)2458(finished: subtest: push delivers the webhook, in 96.08 seconds)2459subtest: eval and build post commit statuses2460gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/a79f628c9ab249a05c7812dd8cb5fa5e1935c219/statuses2461gitlab # [ 433.254935] gitaly[895]: time="2026-08-13T13:21:06.247Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=58 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5221 command.oublock=8 command.real_time_ms=63 command.spawn_token_fork_ms=1 command.system_time_ms=40 command.user_time_ms=18 component=gitaly.UnaryServerInterceptor correlation_id=01KZXMH5EE96TTN77SKYB5KRVP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-13T13:21:16.065" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-13T13:21:06.176" grpc.time_ms=71.74 pid=895 ref=refs/keep-around/a79f628c9ab249a05c7812dd8cb5fa5e1935c219 remote_ip="2001:db8:1::1" revision=a79f628c9ab249a05c7812dd8cb5fa5e1935c219 span.kind=server system=grpc username=root2462gitlab # [ 433.270115] sidekiq-cluster[3454]: {"severity":"INFO","time":"2026-08-13T13:21:07.044Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"75b419a8d97b2abc2ef113f5","created_at":"2026-08-13T13:21:06.262Z","trace_propagation_headers":{"sentry-trace":"16c587dbaef04a9bbb73fe5a0e8c0af4-826781f7c4ad49de","baggage":"sentry-trace_id=16c587dbaef04a9bbb73fe5a0e8c0af4,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZXMH5EE96TTN77SKYB5KRVP","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-08-13T13:21:06.267Z","job_size_bytes":65,"pid":3454,"sidekiq_tid":"m8le","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-75b419a8d97b2abc2ef113f5: done: 0.127384 sec","job_status":"done","queue_duration_s":0.649436,"scheduling_latency_s":0.649479,"redis_calls":10,"redis_duration_s":0.006108000000000001,"redis_read_bytes":14,"redis_write_bytes":857,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.003993,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":494,"redis_shared_state_calls":5,"redis_shared_state_duration_s":0.002115,"redis_shared_state_read_bytes":10,"redis_shared_state_write_bytes":363,"db_count":11,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":11,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.03,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.018,"db_ci_duration_s":0.012,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.08164,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.127384,"completed_at":"2026-08-13T13:21:07.044Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.031175,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2463gitlab # [ 433.313869] sidekiq-cluster[3454]: {"severity":"INFO","time":"2026-08-13T13:21:07.048Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"9368bcaba57aaf20cdf4d63a","created_at":"2026-08-13T13:21:06.277Z","trace_propagation_headers":{"sentry-trace":"1c64b9e34fd14044a1f5ddebc377dc38-59ce8febf093430f","baggage":"sentry-trace_id=1c64b9e34fd14044a1f5ddebc377dc38,sentry-release=Unknown"},"correlation_id":"01KZXMH3XA6XV0MPJSRSBGJKFR","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-08-13T13:21:06.281Z","job_size_bytes":3,"pid":3454,"sidekiq_tid":"m8le","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-9368bcaba57aaf20cdf4d63a: start","job_status":"start","queue_duration_s":0.766547,"scheduling_latency_s":0.766624}2464gitlab # [ 433.329533] nixbot[3544]: INFO: ::ffff:127.0.0.1:57822 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a79f628c9ab249a05c7812dd8cb5fa5e1935c219 HTTP/1.1" 200 OK2465gitlab # [ 433.331407] gitaly[895]: time="2026-08-13T13:21:06.251Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZXMH5EE96TTN77SKYB5KRVP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-13T13:21:36.251" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-13T13:21:06.251" grpc.time_ms=0.291 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2466gitlab # [ 433.344262] sidekiq-cluster[3454]: {"severity":"INFO","time":"2026-08-13T13:21:07.100Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"9368bcaba57aaf20cdf4d63a","created_at":"2026-08-13T13:21:06.277Z","trace_propagation_headers":{"sentry-trace":"1c64b9e34fd14044a1f5ddebc377dc38-59ce8febf093430f","baggage":"sentry-trace_id=1c64b9e34fd14044a1f5ddebc377dc38,sentry-release=Unknown"},"correlation_id":"01KZXMH3XA6XV0MPJSRSBGJKFR","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-08-13T13:21:06.281Z","job_size_bytes":3,"pid":3454,"sidekiq_tid":"m8le","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-9368bcaba57aaf20cdf4d63a: done: 0.052391 sec","job_status":"done","queue_duration_s":0.766547,"scheduling_latency_s":0.766624,"redis_calls":10,"redis_duration_s":0.00248,"redis_read_bytes":62,"redis_write_bytes":808,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001553,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000445,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000482,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.03701,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.052391,"completed_at":"2026-08-13T13:21:07.100Z","load_balancing_strategy":"primary","db_duration_s":0.008151,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2467gitlab # [ 433.387576] sidekiq-cluster[3454]: {"severity":"INFO","time":"2026-08-13T13:21:07.102Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"e4df7fb68147f317f6446546","created_at":"2026-08-13T13:21:06.282Z","trace_propagation_headers":{"sentry-trace":"1c64b9e34fd14044a1f5ddebc377dc38-59ce8febf093430f","baggage":"sentry-trace_id=1c64b9e34fd14044a1f5ddebc377dc38,sentry-release=Unknown"},"correlation_id":"01KZXMH3XA6XV0MPJSRSBGJKFR","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-08-13T13:21:06.285Z","job_size_bytes":3,"pid":3454,"sidekiq_tid":"m8le","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-e4df7fb68147f317f6446546: start","job_status":"start","queue_duration_s":0.81733,"scheduling_latency_s":0.817358}2468gitlab # [ 433.405241] gitaly[895]: time="2026-08-13T13:21:06.319Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZXMH3XA6XV0MPJSRSBGJKFR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-13T13:21:36.218" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-13T13:21:06.318" grpc.time_ms=0.808 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2469gitlab # [ 433.417783] sidekiq-cluster[3454]: {"severity":"INFO","time":"2026-08-13T13:21:07.140Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"e4df7fb68147f317f6446546","created_at":"2026-08-13T13:21:06.282Z","trace_propagation_headers":{"sentry-trace":"1c64b9e34fd14044a1f5ddebc377dc38-59ce8febf093430f","baggage":"sentry-trace_id=1c64b9e34fd14044a1f5ddebc377dc38,sentry-release=Unknown"},"correlation_id":"01KZXMH3XA6XV0MPJSRSBGJKFR","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-08-13T13:21:06.285Z","job_size_bytes":3,"pid":3454,"sidekiq_tid":"m8le","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-e4df7fb68147f317f6446546: done: 0.038225 sec","job_status":"done","queue_duration_s":0.81733,"scheduling_latency_s":0.817358,"redis_calls":7,"redis_duration_s":0.001295,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000948,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000347,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.027148,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.038225,"completed_at":"2026-08-13T13:21:07.140Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00599,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2470gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/a79f628c9ab249a05c7812dd8cb5fa5e1935c219/statuses, in 0.21 seconds)2471gitlab # [ 433.460666] sidekiq-cluster[3454]: {"severity":"INFO","time":"2026-08-13T13:21:07.141Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"4f5d645b6905f3f1ed94410e","created_at":"2026-08-13T13:21:06.286Z","trace_propagation_headers":{"sentry-trace":"1c64b9e34fd14044a1f5ddebc377dc38-59ce8febf093430f","baggage":"sentry-trace_id=1c64b9e34fd14044a1f5ddebc377dc38,sentry-release=Unknown"},"correlation_id":"01KZXMH3XA6XV0MPJSRSBGJKFR","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-08-13T13:21:06.289Z","job_size_bytes":19,"pid":3454,"sidekiq_tid":"m8le","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-4f5d645b6905f3f1ed94410e: start","job_status":"start","queue_duration_s":0.852947,"scheduling_latency_s":0.852966}2472gitlab # [ 433.476450] gitaly[895]: time="2026-08-13T13:21:06.360Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZXMH3XA6XV0MPJSRSBGJKFR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-13T13:21:36.259" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-13T13:21:06.359" grpc.time_ms=0.837 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2473gitlab # [ 433.488780] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/13:13:21:07 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/a79f628c9ab249a05c7812dd8cb5fa5e1935c219/statuses HTTP/1.1" 200 633 "" "curl/8.21.0" 1532474gitlab # [ 433.491348] sidekiq-cluster[3454]: {"severity":"INFO","time":"2026-08-13T13:21:07.177Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"4f5d645b6905f3f1ed94410e","created_at":"2026-08-13T13:21:06.286Z","trace_propagation_headers":{"sentry-trace":"1c64b9e34fd14044a1f5ddebc377dc38-59ce8febf093430f","baggage":"sentry-trace_id=1c64b9e34fd14044a1f5ddebc377dc38,sentry-release=Unknown"},"correlation_id":"01KZXMH3XA6XV0MPJSRSBGJKFR","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-08-13T13:21:06.289Z","job_size_bytes":19,"pid":3454,"sidekiq_tid":"m8le","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-4f5d645b6905f3f1ed94410e: done: 0.03511 sec","job_status":"done","queue_duration_s":0.852947,"scheduling_latency_s":0.852966,"redis_calls":8,"redis_duration_s":0.001659,"redis_read_bytes":6,"redis_write_bytes":764,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00135,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":570,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000309,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":194,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020904,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.03511,"completed_at":"2026-08-13T13:21:07.176Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.009003,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2475gitlab # [ 433.533863] sidekiq-cluster[3454]: {"severity":"INFO","time":"2026-08-13T13:21:07.178Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"110739e65f1fcf59136bf798","created_at":"2026-08-13T13:21:06.290Z","trace_propagation_headers":{"sentry-trace":"1c64b9e34fd14044a1f5ddebc377dc38-59ce8febf093430f","baggage":"sentry-trace_id=1c64b9e34fd14044a1f5ddebc377dc38,sentry-release=Unknown"},"correlation_id":"01KZXMH3XA6XV0MPJSRSBGJKFR","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-08-13T13:21:06.292Z","job_size_bytes":66,"pid":3454,"sidekiq_tid":"m8le","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-110739e65f1fcf59136bf798: start","job_status":"start","queue_duration_s":0.885864,"scheduling_latency_s":0.885886}2476gitlab # [ 433.551278] gitaly[895]: time="2026-08-13T13:21:07.243Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZXMH6J0YT8SRGZ453WCM001 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-13T13:21:37.041" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-13T13:21:07.242" grpc.time_ms=0.865 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2477gitlab # [ 433.564256] sidekiq-cluster[3454]: {"severity":"INFO","time":"2026-08-13T13:21:07.212Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"110739e65f1fcf59136bf798","created_at":"2026-08-13T13:21:06.290Z","trace_propagation_headers":{"sentry-trace":"1c64b9e34fd14044a1f5ddebc377dc38-59ce8febf093430f","baggage":"sentry-trace_id=1c64b9e34fd14044a1f5ddebc377dc38,sentry-release=Unknown"},"correlation_id":"01KZXMH3XA6XV0MPJSRSBGJKFR","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-08-13T13:21:06.292Z","job_size_bytes":66,"pid":3454,"sidekiq_tid":"m8le","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-110739e65f1fcf59136bf798: done: 0.033722 sec","job_status":"done","queue_duration_s":0.885864,"scheduling_latency_s":0.885886,"redis_calls":7,"redis_duration_s":0.005613,"redis_read_bytes":5,"redis_write_bytes":761,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.005126,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000487,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":240,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020938,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.033722,"completed_at":"2026-08-13T13:21:07.212Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002811,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2478gitlab # [ 433.607819] sidekiq-cluster[3454]: {"severity":"INFO","time":"2026-08-13T13:21:07.214Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"f5cefb52ee2dc0e6dac8747c","created_at":"2026-08-13T13:21:06.293Z","trace_propagation_headers":{"sentry-trace":"1c64b9e34fd14044a1f5ddebc377dc38-59ce8febf093430f","baggage":"sentry-trace_id=1c64b9e34fd14044a1f5ddebc377dc38,sentry-release=Unknown"},"correlation_id":"01KZXMH3XA6XV0MPJSRSBGJKFR","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-08-13T13:21:06.295Z","job_size_bytes":3,"pid":3454,"sidekiq_tid":"m8le","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-f5cefb52ee2dc0e6dac8747c: start","job_status":"start","queue_duration_s":0.918953,"scheduling_latency_s":0.918973}2479gitlab # [ 433.625528] sidekiq-cluster[3454]: {"severity":"INFO","time":"2026-08-13T13:21:07.243Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"f5cefb52ee2dc0e6dac8747c","created_at":"2026-08-13T13:21:06.293Z","trace_propagation_headers":{"sentry-trace":"1c64b9e34fd14044a1f5ddebc377dc38-59ce8febf093430f","baggage":"sentry-trace_id=1c64b9e34fd14044a1f5ddebc377dc38,sentry-release=Unknown"},"correlation_id":"01KZXMH3XA6XV0MPJSRSBGJKFR","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-08-13T13:21:06.295Z","job_size_bytes":3,"pid":3454,"sidekiq_tid":"m8le","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-f5cefb52ee2dc0e6dac8747c: done: 0.029791 sec","job_status":"done","queue_duration_s":0.918953,"scheduling_latency_s":0.918973,"redis_calls":7,"redis_duration_s":0.0018720000000000002,"redis_read_bytes":5,"redis_write_bytes":656,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001396,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":458,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000476,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":198,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019902,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.029791,"completed_at":"2026-08-13T13:21:07.243Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004354,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2480gitlab # [ 433.668145] sidekiq-cluster[3454]: {"severity":"INFO","time":"2026-08-13T13:21:07.245Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"7a404eb4ffa781db5e85433e","created_at":"2026-08-13T13:21:06.295Z","trace_propagation_headers":{"sentry-trace":"1c64b9e34fd14044a1f5ddebc377dc38-59ce8febf093430f","baggage":"sentry-trace_id=1c64b9e34fd14044a1f5ddebc377dc38,sentry-release=Unknown"},"correlation_id":"01KZXMH3XA6XV0MPJSRSBGJKFR","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-13T13:21:06.297Z","job_size_bytes":6,"pid":3454,"sidekiq_tid":"m8le","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-7a404eb4ffa781db5e85433e: start","job_status":"start","queue_duration_s":0.948009,"scheduling_latency_s":0.94803}2481gitlab # [ 433.683943] sidekiq-cluster[3454]: {"severity":"INFO","time":"2026-08-13T13:21:07.261Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"7a404eb4ffa781db5e85433e","created_at":"2026-08-13T13:21:06.295Z","trace_propagation_headers":{"sentry-trace":"1c64b9e34fd14044a1f5ddebc377dc38-59ce8febf093430f","baggage":"sentry-trace_id=1c64b9e34fd14044a1f5ddebc377dc38,sentry-release=Unknown"},"correlation_id":"01KZXMH3XA6XV0MPJSRSBGJKFR","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-13T13:21:06.297Z","job_size_bytes":6,"pid":3454,"sidekiq_tid":"m8le","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-7a404eb4ffa781db5e85433e: done: 0.015697 sec","job_status":"done","queue_duration_s":0.948009,"scheduling_latency_s":0.94803,"redis_calls":7,"redis_duration_s":0.0017929999999999999,"redis_read_bytes":5,"redis_write_bytes":721,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001312,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":497,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000481,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":224,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009834,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015697,"completed_at":"2026-08-13T13:21:07.261Z","load_balancing_strategy":"primary","db_duration_s":0.000393,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2482gitlab # [ 433.726094] sidekiq-cluster[3454]: {"severity":"INFO","time":"2026-08-13T13:21:07.262Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"9c0f117bfb434577a90e2310","created_at":"2026-08-13T13:21:06.298Z","trace_propagation_headers":{"sentry-trace":"1c64b9e34fd14044a1f5ddebc377dc38-59ce8febf093430f","baggage":"sentry-trace_id=1c64b9e34fd14044a1f5ddebc377dc38,sentry-release=Unknown"},"correlation_id":"01KZXMH3XA6XV0MPJSRSBGJKFR","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-08-13T13:21:06.300Z","job_size_bytes":3,"pid":3454,"sidekiq_tid":"m8le","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-9c0f117bfb434577a90e2310: start","job_status":"start","queue_duration_s":0.962726,"scheduling_latency_s":0.962743}2483gitlab # [ 433.741364] gitaly[895]: time="2026-08-13T13:21:07.484Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZXMH5EE96TTN77SKYB5KRVP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-13T13:21:37.381" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-13T13:21:07.482" grpc.time_ms=1.545 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2484gitlab # [ 433.753926] sidekiq-cluster[3454]: {"severity":"INFO","time":"2026-08-13T13:21:07.322Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"9c0f117bfb434577a90e2310","created_at":"2026-08-13T13:21:06.298Z","trace_propagation_headers":{"sentry-trace":"1c64b9e34fd14044a1f5ddebc377dc38-59ce8febf093430f","baggage":"sentry-trace_id=1c64b9e34fd14044a1f5ddebc377dc38,sentry-release=Unknown"},"correlation_id":"01KZXMH3XA6XV0MPJSRSBGJKFR","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-08-13T13:21:06.300Z","job_size_bytes":3,"pid":3454,"sidekiq_tid":"m8le","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-9c0f117bfb434577a90e2310: done: 0.059645 sec","job_status":"done","queue_duration_s":0.962726,"scheduling_latency_s":0.962743,"redis_calls":7,"redis_duration_s":0.006537,"redis_read_bytes":5,"redis_write_bytes":636,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001935,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":446,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.004602,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.04047,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.059645,"completed_at":"2026-08-13T13:21:07.322Z","load_balancing_strategy":"primary","db_duration_s":0.005823,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2485gitlab # [ 433.795444] sidekiq-cluster[3454]: {"severity":"INFO","time":"2026-08-13T13:21:07.326Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"d26270c2a38cfd6b84484ea1","created_at":"2026-08-13T13:21:06.333Z","trace_propagation_headers":{"sentry-trace":"16c587dbaef04a9bbb73fe5a0e8c0af4-826781f7c4ad49de","baggage":"sentry-trace_id=16c587dbaef04a9bbb73fe5a0e8c0af4,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZXMH5EE96TTN77SKYB5KRVP","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-13T13:21:06.337Z","job_size_bytes":3,"pid":3454,"sidekiq_tid":"m8le","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-d26270c2a38cfd6b84484ea1: start","job_status":"start","queue_duration_s":0.988649,"scheduling_latency_s":0.988695}2486gitlab # [ 433.811547] gitaly[895]: time="2026-08-13T13:21:07.551Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZXMH5EE96TTN77SKYB5KRVP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-13T13:21:37.449" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-13T13:21:07.550" grpc.time_ms=1.086 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2487gitlab # [ 433.825259] sidekiq-cluster[3454]: {"severity":"INFO","time":"2026-08-13T13:21:07.570Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"d26270c2a38cfd6b84484ea1","created_at":"2026-08-13T13:21:06.333Z","trace_propagation_headers":{"sentry-trace":"16c587dbaef04a9bbb73fe5a0e8c0af4-826781f7c4ad49de","baggage":"sentry-trace_id=16c587dbaef04a9bbb73fe5a0e8c0af4,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZXMH5EE96TTN77SKYB5KRVP","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-13T13:21:06.337Z","job_size_bytes":3,"pid":3454,"sidekiq_tid":"m8le","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-d26270c2a38cfd6b84484ea1: done: 0.244819 sec","job_status":"done","queue_duration_s":0.988649,"scheduling_latency_s":0.988695,"gitaly_calls":2,"gitaly_duration_s":0.010368,"redis_calls":34,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.012031,"redis_read_bytes":79,"redis_write_bytes":5122,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.002049,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":10,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.001846,"redis_cache_read_bytes":19,"redis_cache_write_bytes":892,"redis_queues_calls":2,"redis_queues_duration_s":0.000579,"redis_queues_read_bytes":2,"redis_queues_write_bytes":1133,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002664,"redis_queues_metadata_read_bytes":7,"redis_queues_metadata_write_bytes":772,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000546,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":2,"redis_repository_cache_duration_s":0.000672,"redis_repository_cache_read_bytes":39,"redis_repository_cache_write_bytes":83,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001626,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":551,"db_count":27,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":27,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.044,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":13,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.005,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.009,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.023,"db_ci_duration_s":0.021,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.187749,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.17821752,"duration_s":0.244819,"completed_at":"2026-08-13T13:21:07.570Z","load_balancing_strategy":"primary","db_duration_s":0.047416,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2488gitlab # [ 433.876555] sidekiq-cluster[3454]: {"severity":"INFO","time":"2026-08-13T13:21:07.573Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"fe3da540a0502fdf84372575","created_at":"2026-08-13T13:21:06.374Z","trace_propagation_headers":{"sentry-trace":"1c64b9e34fd14044a1f5ddebc377dc38-59ce8febf093430f","baggage":"sentry-trace_id=1c64b9e34fd14044a1f5ddebc377dc38,sentry-release=Unknown"},"correlation_id":"01KZXMH3XA6XV0MPJSRSBGJKFR","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-13T13:21:06.377Z","job_size_bytes":3,"pid":3454,"sidekiq_tid":"m8le","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-fe3da540a0502fdf84372575: start","job_status":"start","queue_duration_s":1.195946,"scheduling_latency_s":1.195979}2489gitlab # [ 433.891976] sidekiq-cluster[3454]: {"severity":"INFO","time":"2026-08-13T13:21:07.614Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"fe3da540a0502fdf84372575","created_at":"2026-08-13T13:21:06.374Z","trace_propagation_headers":{"sentry-trace":"1c64b9e34fd14044a1f5ddebc377dc38-59ce8febf093430f","baggage":"sentry-trace_id=1c64b9e34fd14044a1f5ddebc377dc38,sentry-release=Unknown"},"correlation_id":"01KZXMH3XA6XV0MPJSRSBGJKFR","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-13T13:21:06.377Z","job_size_bytes":3,"pid":3454,"sidekiq_tid":"m8le","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-fe3da540a0502fdf84372575: done: 0.041061 sec","job_status":"done","queue_duration_s":1.195946,"scheduling_latency_s":1.195979,"redis_calls":8,"redis_duration_s":0.002721,"redis_read_bytes":6,"redis_write_bytes":754,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002156,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":564,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000565,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.027165,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.041061,"completed_at":"2026-08-13T13:21:07.614Z","load_balancing_strategy":"primary","db_duration_s":0.006952,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2490gitlab # [ 433.934241] sidekiq-cluster[3454]: {"severity":"INFO","time":"2026-08-13T13:21:07.616Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"9fd0092c9fe6e3c962d692f0","created_at":"2026-08-13T13:21:07.451Z","trace_propagation_headers":{"sentry-trace":"16c587dbaef04a9bbb73fe5a0e8c0af4-048f8f065838462f","baggage":"sentry-trace_id=16c587dbaef04a9bbb73fe5a0e8c0af4,sentry-release=Unknown"},"correlation_id":"01KZXMH5EE96TTN77SKYB5KRVP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-08-13T13:21:07.455Z","job_size_bytes":3,"pid":3454,"sidekiq_tid":"m8le","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-9fd0092c9fe6e3c962d692f0: start","job_status":"start","queue_duration_s":0.160702,"scheduling_latency_s":0.160728}2491gitlab # [ 433.950260] sidekiq-cluster[3454]: {"severity":"INFO","time":"2026-08-13T13:21:07.678Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"9fd0092c9fe6e3c962d692f0","created_at":"2026-08-13T13:21:07.451Z","trace_propagation_headers":{"sentry-trace":"16c587dbaef04a9bbb73fe5a0e8c0af4-048f8f065838462f","baggage":"sentry-trace_id=16c587dbaef04a9bbb73fe5a0e8c0af4,sentry-release=Unknown"},"correlation_id":"01KZXMH5EE96TTN77SKYB5KRVP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-08-13T13:21:07.455Z","job_size_bytes":3,"pid":3454,"sidekiq_tid":"m8le","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-9fd0092c9fe6e3c962d692f0: done: 0.062024 sec","job_status":"done","queue_duration_s":0.160702,"scheduling_latency_s":0.160728,"redis_calls":7,"redis_duration_s":0.0069,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.006232,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000668,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.035253,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.062024,"completed_at":"2026-08-13T13:21:07.678Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.010109,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2492gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/a79f628c9ab249a05c7812dd8cb5fa5e1935c219/statuses2493gitlab # [ 434.652947] gitaly[895]: time="2026-08-13T13:21:08.478Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZXMH7RP3BCBNTSX3FDG9Y3E grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-13T13:21:38.275" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-13T13:21:08.476" grpc.time_ms=1.364 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2494gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/a79f628c9ab249a05c7812dd8cb5fa5e1935c219/statuses, in 0.24 seconds)2495gitlab # [ 434.708498] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/13:13:21:08 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/a79f628c9ab249a05c7812dd8cb5fa5e1935c219/statuses HTTP/1.1" 200 633 "" "curl/8.21.0" 1592496gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/a79f628c9ab249a05c7812dd8cb5fa5e1935c219/statuses2497gitlab # [ 435.872139] gitaly[895]: time="2026-08-13T13:21:09.697Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZXMH8YRFEEM041ZQKV52XJA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-13T13:21:39.494" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-13T13:21:09.695" grpc.time_ms=1.298 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2498gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/a79f628c9ab249a05c7812dd8cb5fa5e1935c219/statuses, in 0.21 seconds)2499gitlab # [ 435.922613] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/13:13:21:09 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/a79f628c9ab249a05c7812dd8cb5fa5e1935c219/statuses HTTP/1.1" 200 633 "" "curl/8.21.0" 1552500gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/a79f628c9ab249a05c7812dd8cb5fa5e1935c219/statuses2501gitlab # [ 437.100522] gitaly[895]: time="2026-08-13T13:21:10.925Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZXMHA4NDN4J4AC8HFY5TGHF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-13T13:21:40.023" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-13T13:21:10.924" grpc.time_ms=1.309 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2502gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/a79f628c9ab249a05c7812dd8cb5fa5e1935c219/statuses, in 0.25 seconds)2503gitlab # [ 437.170468] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/13:13:21:10 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/a79f628c9ab249a05c7812dd8cb5fa5e1935c219/statuses HTTP/1.1" 200 633 "" "curl/8.21.0" 1892504gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/a79f628c9ab249a05c7812dd8cb5fa5e1935c219/statuses2505gitlab # [ 438.335615] gitaly[895]: time="2026-08-13T13:21:12.161Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZXMHBBNNR9M6N3CGTW540YC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-13T13:21:42.058" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-13T13:21:12.159" grpc.time_ms=1.285 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2506gitlab # [ 438.391904] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/13:13:21:12 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/a79f628c9ab249a05c7812dd8cb5fa5e1935c219/statuses HTTP/1.1" 200 633 "" "curl/8.21.0" 1632507gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/a79f628c9ab249a05c7812dd8cb5fa5e1935c219/statuses, in 0.22 seconds)2508gitlab # [ 438.398715] sidekiq-cluster[3454]: {"severity":"INFO","time":"2026-08-13T13:21:12.223Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"f7fe72ce27cdeb1b172d0321","created_at":"2026-08-13T13:21:12.179Z","trace_propagation_headers":{"sentry-trace":"481f15f216684f589cfee6d32bc3fb13-8676071081a04e4c","baggage":"sentry-trace_id=481f15f216684f589cfee6d32bc3fb13,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f74ebc6ead79d36375226db3e9a3ecd1","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-13T13:21:12.200Z","job_size_bytes":2,"pid":3454,"sidekiq_tid":"m8le","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-f7fe72ce27cdeb1b172d0321: start","job_status":"start","queue_duration_s":0.023387,"scheduling_latency_s":0.023448}2509gitlab # [ 438.422558] gitaly[895]: time="2026-08-13T13:21:12.248Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZXMHBEAETDADY0AQ5CHG7JQ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-13T13:21:42.046" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-13T13:21:12.247" grpc.time_ms=1.011 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2510gitlab # [ 438.556220] gitaly[895]: time="2026-08-13T13:21:12.382Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=9 component=gitaly.StreamServerInterceptor correlation_id=01KZXMHBEAETDADY0AQ5CHG7JQ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-13T13:21:22.182" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-13T13:21:12.363" grpc.time_ms=18.386 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2511gitlab # [ 438.586188] sidekiq-cluster[3454]: {"severity":"INFO","time":"2026-08-13T13:21:12.383Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"f7fe72ce27cdeb1b172d0321","created_at":"2026-08-13T13:21:12.179Z","trace_propagation_headers":{"sentry-trace":"481f15f216684f589cfee6d32bc3fb13-8676071081a04e4c","baggage":"sentry-trace_id=481f15f216684f589cfee6d32bc3fb13,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f74ebc6ead79d36375226db3e9a3ecd1","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-13T13:21:12.200Z","job_size_bytes":2,"pid":3454,"sidekiq_tid":"m8le","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-f7fe72ce27cdeb1b172d0321: done: 0.159413 sec","job_status":"done","queue_duration_s":0.023387,"scheduling_latency_s":0.023448,"redis_calls":9,"redis_duration_s":0.015637,"redis_read_bytes":7,"redis_write_bytes":984,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00391,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.009618,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":473,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002109,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":208,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.045661,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.159413,"completed_at":"2026-08-13T13:21:12.382Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.009874,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2512gitlab # [ 438.642106] sidekiq-cluster[3454]: {"severity":"INFO","time":"2026-08-13T13:21:12.396Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"e9e882fb064bc68fd5e784c7","created_at":"2026-08-13T13:21:12.220Z","trace_propagation_headers":{"sentry-trace":"481f15f216684f589cfee6d32bc3fb13-8676071081a04e4c","baggage":"sentry-trace_id=481f15f216684f589cfee6d32bc3fb13,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"471c73ae18575df7d7589a780adc2c4a","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-13T13:21:12.236Z","job_size_bytes":2,"pid":3454,"sidekiq_tid":"m8le","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-e9e882fb064bc68fd5e784c7: start","job_status":"start","queue_duration_s":0.159612,"scheduling_latency_s":0.159679}2513gitlab # [ 438.667190] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/13:13:21:12 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/a79f628c9ab249a05c7812dd8cb5fa5e1935c219 HTTP/1.1" 201 670 "" "python-httpx/0.28.1" 3542514gitlab # [ 438.671527] nixbot[3544]: {"ts": "2026-08-13T13:21:12.494Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/a79f628c9ab249a05c7812dd8cb5fa5e1935c219 \"HTTP/1.1 201 Created\""}2515gitlab # [ 438.785191] gitaly[895]: time="2026-08-13T13:21:12.611Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZXMHBSNN6Z8TSCMJA2N6SC0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-13T13:21:42.508" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-13T13:21:12.609" grpc.time_ms=1.418 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2516gitlab # [ 438.874774] gitaly[895]: time="2026-08-13T13:21:12.701Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=2 command.system_time_ms=8 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01KZXMHBSNN6Z8TSCMJA2N6SC0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-13T13:21:22.004" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-13T13:21:12.684" grpc.time_ms=16.016 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2517gitlab # [ 438.985836] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/13:13:21:12 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/a79f628c9ab249a05c7812dd8cb5fa5e1935c219 HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 3102518gitlab # [ 438.993990] nixbot[3544]: {"ts": "2026-08-13T13:21:12.813Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/a79f628c9ab249a05c7812dd8cb5fa5e1935c219 \"HTTP/1.1 201 Created\""}2519gitlab # [ 439.119419] gitaly[895]: time="2026-08-13T13:21:12.945Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZXMHC3Y8WHH63H018H8V28V grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-13T13:21:42.743" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-13T13:21:12.944" grpc.time_ms=1.126 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2520gitlab # [ 439.203088] gitaly[895]: time="2026-08-13T13:21:13.029Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZXMHC3Y8WHH63H018H8V28V grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-13T13:21:23.009" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-13T13:21:13.010" grpc.time_ms=18.397 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2521gitlab # [ 439.307510] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/13:13:21:13 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/a79f628c9ab249a05c7812dd8cb5fa5e1935c219 HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 3022522gitlab # [ 439.315861] nixbot[3544]: {"ts": "2026-08-13T13:21:13.135Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/a79f628c9ab249a05c7812dd8cb5fa5e1935c219 \"HTTP/1.1 201 Created\""}2523gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/a79f628c9ab249a05c7812dd8cb5fa5e1935c219/statuses2524gitlab # [ 439.447372] nix-daemon[3765]: accepted connection from pid 4509, user nixbot2525gitlab # [ 439.548706] gitaly[895]: time="2026-08-13T13:21:13.373Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZXMHCJ3RSVMDE3B74SWRWYV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-13T13:21:43.272" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-13T13:21:13.372" grpc.time_ms=1.028 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2526gitlab # [ 439.583671] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/13:13:21:13 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/a79f628c9ab249a05c7812dd8cb5fa5e1935c219/statuses HTTP/1.1" 200 1329 "" "curl/8.21.0" 1252527gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/a79f628c9ab249a05c7812dd8cb5fa5e1935c219/statuses, in 0.20 seconds)2528(finished: subtest: eval and build post commit statuses, in 6.33 seconds)2529(finished: run the VM test script, in 507.33 seconds)2530gitlab # [ 439.608714] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/13:13:21:13 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 792531test script finished in 507.38s2532cleanup2533kill QemuMachine (pid 46)2534gitlab # [ 439.616271] gitaly[895]: time="2026-08-13T13:21:13.434Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=580 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=4 component=gitaly.StreamServerInterceptor correlation_id=01KZXMHCMBDKRA4AN7PT29E49M grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-13T13:21:13.420" grpc.time_ms=13.896 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc2535gitlab # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/41m77i1296n33p6liin8ynr6wh3h6b7m-python3-3.14.6/bin/python3.14)2536(finished: cleanup, in 1.46 seconds)2537additionally exposed symbols:2538 gitlab,2539 vlan1,2540 start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh2541[]2542[{'id': 1, 'url': 'http://buildbot:8010/webhooks/gitlab', 'name': None, 'description': None, 'created_at': '2026-08-13T13:19:30.271Z', 'push_events': True, 'tag_push_events': False, 'merge_requests_events': True, 'repository_update_events': False, 'enable_ssl_verification': True, 'alert_status': 'executable', 'disabled_until': None, 'push_events_branch_filter': None, 'branch_filter_strategy': 'wildcard', 'custom_webhook_template': None, 'token_present': True, 'signing_token_present': False, 'project_id': 1, 'issues_events': False, 'confidential_issues_events': False, 'note_events': False, 'confidential_note_events': None, 'pipeline_events': False, 'wiki_page_events': False, 'deployment_events': False, 'feature_flag_events': False, 'job_events': False, 'releases_events': False, 'milestone_events': False, 'emoji_events': False, 'resource_access_token_events': False, 'resource_deploy_token_events': False, 'vulnerability_events': False}]2543[]2544[]2545[]2546[]2547[]2548[]2549[]2550[]2551[]2552[]2553[]2554[]2555[]2556[]2557[]2558[]2559[]2560[]2561[]2562[]2563[]2564[]2565[]2566[]2567[]2568[]2569[]2570[]2571[]2572[]2573[]2574[]2575[]2576[]2577[]2578[]2579[]2580[]2581[]2582[]2583[]2584[]2585[]2586[]2587[]2588[]2589[]2590[]2591[]2592[]2593[]2594[]2595[]2596[]2597[]2598[]2599[]2600[]2601[]2602[]2603[]2604[]2605[]2606[]2607[]2608[]2609[]2610[]2611[]2612[]2613[]2614[]2615[]2616[]2617[]2618[]2619[]2620[]2621[]2622[]2623[]2624[]2625[]2626[]2627[]2628[]2629[]2630[]2631[]2632[]2633[{'id': 2, 'project_id': 1, 'number': 2, 'tree_hash': 'cefc112e8680bb0f9569544b9656644ac3312d93', 'commit_sha': 'a79f628c9ab249a05c7812dd8cb5fa5e1935c219', 'branch': 'master', 'pr_number': None, 'pr_author': None, 'status': 'evaluating', 'eval_warnings': [{'level': 'warning', 'message': "could not read HEAD ref from repo at '/var/lib/nixbot/worktrees/1-a79f628c9ab2-4', using 'master'", 'count': 1}], 'error': None, 'created_at': '2026-08-13T13:21:05.984118Z', 'started_at': '2026-08-13T13:21:06.364571Z', 'finished_at': None}]2634[{'id': 5, 'sha': 'a79f628c9ab249a05c7812dd8cb5fa5e1935c219', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluating flake', 'created_at': '2026-08-13T13:21:06.325Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2635[{'id': 5, 'sha': 'a79f628c9ab249a05c7812dd8cb5fa5e1935c219', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluating flake', 'created_at': '2026-08-13T13:21:06.325Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2636[{'id': 5, 'sha': 'a79f628c9ab249a05c7812dd8cb5fa5e1935c219', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluating flake', 'created_at': '2026-08-13T13:21:06.325Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2637[{'id': 5, 'sha': 'a79f628c9ab249a05c7812dd8cb5fa5e1935c219', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluating flake', 'created_at': '2026-08-13T13:21:06.325Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2638[{'id': 5, 'sha': 'a79f628c9ab249a05c7812dd8cb5fa5e1935c219', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluating flake', 'created_at': '2026-08-13T13:21:06.325Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2639[{'id': 5, 'sha': 'a79f628c9ab249a05c7812dd8cb5fa5e1935c219', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluation succeeded (2 warnings)', 'created_at': '2026-08-13T13:21:06.325Z', 'started_at': None, 'finished_at': '2026-08-13T13:21:12.426Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}, {'id': 6, 'sha': 'a79f628c9ab249a05c7812dd8cb5fa5e1935c219', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-build', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': '0 attributes built', 'created_at': '2026-08-13T13:21:12.753Z', 'started_at': None, 'finished_at': '2026-08-13T13:21:13.079Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]